Jul 17 17:54:33.897390 ip-10-0-132-226 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 17 17:54:33.897561 ip-10-0-132-226 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 17 17:54:33.897661 ip-10-0-132-226 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 17 17:54:33.898228 ip-10-0-132-226 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 17 17:54:43.647850 ip-10-0-132-226 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 17 17:54:43.647861 ip-10-0-132-226 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 30f3362ad92149f28925bea2159bd31f --
Jul 17 17:56:11.510620 ip-10-0-132-226 systemd[1]: Starting Kubernetes Kubelet...
Jul 17 17:56:11.974264 ip-10-0-132-226 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 17:56:11.974264 ip-10-0-132-226 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 17 17:56:11.974264 ip-10-0-132-226 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 17:56:11.974264 ip-10-0-132-226 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 17 17:56:11.974264 ip-10-0-132-226 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 17 17:56:11.974264 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.968540    2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 17 17:56:11.985149 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975878    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 17:56:11.985149 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975893    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 17:56:11.985149 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975896    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 17:56:11.985149 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975900    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 17:56:11.985149 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975902    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 17:56:11.985149 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975906    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 17:56:11.985149 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975909    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 17:56:11.985149 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975912    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 17:56:11.985149 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975915    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 17:56:11.985149 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975918    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 17:56:11.985149 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975921    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 17:56:11.985149 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975923    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 17:56:11.985149 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975926    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 17:56:11.985149 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975929    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 17:56:11.985149 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975932    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 17:56:11.985149 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975936    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 17:56:11.985149 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975939    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 17:56:11.985149 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975941    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 17:56:11.985149 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975944    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 17:56:11.985149 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975947    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 17:56:11.993647 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975950    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 17:56:11.993647 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975953    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 17:56:11.993647 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975955    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 17:56:11.993647 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975958    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 17:56:11.993647 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975961    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 17:56:11.993647 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975964    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 17:56:11.993647 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975967    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 17:56:11.993647 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975969    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 17:56:11.993647 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975972    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 17:56:11.993647 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975975    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 17:56:11.993647 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975977    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 17:56:11.993647 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975980    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 17:56:11.993647 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975983    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 17:56:11.993647 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975986    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 17:56:11.993647 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975988    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 17:56:11.993647 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975991    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 17:56:11.993647 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975993    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 17:56:11.993647 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975995    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 17:56:11.993647 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.975998    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 17:56:11.997963 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976000    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 17:56:11.997963 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976002    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 17:56:11.997963 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976005    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 17:56:11.997963 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976007    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 17:56:11.997963 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976009    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 17:56:11.997963 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976012    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 17:56:11.997963 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976015    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 17:56:11.997963 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976018    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 17:56:11.997963 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976022    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 17:56:11.997963 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976025    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 17:56:11.997963 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976028    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 17:56:11.997963 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976030    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 17:56:11.997963 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976033    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 17:56:11.997963 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976035    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 17:56:11.997963 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976038    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 17:56:11.997963 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976040    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 17:56:11.997963 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976043    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 17:56:11.997963 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976045    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 17:56:11.997963 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976047    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 17:56:11.997963 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976050    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 17:56:12.005178 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976052    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 17:56:12.005178 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976055    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 17:56:12.005178 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976058    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 17:56:12.005178 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976063    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 17:56:12.005178 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976067    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 17:56:12.005178 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976069    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 17:56:12.005178 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976072    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 17:56:12.005178 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976075    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 17:56:12.005178 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976078    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 17:56:12.005178 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976080    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 17:56:12.005178 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976083    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 17:56:12.005178 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976086    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 17:56:12.005178 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976090    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 17:56:12.005178 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976093    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 17:56:12.005178 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976095    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 17:56:12.005178 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976099    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 17:56:12.005178 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976102    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 17:56:12.005178 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976105    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 17:56:12.005178 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976108    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 17:56:12.009609 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976112    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 17:56:12.009609 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976115    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 17:56:12.009609 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976117    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 17:56:12.009609 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976120    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 17:56:12.009609 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976122    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 17:56:12.009609 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976125    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 17:56:12.009609 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976127    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 17:56:12.009609 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976131    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 17:56:12.009609 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976135    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 17:56:12.009609 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976138    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 17:56:12.009609 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976140    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 17:56:12.009609 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976142    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 17:56:12.009609 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976145    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 17:56:12.009609 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976147    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 17:56:12.009609 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976150    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 17:56:12.009609 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976153    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 17:56:12.009609 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976155    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 17:56:12.009609 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976158    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 17:56:12.009609 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976160    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 17:56:12.009609 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976163    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 17:56:12.021222 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.976165    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 17:56:12.021222 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977765    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 17:56:12.021222 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977773    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 17:56:12.021222 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977777    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 17:56:12.021222 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977780    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 17:56:12.021222 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977785    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 17:56:12.021222 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977789    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 17:56:12.021222 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977792    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 17:56:12.021222 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977796    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 17:56:12.021222 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977799    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 17:56:12.021222 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977802    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 17:56:12.021222 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977805    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 17:56:12.021222 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977808    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 17:56:12.021222 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977811    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 17:56:12.021222 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977814    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 17:56:12.021222 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977817    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 17:56:12.021222 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977820    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 17:56:12.021222 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977823    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 17:56:12.021222 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977825    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 17:56:12.021222 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977828    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 17:56:12.024476 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977831    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 17:56:12.024476 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977833    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 17:56:12.024476 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977836    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 17:56:12.024476 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977839    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 17:56:12.024476 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977841    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 17:56:12.024476 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977844    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 17:56:12.024476 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977846    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 17:56:12.024476 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977849    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 17:56:12.024476 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977852    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 17:56:12.024476 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977854    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 17:56:12.024476 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977857    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 17:56:12.024476 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977860    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 17:56:12.024476 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977863    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 17:56:12.024476 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977865    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 17:56:12.024476 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977868    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 17:56:12.024476 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977871    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 17:56:12.024476 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977873    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 17:56:12.024476 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977875    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 17:56:12.024476 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977878    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 17:56:12.024476 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977881    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 17:56:12.027752 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977883    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 17:56:12.027752 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977886    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 17:56:12.027752 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977888    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 17:56:12.027752 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977891    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 17:56:12.027752 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977894    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 17:56:12.027752 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977897    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 17:56:12.027752 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977899    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 17:56:12.027752 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977902    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 17:56:12.027752 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977904    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 17:56:12.027752 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977907    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 17:56:12.027752 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977909    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 17:56:12.027752 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977912    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 17:56:12.027752 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977914    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 17:56:12.027752 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977917    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 17:56:12.027752 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977920    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 17:56:12.027752 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977923    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 17:56:12.027752 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977925    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 17:56:12.027752 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977928    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 17:56:12.027752 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977930    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 17:56:12.027752 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977934    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 17:56:12.245568 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977938    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 17:56:12.245568 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977942    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 17:56:12.245568 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977945    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 17:56:12.245568 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977948    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 17:56:12.245568 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977951    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 17:56:12.245568 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977954    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 17:56:12.245568 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977957    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 17:56:12.245568 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977959    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 17:56:12.245568 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977962    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 17:56:12.245568 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977966    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 17:56:12.245568 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977969    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 17:56:12.245568 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977972    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 17:56:12.245568 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977974    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 17:56:12.245568 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977977    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 17:56:12.245568 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977979    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 17:56:12.245568 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977982    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 17:56:12.245568 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977985    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 17:56:12.245568 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977987    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 17:56:12.245568 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977990    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 17:56:12.198240 ip-10-0-132-226 systemd[1]: Started Kubernetes Kubelet.
Jul 17 17:56:12.262865 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977993    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 17:56:12.262865 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977995    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 17:56:12.262865 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.977998    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 17:56:12.262865 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978001    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 17:56:12.262865 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978003    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 17:56:12.262865 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978007    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 17:56:12.262865 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978010    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 17:56:12.262865 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978013    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 17:56:12.262865 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978015    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 17:56:12.262865 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978018    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 17:56:12.262865 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978020    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 17:56:12.262865 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978023    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 17:56:12.262865 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978026    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 17:56:12.262865 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978029    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 17:56:12.262865 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978031    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 17:56:12.262865 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978034    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 17:56:12.262865 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978036    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 17:56:12.262865 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978040    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 17:56:12.262865 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978042    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 17:56:12.262865 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978045    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 17:56:12.263883 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978047    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 17:56:12.263883 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978477    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 17:56:12.263883 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978483    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 17:56:12.263883 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978486    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 17:56:12.263883 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978489    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 17:56:12.263883 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978492    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 17:56:12.263883 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978495    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 17:56:12.263883 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978498    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 17:56:12.263883 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978501    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 17:56:12.263883 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978506    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 17:56:12.263883 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978509    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 17:56:12.263883 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978512    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 17:56:12.263883 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978514    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 17:56:12.263883 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978517    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 17:56:12.263883 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978519    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 17:56:12.263883 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978522    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 17:56:12.263883 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978524    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 17:56:12.263883 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978527    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 17:56:12.263883 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978529    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 17:56:12.263883 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978533    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 17:56:12.264956 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978536    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 17:56:12.264956 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978538    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 17:56:12.264956 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978541    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 17:56:12.264956 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978543    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 17:56:12.264956 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978546    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 17:56:12.264956 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978549    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 17:56:12.264956 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978553    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 17:56:12.264956 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978556    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 17:56:12.264956 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978558    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 17:56:12.264956 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978563    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 17:56:12.264956 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978566    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 17:56:12.264956 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978568    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 17:56:12.264956 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978570    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 17:56:12.264956 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978573    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 17:56:12.264956 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978576    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 17:56:12.264956 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978579    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 17:56:12.264956 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978582    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 17:56:12.264956 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978586    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 17:56:12.264956 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978590    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 17:56:12.264956 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978592    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 17:56:12.265803 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978596    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 17:56:12.265803 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978601    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 17:56:12.265803 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978603    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 17:56:12.265803 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978606    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 17:56:12.265803 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978608    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 17:56:12.265803 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978611    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 17:56:12.265803 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978614    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 17:56:12.265803 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978617    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 17:56:12.265803 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978619    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 17:56:12.265803 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978622    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 17:56:12.265803 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978624    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 17:56:12.265803 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978627    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 17:56:12.265803 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978629    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 17:56:12.265803 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978631    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 17:56:12.265803 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978634    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 17:56:12.265803 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978636    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 17:56:12.265803 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978639    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 17:56:12.265803 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978641    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 17:56:12.265803 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978647    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 17:56:12.265803 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978650    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 17:56:12.266843 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978653    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 17:56:12.266843 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978656    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 17:56:12.266843 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978659    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 17:56:12.266843 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978662    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 17:56:12.266843 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978664    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 17:56:12.266843 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978667    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 17:56:12.266843 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978670    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 17:56:12.266843 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978673    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 17:56:12.266843 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978675    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 17:56:12.266843 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978678    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 17:56:12.266843 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978680    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 17:56:12.266843 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978683    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 17:56:12.266843 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978685    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 17:56:12.266843 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978689    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 17:56:12.266843 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978691    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 17:56:12.266843 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978694    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 17:56:12.266843 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978696    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 17:56:12.266843 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978699    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 17:56:12.266843 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978702    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 17:56:12.266843 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978704    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 17:56:12.267485 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978706    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 17:56:12.267485 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978709    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 17:56:12.267485 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978711    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 17:56:12.267485 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978714    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 17:56:12.267485 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978716    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 17:56:12.267485 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978719    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 17:56:12.267485 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978721    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 17:56:12.267485 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978724    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 17:56:12.267485 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978726    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 17:56:12.267485 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978728    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 17:56:12.267485 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978733    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 17:56:12.267485 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978736    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 17:56:12.267485 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978739    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 17:56:12.267485 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978742    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 17:56:12.267485 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978744    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 17:56:12.267485 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978747    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 17:56:12.267485 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978749    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 17:56:12.267485 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978752    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 17:56:12.267485 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978754    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 17:56:12.268717 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.978757    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 17:56:12.268717 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978837    2572 flags.go:64] FLAG: --address="0.0.0.0"
Jul 17 17:56:12.268717 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978855    2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 17 17:56:12.268717 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978863    2572 flags.go:64] FLAG: --anonymous-auth="true"
Jul 17 17:56:12.268717 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978867    2572 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 17 17:56:12.268717 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978871    2572 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 17 17:56:12.268717 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978876    2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 17 17:56:12.268717 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978881    2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 17 17:56:12.268717 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978886    2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 17 17:56:12.268717 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978889    2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 17 17:56:12.268717 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978892    2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 17 17:56:12.268717 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978895    2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 17 17:56:12.268717 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978898    2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 17 17:56:12.268717 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978901    2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 17 17:56:12.268717 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978904    2572 flags.go:64] FLAG: --cgroup-root=""
Jul 17 17:56:12.268717 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978907    2572 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 17 17:56:12.268717 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978910    2572 flags.go:64] FLAG: --client-ca-file=""
Jul 17 17:56:12.268717 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978913    2572 flags.go:64] FLAG: --cloud-provider="external"
Jul 17 17:56:12.268717 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978915    2572 flags.go:64] FLAG: --cluster-dns="[]"
Jul 17 17:56:12.268717 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978920    2572 flags.go:64] FLAG: --cluster-domain=""
Jul 17 17:56:12.268717 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978923    2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 17 17:56:12.268717 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978926    2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 17 17:56:12.268717 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978929    2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 17 17:56:12.268717 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978934    2572 flags.go:64] FLAG: --container-log-max-files="5"
Jul 17 17:56:12.269534 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978938    2572 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 17 17:56:12.269534 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978941    2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 17 17:56:12.269534 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978944    2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 17 17:56:12.269534 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978947    2572 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 17 17:56:12.269534 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978950    2572 flags.go:64] FLAG: --contention-profiling="false"
Jul 17 17:56:12.269534 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978954    2572 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 17 17:56:12.269534 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978957    2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 17 17:56:12.269534 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978960    2572 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 17 17:56:12.269534 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978963    2572 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 17 17:56:12.269534 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978967    2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 17 17:56:12.269534 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978970    2572 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 17 17:56:12.269534 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978973    2572 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 17 17:56:12.269534 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978976    2572 flags.go:64] FLAG: --enable-load-reader="false"
Jul 17 17:56:12.269534 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978979    2572 flags.go:64] FLAG: --enable-server="true"
Jul 17 17:56:12.269534 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978983    2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 17 17:56:12.269534 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978988    2572 flags.go:64] FLAG: --event-burst="100"
Jul 17 17:56:12.269534 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978991    2572 flags.go:64] FLAG: --event-qps="50"
Jul 17 17:56:12.269534 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978994    2572 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 17 17:56:12.269534 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.978997    2572 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 17 17:56:12.269534 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979000    2572 flags.go:64] FLAG: --eviction-hard=""
Jul 17 17:56:12.269534 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979004    2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 17 17:56:12.269534 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979007    2572 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 17 17:56:12.269534 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979010    2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 17 17:56:12.269534 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979013    2572 flags.go:64] FLAG: --eviction-soft=""
Jul 17 17:56:12.269534 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979016    2572 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 17 17:56:12.270353 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979019    2572 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 17 17:56:12.270353 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979022    2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 17 17:56:12.270353 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979025    2572 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 17 17:56:12.270353 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979028    2572 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 17 17:56:12.270353 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979031    2572 flags.go:64] FLAG: --fail-swap-on="true"
Jul 17 17:56:12.270353 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979034    2572 flags.go:64] FLAG: --feature-gates=""
Jul 17 17:56:12.270353 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979039    2572 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 17 17:56:12.270353 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979042    2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 17 17:56:12.270353 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979045    2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 17 17:56:12.270353 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979048    2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 17 17:56:12.270353 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979051    2572 flags.go:64] FLAG: --healthz-port="10248"
Jul 17 17:56:12.270353 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979054    2572 flags.go:64] FLAG: --help="false"
Jul 17 17:56:12.270353 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979057    2572 flags.go:64] FLAG: --hostname-override="ip-10-0-132-226.ec2.internal"
Jul 17 17:56:12.270353 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979060    2572 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 17 17:56:12.270353 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979063    2572 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 17 17:56:12.270353 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979066    2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 17 17:56:12.270353 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979070    2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 17 17:56:12.270353 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979074    2572 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 17 17:56:12.270353 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979090    2572 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 17 17:56:12.270353 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979094    2572 flags.go:64] FLAG: --image-service-endpoint=""
Jul 17 17:56:12.270353 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979097    2572 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 17 17:56:12.270353 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979102    2572 flags.go:64] FLAG: --kube-api-burst="100"
Jul 17 17:56:12.270353 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979106    2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 17 17:56:12.271123 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979109    2572 flags.go:64] FLAG: --kube-api-qps="50"
Jul 17 17:56:12.271123 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979112    2572 flags.go:64] FLAG: --kube-reserved=""
Jul 17 17:56:12.271123 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979115    2572 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 17 17:56:12.271123 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979118    2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 17 17:56:12.271123 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979121    2572 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 17 17:56:12.271123 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979124    2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 17 17:56:12.271123 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979127    2572 flags.go:64] FLAG: --lock-file=""
Jul 17 17:56:12.271123 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979130    2572 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 17 17:56:12.271123 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979133    2572 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 17 17:56:12.271123 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979136    2572 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 17 17:56:12.271123 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979142    2572 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 17 17:56:12.271123 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979145    2572 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 17 17:56:12.271123 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979148    2572 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 17 17:56:12.271123 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979150    2572 flags.go:64] FLAG: --logging-format="text"
Jul 17 17:56:12.271123 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979153    2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 17 17:56:12.271123 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979159    2572 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 17 17:56:12.271123 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979162    2572 flags.go:64] FLAG: --manifest-url=""
Jul 17 17:56:12.271123 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979164    2572 flags.go:64] FLAG: --manifest-url-header=""
Jul 17 17:56:12.271123 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979169    2572 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 17 17:56:12.271123 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979172    2572 flags.go:64] FLAG: --max-open-files="1000000"
Jul 17 17:56:12.271123 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979176    2572 flags.go:64] FLAG: --max-pods="110"
Jul 17 17:56:12.271123 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979179    2572 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 17 17:56:12.271123 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979182    2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 17 17:56:12.271123 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979185    2572 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 17 17:56:12.271123 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979188    2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 17 17:56:12.271958 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979192    2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 17 17:56:12.271958 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979195    2572 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 17 17:56:12.271958 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979197    2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 17 17:56:12.271958 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979205    2572 flags.go:64] FLAG: --node-status-max-images="50"
Jul 17 17:56:12.271958 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979208    2572 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 17 17:56:12.271958 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979212    2572 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 17 17:56:12.271958 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979215    2572 flags.go:64] FLAG: --pod-cidr=""
Jul 17 17:56:12.271958 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979218    2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 17 17:56:12.271958 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979223    2572 flags.go:64] FLAG: --pod-manifest-path=""
Jul 17 17:56:12.271958 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979226    2572 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 17 17:56:12.271958 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979229    2572 flags.go:64] FLAG: --pods-per-core="0"
Jul 17 17:56:12.271958 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979232    2572 flags.go:64] FLAG: --port="10250"
Jul 17 17:56:12.271958 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979236    2572 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 17 17:56:12.271958 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979238    2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03a7976754a62d4ff"
Jul 17 17:56:12.271958 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979242    2572 flags.go:64] FLAG: --qos-reserved=""
Jul 17 17:56:12.271958 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979245    2572 flags.go:64] FLAG: --read-only-port="10255"
Jul 17 17:56:12.271958 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979248    2572 flags.go:64] FLAG: --register-node="true"
Jul 17 17:56:12.271958 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979250    2572 flags.go:64] FLAG: --register-with-taints=""
Jul 17 17:56:12.271958 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979254    2572 flags.go:64] FLAG: --registry-burst="10"
Jul 17 17:56:12.271958 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979257    2572 flags.go:64] FLAG: --registry-qps="5"
Jul 17 17:56:12.271958 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979259    2572 flags.go:64] FLAG: --reserved-cpus=""
Jul 17 17:56:12.271958 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979262    2572 flags.go:64] FLAG: --reserved-memory=""
Jul 17 17:56:12.271958 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979267    2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 17 17:56:12.271958 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979270    2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 17 17:56:12.271958 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979273    2572 flags.go:64] FLAG: --rotate-certificates="false"
Jul 17 17:56:12.273200 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979276    2572 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 17 17:56:12.273200 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979279    2572 flags.go:64] FLAG: --runonce="false"
Jul 17 17:56:12.273200 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979282    2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 17 17:56:12.273200 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979297    2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 17 17:56:12.273200 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979300    2572 flags.go:64] FLAG: --seccomp-default="false"
Jul 17 17:56:12.273200 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979303    2572 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 17 17:56:12.273200 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979306    2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 17 17:56:12.273200 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979309    2572 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 17 17:56:12.273200 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979313    2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 17 17:56:12.273200 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979316    2572 flags.go:64] FLAG: --storage-driver-password="root"
Jul 17 17:56:12.273200 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979318    2572 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 17 17:56:12.273200 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979321    2572 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 17 17:56:12.273200 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979324    2572 flags.go:64] FLAG: --storage-driver-user="root"
Jul 17 17:56:12.273200 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979328    2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 17 17:56:12.273200 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979331    2572 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 17 17:56:12.273200 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979334    2572 flags.go:64] FLAG: --system-cgroups=""
Jul 17 17:56:12.273200 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979337    2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 17 17:56:12.273200 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979342    2572 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 17 17:56:12.273200 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979345    2572 flags.go:64] FLAG: --tls-cert-file=""
Jul 17 17:56:12.273200 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979348    2572 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 17 17:56:12.273200 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979353    2572 flags.go:64] FLAG: --tls-min-version=""
Jul 17 17:56:12.273200 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979355    2572 flags.go:64] FLAG: --tls-private-key-file=""
Jul 17 17:56:12.273200 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979358    2572 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 17 17:56:12.273200 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979361    2572 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 17 17:56:12.273200 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979364    2572 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 17 17:56:12.274074 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979367    2572 flags.go:64] FLAG: --v="2"
Jul 17 17:56:12.274074 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979371    2572 flags.go:64] FLAG: --version="false"
Jul 17 17:56:12.274074 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979375    2572 flags.go:64] FLAG: --vmodule=""
Jul 17 17:56:12.274074 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979379    2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 17 17:56:12.274074 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979384    2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 17 17:56:12.274074 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979504    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 17:56:12.274074 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979509    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 17:56:12.274074 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979512    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 17:56:12.274074 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979515    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 17:56:12.274074 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979518    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 17:56:12.274074 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979521    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 17:56:12.274074 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979524    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 17:56:12.274074 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979526    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 17:56:12.274074 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979529    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 17:56:12.274074 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979532    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 17:56:12.274074 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979535    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 17:56:12.274074 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979537    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 17:56:12.274074 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979539    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 17:56:12.274074 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979542    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 17:56:12.274074 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979545    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 17:56:12.274074 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979549    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 17:56:12.274918 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979551    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 17:56:12.274918 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979554    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 17:56:12.274918 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979556    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 17:56:12.274918 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979559    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 17:56:12.274918 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979561    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 17:56:12.274918 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979564    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 17:56:12.274918 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979567    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 17:56:12.274918 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979569    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 17:56:12.274918 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979571    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 17:56:12.274918 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979574    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 17:56:12.274918 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979576    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 17:56:12.274918 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979579    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 17:56:12.274918 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979581    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 17:56:12.274918 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979584    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 17:56:12.274918 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979586    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 17:56:12.274918 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979590    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 17:56:12.274918 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979593    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 17:56:12.274918 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979595    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 17:56:12.274918 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979598    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 17:56:12.274918 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979600    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 17:56:12.275486 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979603    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 17:56:12.275486 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979605    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 17:56:12.275486 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979607    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 17:56:12.275486 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979610    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 17:56:12.275486 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979613    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 17:56:12.275486 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979616    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 17:56:12.275486 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979619    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 17:56:12.275486 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979621    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 17:56:12.275486 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979624    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 17:56:12.275486 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979627    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 17:56:12.275486 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979629    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 17:56:12.275486 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979633    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 17:56:12.275486 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979636    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 17:56:12.275486 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979638    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 17:56:12.275486 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979641    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 17:56:12.275486 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979643    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 17:56:12.275486 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979646    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 17:56:12.275486 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979648    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 17:56:12.275486 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979651    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 17:56:12.275486 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979653    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 17:56:12.276035 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979656    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 17:56:12.276035 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979658    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 17:56:12.276035 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979661    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 17:56:12.276035 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979663    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 17:56:12.276035 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979666    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 17:56:12.276035 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979668    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 17:56:12.276035 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979671    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 17:56:12.276035 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979674    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 17:56:12.276035 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979677    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 17:56:12.276035 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979681    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 17:56:12.276035 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979685    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 17:56:12.276035 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979688    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 17:56:12.276035 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979691    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 17:56:12.276035 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979693    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 17:56:12.276035 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979695    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 17:56:12.276035 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979698    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 17:56:12.276035 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979701    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 17:56:12.276035 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979704    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 17:56:12.276035 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979706    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 17:56:12.277959 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979709    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 17:56:12.277959 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979712    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 17:56:12.277959 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979714    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 17:56:12.277959 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979716    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 17:56:12.277959 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979721    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 17:56:12.277959 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979724    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 17:56:12.277959 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979728    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 17:56:12.277959 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979732    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 17:56:12.277959 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979735    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 17:56:12.277959 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979738    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 17:56:12.277959 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979741    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 17:56:12.277959 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979744    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 17:56:12.277959 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979747    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 17:56:12.277959 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979750    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 17:56:12.277959 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979753    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 17:56:12.277959 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979756    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 17:56:12.277959 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979758    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 17:56:12.277959 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979761    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 17:56:12.277959 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979763    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 17:56:12.277959 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979766    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 17:56:12.284312 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979769    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 17:56:12.284312 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979772    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 17:56:12.284312 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979774    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 17:56:12.284312 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.979777    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 17:56:12.284312 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.979783    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 17:56:12.284312 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.989658    2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 17 17:56:12.284312 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.989675    2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 17 17:56:12.284312 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.990587    2572 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 17 17:56:12.284312 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.990596    2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 17 17:56:12.284312 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990655    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 17:56:12.284312 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990661    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 17:56:12.284312 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990664    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 17:56:12.284312 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990667    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 17:56:12.284312 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990670    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 17:56:12.284312 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990673    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 17:56:12.285021 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990678    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 17:56:12.285021 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990682    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 17:56:12.285021 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990685    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 17:56:12.285021 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990688    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 17:56:12.285021 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990690    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 17:56:12.285021 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990693    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 17:56:12.285021 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990696    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 17:56:12.285021 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990699    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 17:56:12.285021 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990702    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 17:56:12.285021 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990705    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 17:56:12.285021 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990708    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 17:56:12.285021 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990710    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 17:56:12.285021 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990713    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 17:56:12.285021 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990715    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 17:56:12.285021 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990718    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 17:56:12.285021 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990721    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 17:56:12.285021 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990723    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 17:56:12.285021 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990727    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 17:56:12.285021 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990730    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 17:56:12.285021 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990732    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 17:56:12.285600 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990735    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 17:56:12.285600 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990737    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 17:56:12.285600 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990740    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 17:56:12.285600 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990743    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 17:56:12.285600 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990746    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 17:56:12.285600 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990748    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 17:56:12.285600 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990752    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 17:56:12.285600 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990756    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 17:56:12.285600 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990759    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 17:56:12.285600 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990762    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 17:56:12.285600 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990764    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 17:56:12.285600 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990767    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 17:56:12.285600 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990770    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 17:56:12.285600 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990772    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 17:56:12.285600 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990775    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 17:56:12.285600 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990777    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 17:56:12.285600 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990780    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 17:56:12.285600 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990783    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 17:56:12.285600 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990785    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 17:56:12.285600 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990788    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 17:56:12.286158 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990791    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 17:56:12.286158 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990794    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 17:56:12.286158 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990797    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 17:56:12.286158 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990799    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 17:56:12.286158 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990802    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 17:56:12.286158 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990804    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 17:56:12.286158 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990807    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 17:56:12.286158 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990810    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 17:56:12.286158 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990813    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 17:56:12.286158 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990815    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 17:56:12.286158 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990818    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 17:56:12.286158 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990820    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 17:56:12.286158 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990823    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 17:56:12.286158 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990826    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 17:56:12.286158 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990832    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 17:56:12.286158 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990835    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 17:56:12.286158 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990838    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 17:56:12.286158 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990842    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 17:56:12.286158 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990845    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 17:56:12.286158 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990848    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 17:56:12.286778 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990851    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 17:56:12.286778 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990853    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 17:56:12.286778 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990856    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 17:56:12.286778 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990859    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 17:56:12.286778 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990861    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 17:56:12.286778 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990864    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 17:56:12.286778 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990867    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 17:56:12.286778 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990869    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 17:56:12.286778 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990872    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 17:56:12.286778 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990874    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 17:56:12.286778 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990877    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 17:56:12.286778 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990880    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 17:56:12.286778 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990883    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 17:56:12.286778 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990887    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 17:56:12.286778 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990890    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 17:56:12.286778 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990892    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 17:56:12.286778 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990895    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 17:56:12.286778 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990898    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 17:56:12.286778 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990900    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 17:56:12.286778 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990903    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 17:56:12.287398 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990906    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 17:56:12.287398 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990908    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 17:56:12.287398 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990911    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 17:56:12.287398 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990913    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 17:56:12.287398 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990916    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 17:56:12.287398 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990918    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 17:56:12.287398 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990922    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 17:56:12.287398 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990925    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 17:56:12.287398 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990928    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 17:56:12.287398 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990930    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 17:56:12.287398 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990933    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 17:56:12.287398 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990936    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 17:56:12.287398 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.990938    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 17:56:12.287398 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.990943    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 17:56:12.287398 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991060    2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 17 17:56:12.287837 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991066    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 17 17:56:12.287837 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991069    2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 17 17:56:12.287837 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991072    2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 17 17:56:12.287837 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991075    2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 17 17:56:12.287837 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991078    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 17 17:56:12.287837 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991081    2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 17 17:56:12.287837 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991084    2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 17 17:56:12.287837 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991087    2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 17 17:56:12.287837 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991089    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 17 17:56:12.287837 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991094    2572 feature_gate.go:328] unrecognized feature gate: Example
Jul 17 17:56:12.287837 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991096    2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 17 17:56:12.287837 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991099    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 17 17:56:12.287837 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991103    2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 17 17:56:12.287837 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991106    2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 17 17:56:12.287837 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991108    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 17 17:56:12.287837 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991111    2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 17 17:56:12.287837 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991113    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 17 17:56:12.287837 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991116    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 17 17:56:12.287837 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991118    2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 17 17:56:12.287837 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991121    2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 17 17:56:12.288393 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991123    2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 17 17:56:12.288393 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991126    2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 17 17:56:12.288393 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991130    2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 17 17:56:12.288393 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991134    2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 17 17:56:12.288393 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991139    2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 17 17:56:12.288393 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991142    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 17 17:56:12.288393 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991144    2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 17 17:56:12.288393 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991147    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 17 17:56:12.288393 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991149    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 17 17:56:12.288393 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991152    2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 17 17:56:12.288393 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991155    2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 17 17:56:12.288393 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991157    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 17 17:56:12.288393 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991160    2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 17 17:56:12.288393 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991162    2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 17 17:56:12.288393 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991165    2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 17 17:56:12.288393 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991167    2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 17 17:56:12.288393 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991170    2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 17 17:56:12.288393 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991173    2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 17 17:56:12.288393 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991176    2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 17 17:56:12.288393 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991178    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 17 17:56:12.288944 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991181    2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 17 17:56:12.288944 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991185    2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 17 17:56:12.288944 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991187    2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 17 17:56:12.288944 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991190    2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 17 17:56:12.288944 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991193    2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 17 17:56:12.288944 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991196    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 17 17:56:12.288944 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991199    2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 17 17:56:12.288944 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991202    2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 17 17:56:12.288944 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991204    2572 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 17 17:56:12.288944 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991207    2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 17 17:56:12.288944 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991210    2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 17 17:56:12.288944 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991212    2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 17 17:56:12.288944 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991215    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 17 17:56:12.288944 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991217    2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 17 17:56:12.288944 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991220    2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 17 17:56:12.288944 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991222    2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 17 17:56:12.288944 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991226    2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 17 17:56:12.288944 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991229    2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 17 17:56:12.288944 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991231    2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 17 17:56:12.289479 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991235    2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 17 17:56:12.289479 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991238    2572 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 17 17:56:12.289479 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991242    2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 17 17:56:12.289479 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991245    2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 17 17:56:12.289479 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991248    2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 17 17:56:12.289479 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991251    2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 17 17:56:12.289479 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991253    2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 17 17:56:12.289479 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991256    2572 feature_gate.go:328] unrecognized feature gate: Example2
Jul 17 17:56:12.289479 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991259    2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 17 17:56:12.289479 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991261    2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 17 17:56:12.289479 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991264    2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 17 17:56:12.289479 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991266    2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 17 17:56:12.289479 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991269    2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 17 17:56:12.289479 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991272    2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 17 17:56:12.289479 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991276    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 17 17:56:12.289479 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991279    2572 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 17 17:56:12.289479 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991282    2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 17 17:56:12.289479 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991300    2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 17 17:56:12.289479 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991305    2572 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 17 17:56:12.290026 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991308    2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 17 17:56:12.290026 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991311    2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 17 17:56:12.290026 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991314    2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 17 17:56:12.290026 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991316    2572 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 17 17:56:12.290026 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991319    2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 17 17:56:12.290026 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991322    2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 17 17:56:12.290026 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991324    2572 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 17 17:56:12.290026 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991327    2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 17 17:56:12.290026 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991330    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 17 17:56:12.290026 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991332    2572 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 17 17:56:12.290026 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991336    2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 17 17:56:12.290026 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991339    2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 17 17:56:12.290026 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991341    2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 17 17:56:12.290026 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991344    2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 17 17:56:12.290026 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991346    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 17 17:56:12.290026 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991349    2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 17 17:56:12.290026 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991352    2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 17 17:56:12.290026 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991354    2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 17 17:56:12.290026 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991357    2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 17 17:56:12.290026 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:11.991359    2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 17 17:56:12.290616 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.991365    2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 17 17:56:12.290616 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.991479    2572 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 17 17:56:12.290616 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.993936    2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 17 17:56:12.290616 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.995651    2572 server.go:1019] "Starting client certificate rotation"
Jul 17 17:56:12.290616 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.995756    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 17:56:12.290616 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.995788    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 17 17:56:12.290616 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.998602    2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 17:56:12.290616 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:11.999756    2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 17 17:56:12.290616 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.012995    2572 log.go:25] "Validated CRI v1 runtime API"
Jul 17 17:56:12.290616 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.015819    2572 log.go:25] "Validated CRI v1 image API"
Jul 17 17:56:12.290616 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.016878    2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 17 17:56:12.290616 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.022582    2572 fs.go:135] Filesystem UUIDs: map[2acad23b-224b-4c9b-8f00-39c6dc323ab9:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f80e8cf8-6bf5-4fdc-bef8-fadbd5e12e4a:/dev/nvme0n1p4]
Jul 17 17:56:12.290978 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.022602    2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 17 17:56:12.291113 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.027554    2572 manager.go:216] Machine: {Timestamp:2026-07-17 17:56:12.026692865 +0000 UTC m=+0.382632057 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098885 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec208ad587e5cedc5012e3807516758b SystemUUID:ec208ad5-87e5-cedc-5012-e3807516758b BootID:30f3362a-d921-49f2-8925-bea2159bd31f Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:34:d0:2a:cb:4d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:34:d0:2a:cb:4d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:42:f7:00:eb:6f:71 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 17 17:56:12.291113 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.027681    2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 17 17:56:12.291113 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.027762    2572 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 17 17:56:12.291113 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.028903    2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 17 17:56:12.291113 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.028935    2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-226.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 17 17:56:12.291113 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.029751    2572 topology_manager.go:138] "Creating topology manager with none policy"
Jul 17 17:56:12.291113 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.029761    2572 container_manager_linux.go:309] "Creating device plugin manager"
Jul 17 17:56:12.291113 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.029768    2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.029789    2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.030389    2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.077740    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-55xdp"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.084366    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-55xdp"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.177758    2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.184221    2572 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.184379    2572 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.184409    2572 kubelet.go:486] "Attempting to sync node with API server"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.184421    2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.184446    2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.184458    2572 kubelet.go:398] "Adding apiserver pod source"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.184469    2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.184927    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.184947    2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.188014    2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.190597    2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.190625    2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.192010    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.192024    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.192030    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.192037    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.192045    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.192051    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.192059    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.192065    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.192072    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.192079    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.192088    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.192094    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.193775    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.193788    2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.194833    2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.196283    2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.197322    2572 server.go:1268] "Started kubelet"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.197360    2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.197469    2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.197538    2572 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.199093    2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.199892    2572 server.go:310] "Adding debug handlers to kubelet server"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.200265    2572 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-226.ec2.internal" not found
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:12.203246    2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.208489    2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 17 17:56:12.291437 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.209203    2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:12.209300    2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-226.ec2.internal\" not found"
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.210036    2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.210027    2572 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.210235    2572 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.210340    2572 reconstruct.go:97] "Volume reconstruction finished"
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.210351    2572 reconciler.go:29] "Reconciler: start to sync state"
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.210679    2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.210694    2572 factory.go:55] Registering systemd factory
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.210703    2572 factory.go:223] Registration of the systemd container factory successfully
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.210958    2572 factory.go:153] Registering CRI-O factory
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.210973    2572 factory.go:223] Registration of the crio container factory successfully
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.210995    2572 factory.go:103] Registering Raw factory
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.211009    2572 manager.go:1196] Started watching for new ooms in manager
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.211025    2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.211493    2572 manager.go:349] Starting recovery of all containers
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:12.213597    2572 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-226.ec2.internal\" not found" node="ip-10-0-132-226.ec2.internal"
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.215255    2572 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-226.ec2.internal" not found
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:12.222819    2572 helpers.go:245] readString: Failed to read "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service/memory.max": read /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service/memory.max: no such device
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.222891    2572 manager.go:354] Recovery completed
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.226873    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.228800    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-226.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.228826    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-226.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.228836    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-226.ec2.internal" event="NodeHasSufficientPID"
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.229453    2572 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.229462    2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.229479    2572 state_mem.go:36] "Initialized new in-memory state store"
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.229464    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.230226    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-226.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.230252    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-226.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.230266    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-226.ec2.internal" event="NodeHasSufficientPID"
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.231704    2572 policy_none.go:49] "None policy: Start"
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.231717    2572 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.231728    2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.233679    2572 policy_none.go:47] "Start"
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.271994    2572 manager.go:337] "Starting Device Plugin manager"
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:12.272226    2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.272243    2572 server.go:87] "Starting device plugin registration server"
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.272550    2572 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.272564    2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.272697    2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.272775    2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.272783    2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 17 17:56:12.292558 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:12.273334    2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 17 17:56:12.293715 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:12.273374    2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-226.ec2.internal\" not found"
Jul 17 17:56:12.293715 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.274710    2572 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-226.ec2.internal" not found
Jul 17 17:56:12.398237 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.301424    2572 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2608 into the system container \"/system.slice\": <nil>"
Jul 17 17:56:12.398237 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.332946    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 17 17:56:12.398237 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.334150    2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 17 17:56:12.398237 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.334201    2572 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 17 17:56:12.398237 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.334222    2572 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 17 17:56:12.398237 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:12.334255    2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 17 17:56:12.398237 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.336570    2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 17:56:12.639195 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.548077    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 17:56:12.639195 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.548136    2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-226.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-226.ec2.internal"]
Jul 17 17:56:12.639195 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.548216    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 17:56:12.639195 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.549042    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-226.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 17:56:12.639195 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.549067    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-226.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 17:56:12.639195 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.549077    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-226.ec2.internal" event="NodeHasSufficientPID"
Jul 17 17:56:12.639195 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.549100    2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-226.ec2.internal"
Jul 17 17:56:12.639195 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.549463    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-226.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 17:56:12.639195 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.549491    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-226.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 17:56:12.639195 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.549500    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-226.ec2.internal" event="NodeHasSufficientPID"
Jul 17 17:56:12.639195 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.551746    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 17:56:12.639195 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.551838    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-226.ec2.internal"
Jul 17 17:56:12.639195 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.551862    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 17:56:12.639195 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.552518    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-226.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 17:56:12.639195 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.552536    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-226.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 17:56:12.639195 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.552545    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-226.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 17:56:12.639195 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.552556    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-226.ec2.internal" event="NodeHasSufficientPID"
Jul 17 17:56:12.639195 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.552556    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-226.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 17:56:12.639195 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.552690    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-226.ec2.internal" event="NodeHasSufficientPID"
Jul 17 17:56:12.639195 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.552666    2572 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-132-226.ec2.internal" not found
Jul 17 17:56:12.639195 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:12.552770    2572 csi_plugin.go:399] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "ip-10-0-132-226.ec2.internal" not found
Jul 17 17:56:12.639195 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.554686    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-226.ec2.internal"
Jul 17 17:56:12.639195 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.554711    2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 17 17:56:12.639195 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.555439    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-226.ec2.internal" event="NodeHasSufficientMemory"
Jul 17 17:56:12.639195 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.555470    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-226.ec2.internal" event="NodeHasNoDiskPressure"
Jul 17 17:56:12.639195 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.555486    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-226.ec2.internal" event="NodeHasSufficientPID"
Jul 17 17:56:12.639195 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.557843    2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-226.ec2.internal"
Jul 17 17:56:12.639195 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:12.557861    2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-226.ec2.internal\": node \"ip-10-0-132-226.ec2.internal\" not found"
Jul 17 17:56:12.639195 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.609605    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-226.ec2.internal"
Jul 17 17:56:12.651009 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.648877    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/20554dd5d0f2d6efd09ccfb94678d149-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-226.ec2.internal\" (UID: \"20554dd5d0f2d6efd09ccfb94678d149\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-226.ec2.internal"
Jul 17 17:56:12.651009 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.648914    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20554dd5d0f2d6efd09ccfb94678d149-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-226.ec2.internal\" (UID: \"20554dd5d0f2d6efd09ccfb94678d149\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-226.ec2.internal"
Jul 17 17:56:12.651009 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:12.648939    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8bfbaed7d32901437b702fd04e14392e-config\") pod \"kube-apiserver-proxy-ip-10-0-132-226.ec2.internal\" (UID: \"8bfbaed7d32901437b702fd04e14392e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-226.ec2.internal"
Jul 17 17:56:13.895974 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:13.880080    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/20554dd5d0f2d6efd09ccfb94678d149-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-226.ec2.internal\" (UID: \"20554dd5d0f2d6efd09ccfb94678d149\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-226.ec2.internal"
Jul 17 17:56:13.895974 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:13.880114    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20554dd5d0f2d6efd09ccfb94678d149-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-226.ec2.internal\" (UID: \"20554dd5d0f2d6efd09ccfb94678d149\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-226.ec2.internal"
Jul 17 17:56:13.895974 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:13.880133    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8bfbaed7d32901437b702fd04e14392e-config\") pod \"kube-apiserver-proxy-ip-10-0-132-226.ec2.internal\" (UID: \"8bfbaed7d32901437b702fd04e14392e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-226.ec2.internal"
Jul 17 17:56:13.895974 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:13.880177    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8bfbaed7d32901437b702fd04e14392e-config\") pod \"kube-apiserver-proxy-ip-10-0-132-226.ec2.internal\" (UID: \"8bfbaed7d32901437b702fd04e14392e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-226.ec2.internal"
Jul 17 17:56:13.895974 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:13.880196    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/20554dd5d0f2d6efd09ccfb94678d149-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-226.ec2.internal\" (UID: \"20554dd5d0f2d6efd09ccfb94678d149\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-226.ec2.internal"
Jul 17 17:56:13.895974 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:13.880202    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20554dd5d0f2d6efd09ccfb94678d149-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-226.ec2.internal\" (UID: \"20554dd5d0f2d6efd09ccfb94678d149\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-226.ec2.internal"
Jul 17 17:56:14.132573 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.039448    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 17:56:14.132573 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.039877    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-226.ec2.internal"
Jul 17 17:56:14.132573 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.048346    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 17:56:14.132573 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.058393    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-226.ec2.internal"
Jul 17 17:56:14.132573 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.062662    2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-226.ec2.internal"
Jul 17 17:56:14.132573 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.072046    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 17:56:14.132573 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:14.072083    2572 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-132-226.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-226.ec2.internal"
Jul 17 17:56:14.132573 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.072687    2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 17 17:56:14.132573 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:14.072721    2572 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-132-226.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-226.ec2.internal"
Jul 17 17:56:14.132573 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.073770    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-226.ec2.internal"
Jul 17 17:56:14.132573 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.076240    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-226.ec2.internal"
Jul 17 17:56:14.132573 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.125598    2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 17 17:56:14.132573 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.125742    2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 17 17:56:14.132573 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.125765    2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 17 17:56:14.132573 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.125759    2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 17 17:56:14.315781 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.315735    2572 apiserver.go:52] "Watching apiserver"
Jul 17 17:56:14.315925 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.315755    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-16 17:51:13 +0000 UTC" deadline="2028-03-08 03:14:29.223330698 +0000 UTC"
Jul 17 17:56:14.315925 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.315805    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14385h18m14.907529552s"
Jul 17 17:56:14.322880 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.322855    2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 17 17:56:14.323257 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.323235    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-h9rs6","kube-system/kube-apiserver-proxy-ip-10-0-132-226.ec2.internal","openshift-dns/node-resolver-rnhqt","openshift-multus/multus-additional-cni-plugins-qsb98","openshift-multus/multus-g8zxq","openshift-multus/network-metrics-daemon-mxdhr","openshift-network-diagnostics/network-check-target-sz5w2","kube-system/global-pull-secret-syncer-ldrq9","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-269bj","openshift-cluster-node-tuning-operator/tuned-qm4d4","openshift-image-registry/node-ca-b4t9q","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-226.ec2.internal","openshift-network-operator/iptables-alerter-z7vks","openshift-ovn-kubernetes/ovnkube-node-v5mdx"]
Jul 17 17:56:14.325724 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.325704    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz5w2"
Jul 17 17:56:14.325805 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:14.325780    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz5w2" podUID="d66f36e8-45f4-457e-b26e-44455cc4a850"
Jul 17 17:56:14.327712 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.327692    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z7vks"
Jul 17 17:56:14.329923 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.329904    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.330057 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.330039    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 17 17:56:14.330125 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.330056    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-d48g6\""
Jul 17 17:56:14.330125 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.330083    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 17 17:56:14.330251 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.330194    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 17 17:56:14.332430 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.332411    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qsb98"
Jul 17 17:56:14.332681 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.332573    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 17 17:56:14.332849 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.332721    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-756sv\""
Jul 17 17:56:14.332908 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.332856    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 17 17:56:14.333040 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.333023    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 17 17:56:14.333127 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.333112    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 17 17:56:14.333191 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.333178    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 17 17:56:14.333220 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.333179    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 17 17:56:14.334471 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.334457    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 17 17:56:14.334719 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.334701    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 17 17:56:14.334889 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.334874    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7frs5\""
Jul 17 17:56:14.334951 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.334943    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.335095 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.335081    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 17 17:56:14.335325 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.335312    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 17 17:56:14.335661 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.335649    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 17 17:56:14.336920 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.336905    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 17 17:56:14.336962 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.336949    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9lzs9\""
Jul 17 17:56:14.337184 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.337172    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxdhr"
Jul 17 17:56:14.337235 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:14.337219    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxdhr" podUID="6deaf47f-3310-4d3e-825c-4b85347ad01e"
Jul 17 17:56:14.340123 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.339477    2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 17 17:56:14.340123 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.339710    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-269bj"
Jul 17 17:56:14.342186 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.342163    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 17 17:56:14.342344 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.342325    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 17 17:56:14.342417 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.342342    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 17 17:56:14.342466 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.342438    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gfvzt\""
Jul 17 17:56:14.342522 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.342439    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h9rs6"
Jul 17 17:56:14.344547 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.344529    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 17 17:56:14.344638 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.344595    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 17 17:56:14.344685 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.344648    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-csght\""
Jul 17 17:56:14.344753 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.344734    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.347031 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.347010    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b4t9q"
Jul 17 17:56:14.347426 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.347406    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 17 17:56:14.347558 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.347545    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4q6d7\""
Jul 17 17:56:14.347610 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.347595    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 17 17:56:14.349380 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.349362    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 17 17:56:14.349460 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.349385    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 17 17:56:14.349528 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.349474    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:56:14.349576 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:14.349546    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldrq9" podUID="7403c99b-bdb6-4595-916c-b4b8d138f4d0"
Jul 17 17:56:14.349708 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.349685    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nk4pk\""
Jul 17 17:56:14.349920 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.349904    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 17 17:56:14.351671 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.351654    2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 17 17:56:14.351922 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.351908    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rnhqt"
Jul 17 17:56:14.354009 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.353988    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 17 17:56:14.354075 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.354061    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vkgj2\""
Jul 17 17:56:14.354127 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.354113    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 17 17:56:14.378007 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.377978    2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-dzh6q"
Jul 17 17:56:14.381780 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.381755    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-run-systemd\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.381884 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.381787    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-log-socket\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.381884 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.381810    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2e3bd369-576e-4df1-8a76-aebd537cde58-ovnkube-script-lib\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.381884 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.381832    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k6gq\" (UniqueName: \"kubernetes.io/projected/2e3bd369-576e-4df1-8a76-aebd537cde58-kube-api-access-8k6gq\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.382012 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.381885    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-host-var-lib-cni-multus\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.382012 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.381911    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-host-run-multus-certs\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.382012 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.381964    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d3a85848-4964-41eb-ae52-6fbca6f695fb-cnibin\") pod \"multus-additional-cni-plugins-qsb98\" (UID: \"d3a85848-4964-41eb-ae52-6fbca6f695fb\") " pod="openshift-multus/multus-additional-cni-plugins-qsb98"
Jul 17 17:56:14.382111 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382040    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-host-kubelet\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.382111 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382060    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-host-run-netns\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.382111 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382076    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-var-lib-openvswitch\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.382111 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382102    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmpvn\" (UniqueName: \"kubernetes.io/projected/ab2ebce0-5586-41be-8698-849ad8481836-kube-api-access-tmpvn\") pod \"aws-ebs-csi-driver-node-269bj\" (UID: \"ab2ebce0-5586-41be-8698-849ad8481836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-269bj"
Jul 17 17:56:14.382237 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382119    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-run-ovn\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.382237 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382134    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ab2ebce0-5586-41be-8698-849ad8481836-device-dir\") pod \"aws-ebs-csi-driver-node-269bj\" (UID: \"ab2ebce0-5586-41be-8698-849ad8481836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-269bj"
Jul 17 17:56:14.382237 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382169    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qqd7\" (UniqueName: \"kubernetes.io/projected/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-kube-api-access-9qqd7\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.382237 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382200    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-host-cni-netd\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.382237 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382224    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-cni-binary-copy\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.382393 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382247    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-system-cni-dir\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.382393 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382268    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-hostroot\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.382393 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382314    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d3a85848-4964-41eb-ae52-6fbca6f695fb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qsb98\" (UID: \"d3a85848-4964-41eb-ae52-6fbca6f695fb\") " pod="openshift-multus/multus-additional-cni-plugins-qsb98"
Jul 17 17:56:14.382393 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382344    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d3a85848-4964-41eb-ae52-6fbca6f695fb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qsb98\" (UID: \"d3a85848-4964-41eb-ae52-6fbca6f695fb\") " pod="openshift-multus/multus-additional-cni-plugins-qsb98"
Jul 17 17:56:14.382393 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382368    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d3a85848-4964-41eb-ae52-6fbca6f695fb-cni-binary-copy\") pod \"multus-additional-cni-plugins-qsb98\" (UID: \"d3a85848-4964-41eb-ae52-6fbca6f695fb\") " pod="openshift-multus/multus-additional-cni-plugins-qsb98"
Jul 17 17:56:14.382562 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382394    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-os-release\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.382562 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382419    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-node-log\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.382562 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382434    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e3bd369-576e-4df1-8a76-aebd537cde58-ovn-node-metrics-cert\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.382562 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382453    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-cnibin\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.382562 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382474    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-multus-cni-dir\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.382562 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382492    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6bb964cd-6c2c-4997-b5c5-558b890f6277-agent-certs\") pod \"konnectivity-agent-h9rs6\" (UID: \"6bb964cd-6c2c-4997-b5c5-558b890f6277\") " pod="kube-system/konnectivity-agent-h9rs6"
Jul 17 17:56:14.382562 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382513    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-host-run-ovn-kubernetes\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.382562 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382547    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-multus-socket-dir-parent\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.382829 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382574    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-host-var-lib-cni-bin\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.382829 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382608    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-multus-conf-dir\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.382829 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382630    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-systemd-units\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.382829 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382655    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-host-var-lib-kubelet\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.382829 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382686    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ab2ebce0-5586-41be-8698-849ad8481836-kubelet-dir\") pod \"aws-ebs-csi-driver-node-269bj\" (UID: \"ab2ebce0-5586-41be-8698-849ad8481836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-269bj"
Jul 17 17:56:14.382829 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382716    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3a85848-4964-41eb-ae52-6fbca6f695fb-system-cni-dir\") pod \"multus-additional-cni-plugins-qsb98\" (UID: \"d3a85848-4964-41eb-ae52-6fbca6f695fb\") " pod="openshift-multus/multus-additional-cni-plugins-qsb98"
Jul 17 17:56:14.382829 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382743    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hnn8\" (UniqueName: \"kubernetes.io/projected/d3a85848-4964-41eb-ae52-6fbca6f695fb-kube-api-access-8hnn8\") pod \"multus-additional-cni-plugins-qsb98\" (UID: \"d3a85848-4964-41eb-ae52-6fbca6f695fb\") " pod="openshift-multus/multus-additional-cni-plugins-qsb98"
Jul 17 17:56:14.382829 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382767    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ab2ebce0-5586-41be-8698-849ad8481836-etc-selinux\") pod \"aws-ebs-csi-driver-node-269bj\" (UID: \"ab2ebce0-5586-41be-8698-849ad8481836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-269bj"
Jul 17 17:56:14.382829 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382793    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhhsg\" (UniqueName: \"kubernetes.io/projected/d66f36e8-45f4-457e-b26e-44455cc4a850-kube-api-access-fhhsg\") pod \"network-check-target-sz5w2\" (UID: \"d66f36e8-45f4-457e-b26e-44455cc4a850\") " pod="openshift-network-diagnostics/network-check-target-sz5w2"
Jul 17 17:56:14.382829 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382814    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-host-run-k8s-cni-cncf-io\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.383260 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382838    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ab2ebce0-5586-41be-8698-849ad8481836-registration-dir\") pod \"aws-ebs-csi-driver-node-269bj\" (UID: \"ab2ebce0-5586-41be-8698-849ad8481836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-269bj"
Jul 17 17:56:14.383260 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382872    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-run-openvswitch\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.383260 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382895    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.383260 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382937    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-host-run-netns\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.383260 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.382975    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2413fc9d-9cab-44ea-81d6-e40c84c215a9-host-slash\") pod \"iptables-alerter-z7vks\" (UID: \"2413fc9d-9cab-44ea-81d6-e40c84c215a9\") " pod="openshift-network-operator/iptables-alerter-z7vks"
Jul 17 17:56:14.383260 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.383012    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ab2ebce0-5586-41be-8698-849ad8481836-sys-fs\") pod \"aws-ebs-csi-driver-node-269bj\" (UID: \"ab2ebce0-5586-41be-8698-849ad8481836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-269bj"
Jul 17 17:56:14.383260 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.383036    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-etc-openvswitch\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.383260 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.383059    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-etc-kubernetes\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.383260 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.383082    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6bb964cd-6c2c-4997-b5c5-558b890f6277-konnectivity-ca\") pod \"konnectivity-agent-h9rs6\" (UID: \"6bb964cd-6c2c-4997-b5c5-558b890f6277\") " pod="kube-system/konnectivity-agent-h9rs6"
Jul 17 17:56:14.383260 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.383108    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdc2f\" (UniqueName: \"kubernetes.io/projected/2413fc9d-9cab-44ea-81d6-e40c84c215a9-kube-api-access-xdc2f\") pod \"iptables-alerter-z7vks\" (UID: \"2413fc9d-9cab-44ea-81d6-e40c84c215a9\") " pod="openshift-network-operator/iptables-alerter-z7vks"
Jul 17 17:56:14.383260 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.383134    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6deaf47f-3310-4d3e-825c-4b85347ad01e-metrics-certs\") pod \"network-metrics-daemon-mxdhr\" (UID: \"6deaf47f-3310-4d3e-825c-4b85347ad01e\") " pod="openshift-multus/network-metrics-daemon-mxdhr"
Jul 17 17:56:14.383260 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.383157    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ab2ebce0-5586-41be-8698-849ad8481836-socket-dir\") pod \"aws-ebs-csi-driver-node-269bj\" (UID: \"ab2ebce0-5586-41be-8698-849ad8481836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-269bj"
Jul 17 17:56:14.383260 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.383179    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2413fc9d-9cab-44ea-81d6-e40c84c215a9-iptables-alerter-script\") pod \"iptables-alerter-z7vks\" (UID: \"2413fc9d-9cab-44ea-81d6-e40c84c215a9\") " pod="openshift-network-operator/iptables-alerter-z7vks"
Jul 17 17:56:14.383763 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.383204    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d3a85848-4964-41eb-ae52-6fbca6f695fb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qsb98\" (UID: \"d3a85848-4964-41eb-ae52-6fbca6f695fb\") " pod="openshift-multus/multus-additional-cni-plugins-qsb98"
Jul 17 17:56:14.383763 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.383226    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-host-slash\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.383763 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.383249    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-host-cni-bin\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.383763 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.383320    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2e3bd369-576e-4df1-8a76-aebd537cde58-ovnkube-config\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.383763 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.383343    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2e3bd369-576e-4df1-8a76-aebd537cde58-env-overrides\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.383763 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.383366    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-multus-daemon-config\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.383763 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.383389    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d3a85848-4964-41eb-ae52-6fbca6f695fb-os-release\") pod \"multus-additional-cni-plugins-qsb98\" (UID: \"d3a85848-4964-41eb-ae52-6fbca6f695fb\") " pod="openshift-multus/multus-additional-cni-plugins-qsb98"
Jul 17 17:56:14.383763 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.383414    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98mjx\" (UniqueName: \"kubernetes.io/projected/6deaf47f-3310-4d3e-825c-4b85347ad01e-kube-api-access-98mjx\") pod \"network-metrics-daemon-mxdhr\" (UID: \"6deaf47f-3310-4d3e-825c-4b85347ad01e\") " pod="openshift-multus/network-metrics-daemon-mxdhr"
Jul 17 17:56:14.384225 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.384111    2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-dzh6q"
Jul 17 17:56:14.443267 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.443108    2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 17 17:56:14.484508 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.484484    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k6gq\" (UniqueName: \"kubernetes.io/projected/2e3bd369-576e-4df1-8a76-aebd537cde58-kube-api-access-8k6gq\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.484619 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.484519    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-host-var-lib-cni-multus\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.484619 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.484545    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-host-run-multus-certs\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.484619 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.484566    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d3a85848-4964-41eb-ae52-6fbca6f695fb-cnibin\") pod \"multus-additional-cni-plugins-qsb98\" (UID: \"d3a85848-4964-41eb-ae52-6fbca6f695fb\") " pod="openshift-multus/multus-additional-cni-plugins-qsb98"
Jul 17 17:56:14.484619 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.484588    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-host-kubelet\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.484619 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.484600    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-host-var-lib-cni-multus\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.484619 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.484609    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-host-run-netns\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.484619 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.484604    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-host-run-multus-certs\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.484980 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.484632    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-var-lib-openvswitch\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.484980 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.484634    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d3a85848-4964-41eb-ae52-6fbca6f695fb-cnibin\") pod \"multus-additional-cni-plugins-qsb98\" (UID: \"d3a85848-4964-41eb-ae52-6fbca6f695fb\") " pod="openshift-multus/multus-additional-cni-plugins-qsb98"
Jul 17 17:56:14.484980 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.484659    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmpvn\" (UniqueName: \"kubernetes.io/projected/ab2ebce0-5586-41be-8698-849ad8481836-kube-api-access-tmpvn\") pod \"aws-ebs-csi-driver-node-269bj\" (UID: \"ab2ebce0-5586-41be-8698-849ad8481836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-269bj"
Jul 17 17:56:14.484980 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.484662    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-host-kubelet\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.484980 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.484674    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-host-run-netns\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.484980 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.484704    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-run\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.484980 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.484706    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-var-lib-openvswitch\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.484980 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.484726    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-run-ovn\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.484980 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.484747    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ab2ebce0-5586-41be-8698-849ad8481836-device-dir\") pod \"aws-ebs-csi-driver-node-269bj\" (UID: \"ab2ebce0-5586-41be-8698-849ad8481836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-269bj"
Jul 17 17:56:14.484980 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.484764    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cd3b555f-c848-4492-a111-1a007f3d469d-hosts-file\") pod \"node-resolver-rnhqt\" (UID: \"cd3b555f-c848-4492-a111-1a007f3d469d\") " pod="openshift-dns/node-resolver-rnhqt"
Jul 17 17:56:14.484980 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.484781    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qqd7\" (UniqueName: \"kubernetes.io/projected/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-kube-api-access-9qqd7\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.484980 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.484796    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cxbq\" (UniqueName: \"kubernetes.io/projected/cd3b555f-c848-4492-a111-1a007f3d469d-kube-api-access-6cxbq\") pod \"node-resolver-rnhqt\" (UID: \"cd3b555f-c848-4492-a111-1a007f3d469d\") " pod="openshift-dns/node-resolver-rnhqt"
Jul 17 17:56:14.484980 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.484801    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-run-ovn\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.484980 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.484817    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-host-cni-netd\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.485592 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.484852    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-host-cni-netd\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.485592 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.484818    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ab2ebce0-5586-41be-8698-849ad8481836-device-dir\") pod \"aws-ebs-csi-driver-node-269bj\" (UID: \"ab2ebce0-5586-41be-8698-849ad8481836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-269bj"
Jul 17 17:56:14.485592 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.484869    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-cni-binary-copy\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.485592 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.484898    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-etc-tuned\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.485592 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.484923    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-system-cni-dir\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.485592 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.484948    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-hostroot\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.485592 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.484962    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-system-cni-dir\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.485592 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.484972    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd3b555f-c848-4492-a111-1a007f3d469d-tmp-dir\") pod \"node-resolver-rnhqt\" (UID: \"cd3b555f-c848-4492-a111-1a007f3d469d\") " pod="openshift-dns/node-resolver-rnhqt"
Jul 17 17:56:14.485592 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.484989    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-hostroot\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.485592 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.484992    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d3a85848-4964-41eb-ae52-6fbca6f695fb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qsb98\" (UID: \"d3a85848-4964-41eb-ae52-6fbca6f695fb\") " pod="openshift-multus/multus-additional-cni-plugins-qsb98"
Jul 17 17:56:14.485592 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485036    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d3a85848-4964-41eb-ae52-6fbca6f695fb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qsb98\" (UID: \"d3a85848-4964-41eb-ae52-6fbca6f695fb\") " pod="openshift-multus/multus-additional-cni-plugins-qsb98"
Jul 17 17:56:14.485592 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485060    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1e914c47-eaed-4241-b5f8-9c3d2f0a3be8-serviceca\") pod \"node-ca-b4t9q\" (UID: \"1e914c47-eaed-4241-b5f8-9c3d2f0a3be8\") " pod="openshift-image-registry/node-ca-b4t9q"
Jul 17 17:56:14.485592 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485080    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw27m\" (UniqueName: \"kubernetes.io/projected/1e914c47-eaed-4241-b5f8-9c3d2f0a3be8-kube-api-access-bw27m\") pod \"node-ca-b4t9q\" (UID: \"1e914c47-eaed-4241-b5f8-9c3d2f0a3be8\") " pod="openshift-image-registry/node-ca-b4t9q"
Jul 17 17:56:14.485592 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485100    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d3a85848-4964-41eb-ae52-6fbca6f695fb-cni-binary-copy\") pod \"multus-additional-cni-plugins-qsb98\" (UID: \"d3a85848-4964-41eb-ae52-6fbca6f695fb\") " pod="openshift-multus/multus-additional-cni-plugins-qsb98"
Jul 17 17:56:14.486193 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485124    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-os-release\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.486193 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485157    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-node-log\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.486193 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485189    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e3bd369-576e-4df1-8a76-aebd537cde58-ovn-node-metrics-cert\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.486193 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485204    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-os-release\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.486193 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485214    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-cnibin\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.486193 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485241    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7403c99b-bdb6-4595-916c-b4b8d138f4d0-original-pull-secret\") pod \"global-pull-secret-syncer-ldrq9\" (UID: \"7403c99b-bdb6-4595-916c-b4b8d138f4d0\") " pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:56:14.486193 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485246    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-node-log\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.486193 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485266    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-tmp\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.486193 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485289    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-multus-cni-dir\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.486193 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485298    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-cnibin\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.486193 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485313    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6bb964cd-6c2c-4997-b5c5-558b890f6277-agent-certs\") pod \"konnectivity-agent-h9rs6\" (UID: \"6bb964cd-6c2c-4997-b5c5-558b890f6277\") " pod="kube-system/konnectivity-agent-h9rs6"
Jul 17 17:56:14.486193 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485336    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-etc-modprobe-d\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.486193 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485358    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-host-run-ovn-kubernetes\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.486193 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485384    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-multus-socket-dir-parent\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.486193 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485407    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-host-var-lib-cni-bin\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.486815 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485428    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-multus-conf-dir\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.486815 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485456    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7403c99b-bdb6-4595-916c-b4b8d138f4d0-dbus\") pod \"global-pull-secret-syncer-ldrq9\" (UID: \"7403c99b-bdb6-4595-916c-b4b8d138f4d0\") " pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:56:14.486815 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485485    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-etc-sysctl-conf\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.486815 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485506    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-etc-systemd\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.486815 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485525    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-host\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.486815 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485549    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-systemd-units\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.486815 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485553    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-cni-binary-copy\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.486815 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485572    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-host-var-lib-kubelet\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.486815 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485599    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ab2ebce0-5586-41be-8698-849ad8481836-kubelet-dir\") pod \"aws-ebs-csi-driver-node-269bj\" (UID: \"ab2ebce0-5586-41be-8698-849ad8481836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-269bj"
Jul 17 17:56:14.486815 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485654    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ab2ebce0-5586-41be-8698-849ad8481836-kubelet-dir\") pod \"aws-ebs-csi-driver-node-269bj\" (UID: \"ab2ebce0-5586-41be-8698-849ad8481836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-269bj"
Jul 17 17:56:14.486815 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485654    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-etc-kubernetes\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.486815 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485664    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d3a85848-4964-41eb-ae52-6fbca6f695fb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qsb98\" (UID: \"d3a85848-4964-41eb-ae52-6fbca6f695fb\") " pod="openshift-multus/multus-additional-cni-plugins-qsb98"
Jul 17 17:56:14.486815 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485668    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d3a85848-4964-41eb-ae52-6fbca6f695fb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qsb98\" (UID: \"d3a85848-4964-41eb-ae52-6fbca6f695fb\") " pod="openshift-multus/multus-additional-cni-plugins-qsb98"
Jul 17 17:56:14.486815 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485637    2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 17 17:56:14.487475 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485687    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-sys\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.487475 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485685    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d3a85848-4964-41eb-ae52-6fbca6f695fb-cni-binary-copy\") pod \"multus-additional-cni-plugins-qsb98\" (UID: \"d3a85848-4964-41eb-ae52-6fbca6f695fb\") " pod="openshift-multus/multus-additional-cni-plugins-qsb98"
Jul 17 17:56:14.487475 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485736    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-var-lib-kubelet\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.487475 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485784    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-host-run-ovn-kubernetes\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.487475 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485794    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-systemd-units\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.487475 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485817    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-host-var-lib-cni-bin\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.487475 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485842    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-host-var-lib-kubelet\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.487475 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485850    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-multus-conf-dir\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.487475 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485897    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3a85848-4964-41eb-ae52-6fbca6f695fb-system-cni-dir\") pod \"multus-additional-cni-plugins-qsb98\" (UID: \"d3a85848-4964-41eb-ae52-6fbca6f695fb\") " pod="openshift-multus/multus-additional-cni-plugins-qsb98"
Jul 17 17:56:14.487475 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485925    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hnn8\" (UniqueName: \"kubernetes.io/projected/d3a85848-4964-41eb-ae52-6fbca6f695fb-kube-api-access-8hnn8\") pod \"multus-additional-cni-plugins-qsb98\" (UID: \"d3a85848-4964-41eb-ae52-6fbca6f695fb\") " pod="openshift-multus/multus-additional-cni-plugins-qsb98"
Jul 17 17:56:14.487475 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485951    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ab2ebce0-5586-41be-8698-849ad8481836-etc-selinux\") pod \"aws-ebs-csi-driver-node-269bj\" (UID: \"ab2ebce0-5586-41be-8698-849ad8481836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-269bj"
Jul 17 17:56:14.487475 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485959    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-multus-socket-dir-parent\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.487475 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.485971    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-multus-cni-dir\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.487475 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486041    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-etc-sysconfig\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.488091 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486049    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ab2ebce0-5586-41be-8698-849ad8481836-etc-selinux\") pod \"aws-ebs-csi-driver-node-269bj\" (UID: \"ab2ebce0-5586-41be-8698-849ad8481836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-269bj"
Jul 17 17:56:14.488091 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486031    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d3a85848-4964-41eb-ae52-6fbca6f695fb-system-cni-dir\") pod \"multus-additional-cni-plugins-qsb98\" (UID: \"d3a85848-4964-41eb-ae52-6fbca6f695fb\") " pod="openshift-multus/multus-additional-cni-plugins-qsb98"
Jul 17 17:56:14.488091 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486066    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-etc-sysctl-d\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.488091 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486096    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e914c47-eaed-4241-b5f8-9c3d2f0a3be8-host\") pod \"node-ca-b4t9q\" (UID: \"1e914c47-eaed-4241-b5f8-9c3d2f0a3be8\") " pod="openshift-image-registry/node-ca-b4t9q"
Jul 17 17:56:14.488091 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486127    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhhsg\" (UniqueName: \"kubernetes.io/projected/d66f36e8-45f4-457e-b26e-44455cc4a850-kube-api-access-fhhsg\") pod \"network-check-target-sz5w2\" (UID: \"d66f36e8-45f4-457e-b26e-44455cc4a850\") " pod="openshift-network-diagnostics/network-check-target-sz5w2"
Jul 17 17:56:14.488091 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486160    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-host-run-k8s-cni-cncf-io\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.488091 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486262    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ab2ebce0-5586-41be-8698-849ad8481836-registration-dir\") pod \"aws-ebs-csi-driver-node-269bj\" (UID: \"ab2ebce0-5586-41be-8698-849ad8481836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-269bj"
Jul 17 17:56:14.488091 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486268    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-host-run-k8s-cni-cncf-io\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.488091 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486298    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-run-openvswitch\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.488091 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486343    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.488091 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486349    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-run-openvswitch\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.488091 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486374    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-host-run-netns\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.488091 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486378    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ab2ebce0-5586-41be-8698-849ad8481836-registration-dir\") pod \"aws-ebs-csi-driver-node-269bj\" (UID: \"ab2ebce0-5586-41be-8698-849ad8481836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-269bj"
Jul 17 17:56:14.488091 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486386    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.488538 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486395    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2413fc9d-9cab-44ea-81d6-e40c84c215a9-host-slash\") pod \"iptables-alerter-z7vks\" (UID: \"2413fc9d-9cab-44ea-81d6-e40c84c215a9\") " pod="openshift-network-operator/iptables-alerter-z7vks"
Jul 17 17:56:14.488538 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486422    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ab2ebce0-5586-41be-8698-849ad8481836-sys-fs\") pod \"aws-ebs-csi-driver-node-269bj\" (UID: \"ab2ebce0-5586-41be-8698-849ad8481836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-269bj"
Jul 17 17:56:14.488538 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486440    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2413fc9d-9cab-44ea-81d6-e40c84c215a9-host-slash\") pod \"iptables-alerter-z7vks\" (UID: \"2413fc9d-9cab-44ea-81d6-e40c84c215a9\") " pod="openshift-network-operator/iptables-alerter-z7vks"
Jul 17 17:56:14.488538 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486447    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-host-run-netns\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.488538 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486478    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7403c99b-bdb6-4595-916c-b4b8d138f4d0-kubelet-config\") pod \"global-pull-secret-syncer-ldrq9\" (UID: \"7403c99b-bdb6-4595-916c-b4b8d138f4d0\") " pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:56:14.488538 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486503    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ab2ebce0-5586-41be-8698-849ad8481836-sys-fs\") pod \"aws-ebs-csi-driver-node-269bj\" (UID: \"ab2ebce0-5586-41be-8698-849ad8481836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-269bj"
Jul 17 17:56:14.488538 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486528    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7znsh\" (UniqueName: \"kubernetes.io/projected/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-kube-api-access-7znsh\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.488538 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486548    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-etc-openvswitch\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.488538 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486572    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-etc-kubernetes\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.488538 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486590    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6bb964cd-6c2c-4997-b5c5-558b890f6277-konnectivity-ca\") pod \"konnectivity-agent-h9rs6\" (UID: \"6bb964cd-6c2c-4997-b5c5-558b890f6277\") " pod="kube-system/konnectivity-agent-h9rs6"
Jul 17 17:56:14.488538 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486600    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-etc-openvswitch\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.488538 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486604    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-etc-kubernetes\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.488538 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486606    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdc2f\" (UniqueName: \"kubernetes.io/projected/2413fc9d-9cab-44ea-81d6-e40c84c215a9-kube-api-access-xdc2f\") pod \"iptables-alerter-z7vks\" (UID: \"2413fc9d-9cab-44ea-81d6-e40c84c215a9\") " pod="openshift-network-operator/iptables-alerter-z7vks"
Jul 17 17:56:14.488538 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486648    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6deaf47f-3310-4d3e-825c-4b85347ad01e-metrics-certs\") pod \"network-metrics-daemon-mxdhr\" (UID: \"6deaf47f-3310-4d3e-825c-4b85347ad01e\") " pod="openshift-multus/network-metrics-daemon-mxdhr"
Jul 17 17:56:14.489045 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486672    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ab2ebce0-5586-41be-8698-849ad8481836-socket-dir\") pod \"aws-ebs-csi-driver-node-269bj\" (UID: \"ab2ebce0-5586-41be-8698-849ad8481836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-269bj"
Jul 17 17:56:14.489045 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:14.486749    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 17:56:14.489045 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486699    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-lib-modules\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.489045 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:14.486808    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6deaf47f-3310-4d3e-825c-4b85347ad01e-metrics-certs podName:6deaf47f-3310-4d3e-825c-4b85347ad01e nodeName:}" failed. No retries permitted until 2026-07-17 17:56:14.986793146 +0000 UTC m=+2.212022437 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6deaf47f-3310-4d3e-825c-4b85347ad01e-metrics-certs") pod "network-metrics-daemon-mxdhr" (UID: "6deaf47f-3310-4d3e-825c-4b85347ad01e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 17:56:14.489045 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486834    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ab2ebce0-5586-41be-8698-849ad8481836-socket-dir\") pod \"aws-ebs-csi-driver-node-269bj\" (UID: \"ab2ebce0-5586-41be-8698-849ad8481836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-269bj"
Jul 17 17:56:14.489045 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486843    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2413fc9d-9cab-44ea-81d6-e40c84c215a9-iptables-alerter-script\") pod \"iptables-alerter-z7vks\" (UID: \"2413fc9d-9cab-44ea-81d6-e40c84c215a9\") " pod="openshift-network-operator/iptables-alerter-z7vks"
Jul 17 17:56:14.489045 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486898    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d3a85848-4964-41eb-ae52-6fbca6f695fb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qsb98\" (UID: \"d3a85848-4964-41eb-ae52-6fbca6f695fb\") " pod="openshift-multus/multus-additional-cni-plugins-qsb98"
Jul 17 17:56:14.489045 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486921    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-host-slash\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.489045 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486943    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-host-cni-bin\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.489045 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486966    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2e3bd369-576e-4df1-8a76-aebd537cde58-ovnkube-config\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.489045 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.486991    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2e3bd369-576e-4df1-8a76-aebd537cde58-env-overrides\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.489045 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.487009    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-host-slash\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.489045 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.487019    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-host-cni-bin\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.489045 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.487033    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-multus-daemon-config\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.489556 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.487092    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d3a85848-4964-41eb-ae52-6fbca6f695fb-os-release\") pod \"multus-additional-cni-plugins-qsb98\" (UID: \"d3a85848-4964-41eb-ae52-6fbca6f695fb\") " pod="openshift-multus/multus-additional-cni-plugins-qsb98"
Jul 17 17:56:14.489556 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.487124    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/6bb964cd-6c2c-4997-b5c5-558b890f6277-konnectivity-ca\") pod \"konnectivity-agent-h9rs6\" (UID: \"6bb964cd-6c2c-4997-b5c5-558b890f6277\") " pod="kube-system/konnectivity-agent-h9rs6"
Jul 17 17:56:14.489556 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.487156    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d3a85848-4964-41eb-ae52-6fbca6f695fb-os-release\") pod \"multus-additional-cni-plugins-qsb98\" (UID: \"d3a85848-4964-41eb-ae52-6fbca6f695fb\") " pod="openshift-multus/multus-additional-cni-plugins-qsb98"
Jul 17 17:56:14.489556 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.487183    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98mjx\" (UniqueName: \"kubernetes.io/projected/6deaf47f-3310-4d3e-825c-4b85347ad01e-kube-api-access-98mjx\") pod \"network-metrics-daemon-mxdhr\" (UID: \"6deaf47f-3310-4d3e-825c-4b85347ad01e\") " pod="openshift-multus/network-metrics-daemon-mxdhr"
Jul 17 17:56:14.489556 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.487298    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-run-systemd\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.489556 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.487326    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-log-socket\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.489556 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.487363    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2e3bd369-576e-4df1-8a76-aebd537cde58-ovnkube-script-lib\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.489556 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.487382    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2413fc9d-9cab-44ea-81d6-e40c84c215a9-iptables-alerter-script\") pod \"iptables-alerter-z7vks\" (UID: \"2413fc9d-9cab-44ea-81d6-e40c84c215a9\") " pod="openshift-network-operator/iptables-alerter-z7vks"
Jul 17 17:56:14.489556 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.487407    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-run-systemd\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.489556 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.487439    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2e3bd369-576e-4df1-8a76-aebd537cde58-log-socket\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.489556 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.487499    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2e3bd369-576e-4df1-8a76-aebd537cde58-env-overrides\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.489556 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.487515    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d3a85848-4964-41eb-ae52-6fbca6f695fb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qsb98\" (UID: \"d3a85848-4964-41eb-ae52-6fbca6f695fb\") " pod="openshift-multus/multus-additional-cni-plugins-qsb98"
Jul 17 17:56:14.489556 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.487539    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-multus-daemon-config\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.489556 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.487974    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2e3bd369-576e-4df1-8a76-aebd537cde58-ovnkube-config\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.489914 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.488408    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2e3bd369-576e-4df1-8a76-aebd537cde58-ovnkube-script-lib\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.489914 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.489174    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2e3bd369-576e-4df1-8a76-aebd537cde58-ovn-node-metrics-cert\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.489914 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.489220    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/6bb964cd-6c2c-4997-b5c5-558b890f6277-agent-certs\") pod \"konnectivity-agent-h9rs6\" (UID: \"6bb964cd-6c2c-4997-b5c5-558b890f6277\") " pod="kube-system/konnectivity-agent-h9rs6"
Jul 17 17:56:14.494773 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:14.494743    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 17:56:14.494773 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:14.494762    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 17:56:14.494773 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:14.494771    2572 projected.go:196] Error preparing data for projected volume kube-api-access-fhhsg for pod openshift-network-diagnostics/network-check-target-sz5w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 17:56:14.494992 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:14.494831    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d66f36e8-45f4-457e-b26e-44455cc4a850-kube-api-access-fhhsg podName:d66f36e8-45f4-457e-b26e-44455cc4a850 nodeName:}" failed. No retries permitted until 2026-07-17 17:56:14.994814403 +0000 UTC m=+2.220043711 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fhhsg" (UniqueName: "kubernetes.io/projected/d66f36e8-45f4-457e-b26e-44455cc4a850-kube-api-access-fhhsg") pod "network-check-target-sz5w2" (UID: "d66f36e8-45f4-457e-b26e-44455cc4a850") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 17:56:14.495481 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.495459    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qqd7\" (UniqueName: \"kubernetes.io/projected/91a901b1-0ccc-4ea8-92cb-2c3fd93e6430-kube-api-access-9qqd7\") pod \"multus-g8zxq\" (UID: \"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430\") " pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.496199 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.496160    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hnn8\" (UniqueName: \"kubernetes.io/projected/d3a85848-4964-41eb-ae52-6fbca6f695fb-kube-api-access-8hnn8\") pod \"multus-additional-cni-plugins-qsb98\" (UID: \"d3a85848-4964-41eb-ae52-6fbca6f695fb\") " pod="openshift-multus/multus-additional-cni-plugins-qsb98"
Jul 17 17:56:14.496341 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.496321    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmpvn\" (UniqueName: \"kubernetes.io/projected/ab2ebce0-5586-41be-8698-849ad8481836-kube-api-access-tmpvn\") pod \"aws-ebs-csi-driver-node-269bj\" (UID: \"ab2ebce0-5586-41be-8698-849ad8481836\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-269bj"
Jul 17 17:56:14.497313 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.497284    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdc2f\" (UniqueName: \"kubernetes.io/projected/2413fc9d-9cab-44ea-81d6-e40c84c215a9-kube-api-access-xdc2f\") pod \"iptables-alerter-z7vks\" (UID: \"2413fc9d-9cab-44ea-81d6-e40c84c215a9\") " pod="openshift-network-operator/iptables-alerter-z7vks"
Jul 17 17:56:14.497643 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.497627    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98mjx\" (UniqueName: \"kubernetes.io/projected/6deaf47f-3310-4d3e-825c-4b85347ad01e-kube-api-access-98mjx\") pod \"network-metrics-daemon-mxdhr\" (UID: \"6deaf47f-3310-4d3e-825c-4b85347ad01e\") " pod="openshift-multus/network-metrics-daemon-mxdhr"
Jul 17 17:56:14.497979 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.497958    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k6gq\" (UniqueName: \"kubernetes.io/projected/2e3bd369-576e-4df1-8a76-aebd537cde58-kube-api-access-8k6gq\") pod \"ovnkube-node-v5mdx\" (UID: \"2e3bd369-576e-4df1-8a76-aebd537cde58\") " pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.587697 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.587609    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cxbq\" (UniqueName: \"kubernetes.io/projected/cd3b555f-c848-4492-a111-1a007f3d469d-kube-api-access-6cxbq\") pod \"node-resolver-rnhqt\" (UID: \"cd3b555f-c848-4492-a111-1a007f3d469d\") " pod="openshift-dns/node-resolver-rnhqt"
Jul 17 17:56:14.587697 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.587645    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-etc-tuned\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.587697 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.587661    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd3b555f-c848-4492-a111-1a007f3d469d-tmp-dir\") pod \"node-resolver-rnhqt\" (UID: \"cd3b555f-c848-4492-a111-1a007f3d469d\") " pod="openshift-dns/node-resolver-rnhqt"
Jul 17 17:56:14.588330 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.587705    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1e914c47-eaed-4241-b5f8-9c3d2f0a3be8-serviceca\") pod \"node-ca-b4t9q\" (UID: \"1e914c47-eaed-4241-b5f8-9c3d2f0a3be8\") " pod="openshift-image-registry/node-ca-b4t9q"
Jul 17 17:56:14.588330 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.587742    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw27m\" (UniqueName: \"kubernetes.io/projected/1e914c47-eaed-4241-b5f8-9c3d2f0a3be8-kube-api-access-bw27m\") pod \"node-ca-b4t9q\" (UID: \"1e914c47-eaed-4241-b5f8-9c3d2f0a3be8\") " pod="openshift-image-registry/node-ca-b4t9q"
Jul 17 17:56:14.588330 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.587866    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7403c99b-bdb6-4595-916c-b4b8d138f4d0-original-pull-secret\") pod \"global-pull-secret-syncer-ldrq9\" (UID: \"7403c99b-bdb6-4595-916c-b4b8d138f4d0\") " pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:56:14.588330 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.587900    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-tmp\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.588330 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.587931    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-etc-modprobe-d\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.588330 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.587955    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7403c99b-bdb6-4595-916c-b4b8d138f4d0-dbus\") pod \"global-pull-secret-syncer-ldrq9\" (UID: \"7403c99b-bdb6-4595-916c-b4b8d138f4d0\") " pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:56:14.588330 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.587963    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd3b555f-c848-4492-a111-1a007f3d469d-tmp-dir\") pod \"node-resolver-rnhqt\" (UID: \"cd3b555f-c848-4492-a111-1a007f3d469d\") " pod="openshift-dns/node-resolver-rnhqt"
Jul 17 17:56:14.588330 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.587974    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-etc-sysctl-conf\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.588330 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.588039    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-etc-systemd\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.588330 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.588058    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7403c99b-bdb6-4595-916c-b4b8d138f4d0-dbus\") pod \"global-pull-secret-syncer-ldrq9\" (UID: \"7403c99b-bdb6-4595-916c-b4b8d138f4d0\") " pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:56:14.588330 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.588070    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-host\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.588330 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.588094    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-etc-kubernetes\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.588330 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:14.588105    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 17:56:14.588330 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.588116    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-sys\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.588330 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.588135    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-etc-sysctl-conf\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.588927 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.588138    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-var-lib-kubelet\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.588927 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.588145    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-etc-systemd\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.588927 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:14.588165    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7403c99b-bdb6-4595-916c-b4b8d138f4d0-original-pull-secret podName:7403c99b-bdb6-4595-916c-b4b8d138f4d0 nodeName:}" failed. No retries permitted until 2026-07-17 17:56:15.088147198 +0000 UTC m=+2.313376497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7403c99b-bdb6-4595-916c-b4b8d138f4d0-original-pull-secret") pod "global-pull-secret-syncer-ldrq9" (UID: "7403c99b-bdb6-4595-916c-b4b8d138f4d0") : object "kube-system"/"original-pull-secret" not registered
Jul 17 17:56:14.588927 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.588175    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-etc-modprobe-d\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.588927 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.588178    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-var-lib-kubelet\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.588927 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.588173    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1e914c47-eaed-4241-b5f8-9c3d2f0a3be8-serviceca\") pod \"node-ca-b4t9q\" (UID: \"1e914c47-eaed-4241-b5f8-9c3d2f0a3be8\") " pod="openshift-image-registry/node-ca-b4t9q"
Jul 17 17:56:14.588927 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.588237    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-host\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.588927 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.588238    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-sys\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.588927 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.588239    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-etc-sysconfig\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.588927 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.588275    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-etc-kubernetes\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.588927 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.588294    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-etc-sysconfig\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.588927 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.588286    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-etc-sysctl-d\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.588927 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.588340    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e914c47-eaed-4241-b5f8-9c3d2f0a3be8-host\") pod \"node-ca-b4t9q\" (UID: \"1e914c47-eaed-4241-b5f8-9c3d2f0a3be8\") " pod="openshift-image-registry/node-ca-b4t9q"
Jul 17 17:56:14.588927 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.588387    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7403c99b-bdb6-4595-916c-b4b8d138f4d0-kubelet-config\") pod \"global-pull-secret-syncer-ldrq9\" (UID: \"7403c99b-bdb6-4595-916c-b4b8d138f4d0\") " pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:56:14.589392 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.588413    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e914c47-eaed-4241-b5f8-9c3d2f0a3be8-host\") pod \"node-ca-b4t9q\" (UID: \"1e914c47-eaed-4241-b5f8-9c3d2f0a3be8\") " pod="openshift-image-registry/node-ca-b4t9q"
Jul 17 17:56:14.589392 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.588421    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7znsh\" (UniqueName: \"kubernetes.io/projected/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-kube-api-access-7znsh\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.589392 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.588448    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-etc-sysctl-d\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.589392 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.588459    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7403c99b-bdb6-4595-916c-b4b8d138f4d0-kubelet-config\") pod \"global-pull-secret-syncer-ldrq9\" (UID: \"7403c99b-bdb6-4595-916c-b4b8d138f4d0\") " pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:56:14.589392 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.588473    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-lib-modules\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.589392 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.588518    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-run\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.589392 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.588543    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cd3b555f-c848-4492-a111-1a007f3d469d-hosts-file\") pod \"node-resolver-rnhqt\" (UID: \"cd3b555f-c848-4492-a111-1a007f3d469d\") " pod="openshift-dns/node-resolver-rnhqt"
Jul 17 17:56:14.589392 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.588574    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-run\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.589392 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.588593    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-lib-modules\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.589392 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.588616    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cd3b555f-c848-4492-a111-1a007f3d469d-hosts-file\") pod \"node-resolver-rnhqt\" (UID: \"cd3b555f-c848-4492-a111-1a007f3d469d\") " pod="openshift-dns/node-resolver-rnhqt"
Jul 17 17:56:14.589964 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.589919    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-etc-tuned\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.590234 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.590214    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-tmp\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.600693 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.600675    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cxbq\" (UniqueName: \"kubernetes.io/projected/cd3b555f-c848-4492-a111-1a007f3d469d-kube-api-access-6cxbq\") pod \"node-resolver-rnhqt\" (UID: \"cd3b555f-c848-4492-a111-1a007f3d469d\") " pod="openshift-dns/node-resolver-rnhqt"
Jul 17 17:56:14.603379 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.603348    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7znsh\" (UniqueName: \"kubernetes.io/projected/f91fbd01-c503-41b5-8fc9-84e1e4f0b605-kube-api-access-7znsh\") pod \"tuned-qm4d4\" (UID: \"f91fbd01-c503-41b5-8fc9-84e1e4f0b605\") " pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.603627 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.603602    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw27m\" (UniqueName: \"kubernetes.io/projected/1e914c47-eaed-4241-b5f8-9c3d2f0a3be8-kube-api-access-bw27m\") pod \"node-ca-b4t9q\" (UID: \"1e914c47-eaed-4241-b5f8-9c3d2f0a3be8\") " pod="openshift-image-registry/node-ca-b4t9q"
Jul 17 17:56:14.667085 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.667049    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z7vks"
Jul 17 17:56:14.683445 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.683416    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:14.698636 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.698612    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qsb98"
Jul 17 17:56:14.716328 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.716304    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g8zxq"
Jul 17 17:56:14.729309 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.729284    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-269bj"
Jul 17 17:56:14.747248 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.747205    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h9rs6"
Jul 17 17:56:14.756661 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.756640    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qm4d4"
Jul 17 17:56:14.774231 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.774204    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-b4t9q"
Jul 17 17:56:14.778595 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.778580    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rnhqt"
Jul 17 17:56:14.804572 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:14.804535    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd3b555f_c848_4492_a111_1a007f3d469d.slice/crio-368aa58b74ea152a3accd76f2ef7f04b7880c2d585dc8a78e48d41355117b51f WatchSource:0}: Error finding container 368aa58b74ea152a3accd76f2ef7f04b7880c2d585dc8a78e48d41355117b51f: Status 404 returned error can't find the container with id 368aa58b74ea152a3accd76f2ef7f04b7880c2d585dc8a78e48d41355117b51f
Jul 17 17:56:14.805055 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:14.805028    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20554dd5d0f2d6efd09ccfb94678d149.slice/crio-04512e584d1901a2c98cede4dda5836e0802416a23f9d0259dcb183be877ff32 WatchSource:0}: Error finding container 04512e584d1901a2c98cede4dda5836e0802416a23f9d0259dcb183be877ff32: Status 404 returned error can't find the container with id 04512e584d1901a2c98cede4dda5836e0802416a23f9d0259dcb183be877ff32
Jul 17 17:56:14.805486 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:14.805454    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bfbaed7d32901437b702fd04e14392e.slice/crio-d0b5b6a8edbc50b4ea7d792522dd3f28f480c09a97f85ceb64e43b1d5ad1c369 WatchSource:0}: Error finding container d0b5b6a8edbc50b4ea7d792522dd3f28f480c09a97f85ceb64e43b1d5ad1c369: Status 404 returned error can't find the container with id d0b5b6a8edbc50b4ea7d792522dd3f28f480c09a97f85ceb64e43b1d5ad1c369
Jul 17 17:56:14.806265 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:14.806248    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e914c47_eaed_4241_b5f8_9c3d2f0a3be8.slice/crio-5621fb3ef4b29a165eb449048f3dc6c9c1eab2d670d7882dc354cc0e4adb8115 WatchSource:0}: Error finding container 5621fb3ef4b29a165eb449048f3dc6c9c1eab2d670d7882dc354cc0e4adb8115: Status 404 returned error can't find the container with id 5621fb3ef4b29a165eb449048f3dc6c9c1eab2d670d7882dc354cc0e4adb8115
Jul 17 17:56:14.812124 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.812106    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 17:56:14.992340 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:14.992305    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6deaf47f-3310-4d3e-825c-4b85347ad01e-metrics-certs\") pod \"network-metrics-daemon-mxdhr\" (UID: \"6deaf47f-3310-4d3e-825c-4b85347ad01e\") " pod="openshift-multus/network-metrics-daemon-mxdhr"
Jul 17 17:56:14.992495 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:14.992458    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 17:56:14.992541 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:14.992524    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6deaf47f-3310-4d3e-825c-4b85347ad01e-metrics-certs podName:6deaf47f-3310-4d3e-825c-4b85347ad01e nodeName:}" failed. No retries permitted until 2026-07-17 17:56:15.992509291 +0000 UTC m=+3.217738576 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6deaf47f-3310-4d3e-825c-4b85347ad01e-metrics-certs") pod "network-metrics-daemon-mxdhr" (UID: "6deaf47f-3310-4d3e-825c-4b85347ad01e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 17:56:15.071980 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:15.071952    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e3bd369_576e_4df1_8a76_aebd537cde58.slice/crio-b87a5e4a15c0f21f211d71642ad97d1c1f4127eebbcdd5c36cbbb5bb505aa3b7 WatchSource:0}: Error finding container b87a5e4a15c0f21f211d71642ad97d1c1f4127eebbcdd5c36cbbb5bb505aa3b7: Status 404 returned error can't find the container with id b87a5e4a15c0f21f211d71642ad97d1c1f4127eebbcdd5c36cbbb5bb505aa3b7
Jul 17 17:56:15.077992 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:15.077969    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2413fc9d_9cab_44ea_81d6_e40c84c215a9.slice/crio-df14742c4b4a65fba6a4f0267a4ae9e71946e61753ac703e37291db0f2bd20b4 WatchSource:0}: Error finding container df14742c4b4a65fba6a4f0267a4ae9e71946e61753ac703e37291db0f2bd20b4: Status 404 returned error can't find the container with id df14742c4b4a65fba6a4f0267a4ae9e71946e61753ac703e37291db0f2bd20b4
Jul 17 17:56:15.081491 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:15.081468    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91a901b1_0ccc_4ea8_92cb_2c3fd93e6430.slice/crio-5d3b6b46f561c8af2f2d98cd810b60a9133f5dc1b0a0b68218cfc8f92143694d WatchSource:0}: Error finding container 5d3b6b46f561c8af2f2d98cd810b60a9133f5dc1b0a0b68218cfc8f92143694d: Status 404 returned error can't find the container with id 5d3b6b46f561c8af2f2d98cd810b60a9133f5dc1b0a0b68218cfc8f92143694d
Jul 17 17:56:15.082620 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:15.082596    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3a85848_4964_41eb_ae52_6fbca6f695fb.slice/crio-5076b2ac2a27edff125820004a0a54c8f2b7f26781c7a3c9676f355f12e3d611 WatchSource:0}: Error finding container 5076b2ac2a27edff125820004a0a54c8f2b7f26781c7a3c9676f355f12e3d611: Status 404 returned error can't find the container with id 5076b2ac2a27edff125820004a0a54c8f2b7f26781c7a3c9676f355f12e3d611
Jul 17 17:56:15.084976 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:15.084954    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bb964cd_6c2c_4997_b5c5_558b890f6277.slice/crio-54d82a09853df722e6daad043b42c074ec3b0482206bb11c7167ed33f60caaed WatchSource:0}: Error finding container 54d82a09853df722e6daad043b42c074ec3b0482206bb11c7167ed33f60caaed: Status 404 returned error can't find the container with id 54d82a09853df722e6daad043b42c074ec3b0482206bb11c7167ed33f60caaed
Jul 17 17:56:15.092884 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:15.092860    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7403c99b-bdb6-4595-916c-b4b8d138f4d0-original-pull-secret\") pod \"global-pull-secret-syncer-ldrq9\" (UID: \"7403c99b-bdb6-4595-916c-b4b8d138f4d0\") " pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:56:15.092978 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:15.092905    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhhsg\" (UniqueName: \"kubernetes.io/projected/d66f36e8-45f4-457e-b26e-44455cc4a850-kube-api-access-fhhsg\") pod \"network-check-target-sz5w2\" (UID: \"d66f36e8-45f4-457e-b26e-44455cc4a850\") " pod="openshift-network-diagnostics/network-check-target-sz5w2"
Jul 17 17:56:15.093045 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:15.093026    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 17:56:15.093045 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:15.093043    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 17:56:15.093122 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:15.093053    2572 projected.go:196] Error preparing data for projected volume kube-api-access-fhhsg for pod openshift-network-diagnostics/network-check-target-sz5w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 17:56:15.093122 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:15.093062    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 17:56:15.093122 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:15.093103    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d66f36e8-45f4-457e-b26e-44455cc4a850-kube-api-access-fhhsg podName:d66f36e8-45f4-457e-b26e-44455cc4a850 nodeName:}" failed. No retries permitted until 2026-07-17 17:56:16.093085824 +0000 UTC m=+3.318315127 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fhhsg" (UniqueName: "kubernetes.io/projected/d66f36e8-45f4-457e-b26e-44455cc4a850-kube-api-access-fhhsg") pod "network-check-target-sz5w2" (UID: "d66f36e8-45f4-457e-b26e-44455cc4a850") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 17:56:15.093242 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:15.093123    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7403c99b-bdb6-4595-916c-b4b8d138f4d0-original-pull-secret podName:7403c99b-bdb6-4595-916c-b4b8d138f4d0 nodeName:}" failed. No retries permitted until 2026-07-17 17:56:16.093114337 +0000 UTC m=+3.318343623 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7403c99b-bdb6-4595-916c-b4b8d138f4d0-original-pull-secret") pod "global-pull-secret-syncer-ldrq9" (UID: "7403c99b-bdb6-4595-916c-b4b8d138f4d0") : object "kube-system"/"original-pull-secret" not registered
Jul 17 17:56:15.114617 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:15.114592    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf91fbd01_c503_41b5_8fc9_84e1e4f0b605.slice/crio-e1252d1a360308e653440b9c197b54ef31c206d4268440e72aa3b2adcc034225 WatchSource:0}: Error finding container e1252d1a360308e653440b9c197b54ef31c206d4268440e72aa3b2adcc034225: Status 404 returned error can't find the container with id e1252d1a360308e653440b9c197b54ef31c206d4268440e72aa3b2adcc034225
Jul 17 17:56:15.186109 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:15.186071    2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 17:56:15.212625 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:15.212602    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab2ebce0_5586_41be_8698_849ad8481836.slice/crio-f47aeaea4ebc79472866f11afa0af8036ed8de25bdce275e84f6e037476baeaa WatchSource:0}: Error finding container f47aeaea4ebc79472866f11afa0af8036ed8de25bdce275e84f6e037476baeaa: Status 404 returned error can't find the container with id f47aeaea4ebc79472866f11afa0af8036ed8de25bdce275e84f6e037476baeaa
Jul 17 17:56:15.284480 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:15.284401    2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 17:56:15.387111 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:15.387055    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 17:51:14 +0000 UTC" deadline="2028-01-30 02:44:23.329574474 +0000 UTC"
Jul 17 17:56:15.387111 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:15.387102    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13472h48m7.942475398s"
Jul 17 17:56:15.469448 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:15.469387    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-269bj" event={"ID":"ab2ebce0-5586-41be-8698-849ad8481836","Type":"ContainerStarted","Data":"f47aeaea4ebc79472866f11afa0af8036ed8de25bdce275e84f6e037476baeaa"}
Jul 17 17:56:15.470865 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:15.470835    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qm4d4" event={"ID":"f91fbd01-c503-41b5-8fc9-84e1e4f0b605","Type":"ContainerStarted","Data":"e1252d1a360308e653440b9c197b54ef31c206d4268440e72aa3b2adcc034225"}
Jul 17 17:56:15.471269 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:15.471247    2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 17 17:56:15.472048 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:15.472025    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h9rs6" event={"ID":"6bb964cd-6c2c-4997-b5c5-558b890f6277","Type":"ContainerStarted","Data":"54d82a09853df722e6daad043b42c074ec3b0482206bb11c7167ed33f60caaed"}
Jul 17 17:56:15.473034 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:15.473011    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qsb98" event={"ID":"d3a85848-4964-41eb-ae52-6fbca6f695fb","Type":"ContainerStarted","Data":"5076b2ac2a27edff125820004a0a54c8f2b7f26781c7a3c9676f355f12e3d611"}
Jul 17 17:56:15.474138 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:15.474111    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z7vks" event={"ID":"2413fc9d-9cab-44ea-81d6-e40c84c215a9","Type":"ContainerStarted","Data":"df14742c4b4a65fba6a4f0267a4ae9e71946e61753ac703e37291db0f2bd20b4"}
Jul 17 17:56:15.475414 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:15.475390    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx" event={"ID":"2e3bd369-576e-4df1-8a76-aebd537cde58","Type":"ContainerStarted","Data":"b87a5e4a15c0f21f211d71642ad97d1c1f4127eebbcdd5c36cbbb5bb505aa3b7"}
Jul 17 17:56:15.476544 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:15.476519    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-226.ec2.internal" event={"ID":"20554dd5d0f2d6efd09ccfb94678d149","Type":"ContainerStarted","Data":"04512e584d1901a2c98cede4dda5836e0802416a23f9d0259dcb183be877ff32"}
Jul 17 17:56:15.477635 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:15.477611    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b4t9q" event={"ID":"1e914c47-eaed-4241-b5f8-9c3d2f0a3be8","Type":"ContainerStarted","Data":"5621fb3ef4b29a165eb449048f3dc6c9c1eab2d670d7882dc354cc0e4adb8115"}
Jul 17 17:56:15.478794 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:15.478775    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g8zxq" event={"ID":"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430","Type":"ContainerStarted","Data":"5d3b6b46f561c8af2f2d98cd810b60a9133f5dc1b0a0b68218cfc8f92143694d"}
Jul 17 17:56:15.479976 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:15.479955    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-226.ec2.internal" event={"ID":"8bfbaed7d32901437b702fd04e14392e","Type":"ContainerStarted","Data":"d0b5b6a8edbc50b4ea7d792522dd3f28f480c09a97f85ceb64e43b1d5ad1c369"}
Jul 17 17:56:15.481076 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:15.481057    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rnhqt" event={"ID":"cd3b555f-c848-4492-a111-1a007f3d469d","Type":"ContainerStarted","Data":"368aa58b74ea152a3accd76f2ef7f04b7880c2d585dc8a78e48d41355117b51f"}
Jul 17 17:56:16.001561 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:16.001518    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6deaf47f-3310-4d3e-825c-4b85347ad01e-metrics-certs\") pod \"network-metrics-daemon-mxdhr\" (UID: \"6deaf47f-3310-4d3e-825c-4b85347ad01e\") " pod="openshift-multus/network-metrics-daemon-mxdhr"
Jul 17 17:56:16.001831 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:16.001792    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 17:56:16.001929 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:16.001867    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6deaf47f-3310-4d3e-825c-4b85347ad01e-metrics-certs podName:6deaf47f-3310-4d3e-825c-4b85347ad01e nodeName:}" failed. No retries permitted until 2026-07-17 17:56:18.001843453 +0000 UTC m=+5.227072742 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6deaf47f-3310-4d3e-825c-4b85347ad01e-metrics-certs") pod "network-metrics-daemon-mxdhr" (UID: "6deaf47f-3310-4d3e-825c-4b85347ad01e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 17:56:16.103245 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:16.102209    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7403c99b-bdb6-4595-916c-b4b8d138f4d0-original-pull-secret\") pod \"global-pull-secret-syncer-ldrq9\" (UID: \"7403c99b-bdb6-4595-916c-b4b8d138f4d0\") " pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:56:16.103245 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:16.102284    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhhsg\" (UniqueName: \"kubernetes.io/projected/d66f36e8-45f4-457e-b26e-44455cc4a850-kube-api-access-fhhsg\") pod \"network-check-target-sz5w2\" (UID: \"d66f36e8-45f4-457e-b26e-44455cc4a850\") " pod="openshift-network-diagnostics/network-check-target-sz5w2"
Jul 17 17:56:16.103245 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:16.102453    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 17:56:16.103245 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:16.102509    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 17:56:16.103245 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:16.102522    2572 projected.go:196] Error preparing data for projected volume kube-api-access-fhhsg for pod openshift-network-diagnostics/network-check-target-sz5w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 17:56:16.103245 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:16.102666    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d66f36e8-45f4-457e-b26e-44455cc4a850-kube-api-access-fhhsg podName:d66f36e8-45f4-457e-b26e-44455cc4a850 nodeName:}" failed. No retries permitted until 2026-07-17 17:56:18.102563184 +0000 UTC m=+5.327792489 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fhhsg" (UniqueName: "kubernetes.io/projected/d66f36e8-45f4-457e-b26e-44455cc4a850-kube-api-access-fhhsg") pod "network-check-target-sz5w2" (UID: "d66f36e8-45f4-457e-b26e-44455cc4a850") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 17:56:16.103245 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:16.103150    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 17:56:16.103245 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:16.103203    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7403c99b-bdb6-4595-916c-b4b8d138f4d0-original-pull-secret podName:7403c99b-bdb6-4595-916c-b4b8d138f4d0 nodeName:}" failed. No retries permitted until 2026-07-17 17:56:18.103187255 +0000 UTC m=+5.328416558 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7403c99b-bdb6-4595-916c-b4b8d138f4d0-original-pull-secret") pod "global-pull-secret-syncer-ldrq9" (UID: "7403c99b-bdb6-4595-916c-b4b8d138f4d0") : object "kube-system"/"original-pull-secret" not registered
Jul 17 17:56:16.388654 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:16.387515    2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-16 17:51:14 +0000 UTC" deadline="2028-05-03 22:45:44.465225312 +0000 UTC"
Jul 17 17:56:16.388654 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:16.387555    2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15748h49m28.077675188s"
Jul 17 17:56:16.465562 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:16.465525    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxdhr"
Jul 17 17:56:16.465816 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:16.465674    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxdhr" podUID="6deaf47f-3310-4d3e-825c-4b85347ad01e"
Jul 17 17:56:16.466123 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:16.466102    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz5w2"
Jul 17 17:56:16.466220 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:16.466202    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz5w2" podUID="d66f36e8-45f4-457e-b26e-44455cc4a850"
Jul 17 17:56:16.466282 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:16.466263    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:56:16.466356 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:16.466335    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldrq9" podUID="7403c99b-bdb6-4595-916c-b4b8d138f4d0"
Jul 17 17:56:18.018607 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:18.018565    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6deaf47f-3310-4d3e-825c-4b85347ad01e-metrics-certs\") pod \"network-metrics-daemon-mxdhr\" (UID: \"6deaf47f-3310-4d3e-825c-4b85347ad01e\") " pod="openshift-multus/network-metrics-daemon-mxdhr"
Jul 17 17:56:18.019112 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:18.018774    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 17:56:18.019112 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:18.018839    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6deaf47f-3310-4d3e-825c-4b85347ad01e-metrics-certs podName:6deaf47f-3310-4d3e-825c-4b85347ad01e nodeName:}" failed. No retries permitted until 2026-07-17 17:56:22.01881891 +0000 UTC m=+9.244048210 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6deaf47f-3310-4d3e-825c-4b85347ad01e-metrics-certs") pod "network-metrics-daemon-mxdhr" (UID: "6deaf47f-3310-4d3e-825c-4b85347ad01e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 17:56:18.119303 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:18.119263    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhhsg\" (UniqueName: \"kubernetes.io/projected/d66f36e8-45f4-457e-b26e-44455cc4a850-kube-api-access-fhhsg\") pod \"network-check-target-sz5w2\" (UID: \"d66f36e8-45f4-457e-b26e-44455cc4a850\") " pod="openshift-network-diagnostics/network-check-target-sz5w2"
Jul 17 17:56:18.119492 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:18.119358    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7403c99b-bdb6-4595-916c-b4b8d138f4d0-original-pull-secret\") pod \"global-pull-secret-syncer-ldrq9\" (UID: \"7403c99b-bdb6-4595-916c-b4b8d138f4d0\") " pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:56:18.119492 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:18.119480    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 17:56:18.119599 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:18.119541    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7403c99b-bdb6-4595-916c-b4b8d138f4d0-original-pull-secret podName:7403c99b-bdb6-4595-916c-b4b8d138f4d0 nodeName:}" failed. No retries permitted until 2026-07-17 17:56:22.119523362 +0000 UTC m=+9.344752654 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7403c99b-bdb6-4595-916c-b4b8d138f4d0-original-pull-secret") pod "global-pull-secret-syncer-ldrq9" (UID: "7403c99b-bdb6-4595-916c-b4b8d138f4d0") : object "kube-system"/"original-pull-secret" not registered
Jul 17 17:56:18.119959 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:18.119939    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 17:56:18.120073 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:18.119965    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 17:56:18.120073 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:18.119977    2572 projected.go:196] Error preparing data for projected volume kube-api-access-fhhsg for pod openshift-network-diagnostics/network-check-target-sz5w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 17:56:18.120715 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:18.120345    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d66f36e8-45f4-457e-b26e-44455cc4a850-kube-api-access-fhhsg podName:d66f36e8-45f4-457e-b26e-44455cc4a850 nodeName:}" failed. No retries permitted until 2026-07-17 17:56:22.120324231 +0000 UTC m=+9.345553519 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fhhsg" (UniqueName: "kubernetes.io/projected/d66f36e8-45f4-457e-b26e-44455cc4a850-kube-api-access-fhhsg") pod "network-check-target-sz5w2" (UID: "d66f36e8-45f4-457e-b26e-44455cc4a850") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 17:56:18.465944 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:18.465910    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:56:18.465944 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:18.465932    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxdhr"
Jul 17 17:56:18.466204 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:18.466065    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldrq9" podUID="7403c99b-bdb6-4595-916c-b4b8d138f4d0"
Jul 17 17:56:18.466204 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:18.466167    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxdhr" podUID="6deaf47f-3310-4d3e-825c-4b85347ad01e"
Jul 17 17:56:18.466313 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:18.466235    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz5w2"
Jul 17 17:56:18.466365 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:18.466335    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz5w2" podUID="d66f36e8-45f4-457e-b26e-44455cc4a850"
Jul 17 17:56:20.465450 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:20.465412    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:56:20.465913 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:20.465557    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldrq9" podUID="7403c99b-bdb6-4595-916c-b4b8d138f4d0"
Jul 17 17:56:20.465984 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:20.465916    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxdhr"
Jul 17 17:56:20.466289 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:20.466054    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxdhr" podUID="6deaf47f-3310-4d3e-825c-4b85347ad01e"
Jul 17 17:56:20.466289 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:20.466157    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz5w2"
Jul 17 17:56:20.466289 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:20.466252    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz5w2" podUID="d66f36e8-45f4-457e-b26e-44455cc4a850"
Jul 17 17:56:22.052061 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:22.052018    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6deaf47f-3310-4d3e-825c-4b85347ad01e-metrics-certs\") pod \"network-metrics-daemon-mxdhr\" (UID: \"6deaf47f-3310-4d3e-825c-4b85347ad01e\") " pod="openshift-multus/network-metrics-daemon-mxdhr"
Jul 17 17:56:22.052516 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:22.052218    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 17:56:22.052516 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:22.052286    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6deaf47f-3310-4d3e-825c-4b85347ad01e-metrics-certs podName:6deaf47f-3310-4d3e-825c-4b85347ad01e nodeName:}" failed. No retries permitted until 2026-07-17 17:56:30.052267022 +0000 UTC m=+17.277496314 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6deaf47f-3310-4d3e-825c-4b85347ad01e-metrics-certs") pod "network-metrics-daemon-mxdhr" (UID: "6deaf47f-3310-4d3e-825c-4b85347ad01e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 17:56:22.152831 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:22.152794    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7403c99b-bdb6-4595-916c-b4b8d138f4d0-original-pull-secret\") pod \"global-pull-secret-syncer-ldrq9\" (UID: \"7403c99b-bdb6-4595-916c-b4b8d138f4d0\") " pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:56:22.153027 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:22.152867    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhhsg\" (UniqueName: \"kubernetes.io/projected/d66f36e8-45f4-457e-b26e-44455cc4a850-kube-api-access-fhhsg\") pod \"network-check-target-sz5w2\" (UID: \"d66f36e8-45f4-457e-b26e-44455cc4a850\") " pod="openshift-network-diagnostics/network-check-target-sz5w2"
Jul 17 17:56:22.153027 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:22.152989    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 17:56:22.153140 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:22.153078    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 17:56:22.153140 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:22.153091    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7403c99b-bdb6-4595-916c-b4b8d138f4d0-original-pull-secret podName:7403c99b-bdb6-4595-916c-b4b8d138f4d0 nodeName:}" failed. No retries permitted until 2026-07-17 17:56:30.153068495 +0000 UTC m=+17.378297783 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7403c99b-bdb6-4595-916c-b4b8d138f4d0-original-pull-secret") pod "global-pull-secret-syncer-ldrq9" (UID: "7403c99b-bdb6-4595-916c-b4b8d138f4d0") : object "kube-system"/"original-pull-secret" not registered
Jul 17 17:56:22.153140 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:22.153096    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 17:56:22.153140 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:22.153109    2572 projected.go:196] Error preparing data for projected volume kube-api-access-fhhsg for pod openshift-network-diagnostics/network-check-target-sz5w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 17:56:22.153349 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:22.153156    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d66f36e8-45f4-457e-b26e-44455cc4a850-kube-api-access-fhhsg podName:d66f36e8-45f4-457e-b26e-44455cc4a850 nodeName:}" failed. No retries permitted until 2026-07-17 17:56:30.1531394 +0000 UTC m=+17.378368703 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fhhsg" (UniqueName: "kubernetes.io/projected/d66f36e8-45f4-457e-b26e-44455cc4a850-kube-api-access-fhhsg") pod "network-check-target-sz5w2" (UID: "d66f36e8-45f4-457e-b26e-44455cc4a850") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 17:56:22.466026 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:22.465976    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz5w2"
Jul 17 17:56:22.466225 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:22.466036    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:56:22.466225 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:22.465982    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxdhr"
Jul 17 17:56:22.466225 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:22.466124    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz5w2" podUID="d66f36e8-45f4-457e-b26e-44455cc4a850"
Jul 17 17:56:22.466415 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:22.466237    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldrq9" podUID="7403c99b-bdb6-4595-916c-b4b8d138f4d0"
Jul 17 17:56:22.466415 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:22.466314    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxdhr" podUID="6deaf47f-3310-4d3e-825c-4b85347ad01e"
Jul 17 17:56:24.466246 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:24.466211    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz5w2"
Jul 17 17:56:24.466775 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:24.466222    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:56:24.466775 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:24.466339    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz5w2" podUID="d66f36e8-45f4-457e-b26e-44455cc4a850"
Jul 17 17:56:24.466775 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:24.466364    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxdhr"
Jul 17 17:56:24.466775 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:24.466443    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldrq9" podUID="7403c99b-bdb6-4595-916c-b4b8d138f4d0"
Jul 17 17:56:24.466775 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:24.466555    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxdhr" podUID="6deaf47f-3310-4d3e-825c-4b85347ad01e"
Jul 17 17:56:26.466034 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:26.465959    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxdhr"
Jul 17 17:56:26.466502 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:26.465959    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:56:26.466502 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:26.466120    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxdhr" podUID="6deaf47f-3310-4d3e-825c-4b85347ad01e"
Jul 17 17:56:26.466502 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:26.465959    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz5w2"
Jul 17 17:56:26.466502 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:26.466198    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldrq9" podUID="7403c99b-bdb6-4595-916c-b4b8d138f4d0"
Jul 17 17:56:26.466502 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:26.466236    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz5w2" podUID="d66f36e8-45f4-457e-b26e-44455cc4a850"
Jul 17 17:56:28.466091 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:28.466052    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:56:28.466091 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:28.466075    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxdhr"
Jul 17 17:56:28.466536 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:28.466171    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldrq9" podUID="7403c99b-bdb6-4595-916c-b4b8d138f4d0"
Jul 17 17:56:28.466536 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:28.466281    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxdhr" podUID="6deaf47f-3310-4d3e-825c-4b85347ad01e"
Jul 17 17:56:28.466536 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:28.466322    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz5w2"
Jul 17 17:56:28.466536 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:28.466401    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz5w2" podUID="d66f36e8-45f4-457e-b26e-44455cc4a850"
Jul 17 17:56:30.110501 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:30.110462    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6deaf47f-3310-4d3e-825c-4b85347ad01e-metrics-certs\") pod \"network-metrics-daemon-mxdhr\" (UID: \"6deaf47f-3310-4d3e-825c-4b85347ad01e\") " pod="openshift-multus/network-metrics-daemon-mxdhr"
Jul 17 17:56:30.110883 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:30.110648    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 17:56:30.110883 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:30.110724    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6deaf47f-3310-4d3e-825c-4b85347ad01e-metrics-certs podName:6deaf47f-3310-4d3e-825c-4b85347ad01e nodeName:}" failed. No retries permitted until 2026-07-17 17:56:46.110706864 +0000 UTC m=+33.335936150 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6deaf47f-3310-4d3e-825c-4b85347ad01e-metrics-certs") pod "network-metrics-daemon-mxdhr" (UID: "6deaf47f-3310-4d3e-825c-4b85347ad01e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 17:56:30.210842 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:30.210808    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7403c99b-bdb6-4595-916c-b4b8d138f4d0-original-pull-secret\") pod \"global-pull-secret-syncer-ldrq9\" (UID: \"7403c99b-bdb6-4595-916c-b4b8d138f4d0\") " pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:56:30.211064 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:30.210878    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhhsg\" (UniqueName: \"kubernetes.io/projected/d66f36e8-45f4-457e-b26e-44455cc4a850-kube-api-access-fhhsg\") pod \"network-check-target-sz5w2\" (UID: \"d66f36e8-45f4-457e-b26e-44455cc4a850\") " pod="openshift-network-diagnostics/network-check-target-sz5w2"
Jul 17 17:56:30.211064 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:30.211021    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 17:56:30.211064 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:30.211036    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 17:56:30.211064 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:30.211052    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 17:56:30.211064 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:30.211062    2572 projected.go:196] Error preparing data for projected volume kube-api-access-fhhsg for pod openshift-network-diagnostics/network-check-target-sz5w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 17:56:30.211264 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:30.211101    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7403c99b-bdb6-4595-916c-b4b8d138f4d0-original-pull-secret podName:7403c99b-bdb6-4595-916c-b4b8d138f4d0 nodeName:}" failed. No retries permitted until 2026-07-17 17:56:46.211079972 +0000 UTC m=+33.436309260 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7403c99b-bdb6-4595-916c-b4b8d138f4d0-original-pull-secret") pod "global-pull-secret-syncer-ldrq9" (UID: "7403c99b-bdb6-4595-916c-b4b8d138f4d0") : object "kube-system"/"original-pull-secret" not registered
Jul 17 17:56:30.211264 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:30.211121    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d66f36e8-45f4-457e-b26e-44455cc4a850-kube-api-access-fhhsg podName:d66f36e8-45f4-457e-b26e-44455cc4a850 nodeName:}" failed. No retries permitted until 2026-07-17 17:56:46.211111594 +0000 UTC m=+33.436340883 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fhhsg" (UniqueName: "kubernetes.io/projected/d66f36e8-45f4-457e-b26e-44455cc4a850-kube-api-access-fhhsg") pod "network-check-target-sz5w2" (UID: "d66f36e8-45f4-457e-b26e-44455cc4a850") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 17:56:30.465287 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:30.465257    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz5w2"
Jul 17 17:56:30.465482 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:30.465251    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxdhr"
Jul 17 17:56:30.465482 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:30.465381    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz5w2" podUID="d66f36e8-45f4-457e-b26e-44455cc4a850"
Jul 17 17:56:30.465482 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:30.465268    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:56:30.465482 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:30.465468    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxdhr" podUID="6deaf47f-3310-4d3e-825c-4b85347ad01e"
Jul 17 17:56:30.465647 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:30.465510    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldrq9" podUID="7403c99b-bdb6-4595-916c-b4b8d138f4d0"
Jul 17 17:56:32.465362 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:32.465328    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:56:32.465362 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:32.465360    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz5w2"
Jul 17 17:56:32.465857 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:32.465343    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxdhr"
Jul 17 17:56:32.465857 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:32.465531    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz5w2" podUID="d66f36e8-45f4-457e-b26e-44455cc4a850"
Jul 17 17:56:32.465857 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:32.465451    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldrq9" podUID="7403c99b-bdb6-4595-916c-b4b8d138f4d0"
Jul 17 17:56:32.465857 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:32.465593    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxdhr" podUID="6deaf47f-3310-4d3e-825c-4b85347ad01e"
Jul 17 17:56:34.465401 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:34.465368    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxdhr"
Jul 17 17:56:34.465401 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:34.465410    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz5w2"
Jul 17 17:56:34.465964 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:34.465379    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:56:34.465964 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:34.465510    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxdhr" podUID="6deaf47f-3310-4d3e-825c-4b85347ad01e"
Jul 17 17:56:34.465964 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:34.465579    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldrq9" podUID="7403c99b-bdb6-4595-916c-b4b8d138f4d0"
Jul 17 17:56:34.465964 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:34.465679    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz5w2" podUID="d66f36e8-45f4-457e-b26e-44455cc4a850"
Jul 17 17:56:36.465685 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:36.465408    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:56:36.466249 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:36.465457    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxdhr"
Jul 17 17:56:36.466249 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:36.465745    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldrq9" podUID="7403c99b-bdb6-4595-916c-b4b8d138f4d0"
Jul 17 17:56:36.466249 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:36.465862    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxdhr" podUID="6deaf47f-3310-4d3e-825c-4b85347ad01e"
Jul 17 17:56:36.466249 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:36.465458    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz5w2"
Jul 17 17:56:36.466249 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:36.465967    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz5w2" podUID="d66f36e8-45f4-457e-b26e-44455cc4a850"
Jul 17 17:56:36.530732 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:36.530643    2572 generic.go:356] "Generic (PLEG): container finished" podID="20554dd5d0f2d6efd09ccfb94678d149" containerID="ea854866967e72102ffc637abdf05a9da2adda1e0826bda22e7c505dd8dec12e" exitCode=0
Jul 17 17:56:36.530732 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:36.530724    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-226.ec2.internal" event={"ID":"20554dd5d0f2d6efd09ccfb94678d149","Type":"ContainerDied","Data":"ea854866967e72102ffc637abdf05a9da2adda1e0826bda22e7c505dd8dec12e"}
Jul 17 17:56:36.531933 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:36.531910    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-b4t9q" event={"ID":"1e914c47-eaed-4241-b5f8-9c3d2f0a3be8","Type":"ContainerStarted","Data":"758f3f458c54c9e0e3183d83df9a58c18b14c1eb49a4e00539e9986bff1f2e8e"}
Jul 17 17:56:36.533385 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:36.533360    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g8zxq" event={"ID":"91a901b1-0ccc-4ea8-92cb-2c3fd93e6430","Type":"ContainerStarted","Data":"5705cb7b9a2c29911c1ef67065969b6c296746d739d454bc73342b692cee5bda"}
Jul 17 17:56:36.534664 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:36.534646    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-226.ec2.internal" event={"ID":"8bfbaed7d32901437b702fd04e14392e","Type":"ContainerStarted","Data":"c42715ebabbfa551f7553ff9e205c412e52e6fd2ab7f2b0cc3470584cbad648a"}
Jul 17 17:56:36.535865 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:36.535848    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rnhqt" event={"ID":"cd3b555f-c848-4492-a111-1a007f3d469d","Type":"ContainerStarted","Data":"8fcff32ff8916db52a6585e8a471c119b1a126240d181005d7c13874bebc1379"}
Jul 17 17:56:36.537230 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:36.537207    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-269bj" event={"ID":"ab2ebce0-5586-41be-8698-849ad8481836","Type":"ContainerStarted","Data":"bb30ab1ac47624632448860c9b50a0d870b2709ba8c6e268dc9f1f290948792d"}
Jul 17 17:56:36.538544 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:36.538526    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qm4d4" event={"ID":"f91fbd01-c503-41b5-8fc9-84e1e4f0b605","Type":"ContainerStarted","Data":"edaf4299ebd53b29daec64f556e7e35456c2d7ebf6f305e3934f410307a19c3a"}
Jul 17 17:56:36.539814 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:36.539788    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h9rs6" event={"ID":"6bb964cd-6c2c-4997-b5c5-558b890f6277","Type":"ContainerStarted","Data":"0d5cd798fb9fa04b60e772eb51692888021b7394a9bf8bcbd2880e9f5799f326"}
Jul 17 17:56:36.541187 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:36.541165    2572 generic.go:356] "Generic (PLEG): container finished" podID="d3a85848-4964-41eb-ae52-6fbca6f695fb" containerID="2be8e50c446f9024abeef8a73be0f931ba38f7da3d163f0a35d1afba5d933dd9" exitCode=0
Jul 17 17:56:36.541281 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:36.541247    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qsb98" event={"ID":"d3a85848-4964-41eb-ae52-6fbca6f695fb","Type":"ContainerDied","Data":"2be8e50c446f9024abeef8a73be0f931ba38f7da3d163f0a35d1afba5d933dd9"}
Jul 17 17:56:36.544046 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:36.544030    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5mdx_2e3bd369-576e-4df1-8a76-aebd537cde58/ovn-acl-logging/0.log"
Jul 17 17:56:36.544382 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:36.544365    2572 generic.go:356] "Generic (PLEG): container finished" podID="2e3bd369-576e-4df1-8a76-aebd537cde58" containerID="51c148d22fe184548f9c9a285a3319e92fc531e9a0e53816cdbb756c8b5476e9" exitCode=1
Jul 17 17:56:36.544440 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:36.544392    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx" event={"ID":"2e3bd369-576e-4df1-8a76-aebd537cde58","Type":"ContainerStarted","Data":"a37185af8493fd192c60d121415f4d5787cef8a375cbf566b2113d6ec716c154"}
Jul 17 17:56:36.544440 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:36.544436    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx" event={"ID":"2e3bd369-576e-4df1-8a76-aebd537cde58","Type":"ContainerStarted","Data":"0760be37df489aa26dcb62dbf966a7661ae7dd062c163938810114bbd7e2efd7"}
Jul 17 17:56:36.544512 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:36.544464    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx" event={"ID":"2e3bd369-576e-4df1-8a76-aebd537cde58","Type":"ContainerStarted","Data":"112a93a0f5ef09b76bb252338e26229ea333f1ba88cbe1cf4e03edffa3d3df6c"}
Jul 17 17:56:36.544512 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:36.544496    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx" event={"ID":"2e3bd369-576e-4df1-8a76-aebd537cde58","Type":"ContainerStarted","Data":"2f0ee9b00eaf25b9b1d54100b523ecfa533928199e36c9e375fc64c77b427236"}
Jul 17 17:56:36.544573 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:36.544521    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx" event={"ID":"2e3bd369-576e-4df1-8a76-aebd537cde58","Type":"ContainerDied","Data":"51c148d22fe184548f9c9a285a3319e92fc531e9a0e53816cdbb756c8b5476e9"}
Jul 17 17:56:36.544573 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:36.544550    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx" event={"ID":"2e3bd369-576e-4df1-8a76-aebd537cde58","Type":"ContainerStarted","Data":"938e265ab3192b17c05cf7263af6e2481df9af569e7d3feb074a95f98be3c824"}
Jul 17 17:56:36.565498 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:36.565456    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qm4d4" podStartSLOduration=3.230909172 podStartE2EDuration="23.565441724s" totalImagesPullingTime="20.334532552s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:56:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:56:36.565218444 +0000 UTC m=+23.790447763" watchObservedRunningTime="2026-07-17 17:56:36.565441724 +0000 UTC m=+23.790671031"
Jul 17 17:56:36.565631 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:36.565550    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-b4t9q" podStartSLOduration=2.93272174 podStartE2EDuration="23.565544197s" totalImagesPullingTime="20.632822457s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:56:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:56:36.54892433 +0000 UTC m=+23.774153639" watchObservedRunningTime="2026-07-17 17:56:36.565544197 +0000 UTC m=+23.790773551"
Jul 17 17:56:36.584591 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:36.584545    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rnhqt" podStartSLOduration=10.326080229 podStartE2EDuration="22.584531383s" totalImagesPullingTime="12.258451154s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:56:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:56:36.584284875 +0000 UTC m=+23.809514183" watchObservedRunningTime="2026-07-17 17:56:36.584531383 +0000 UTC m=+23.809760691"
Jul 17 17:56:36.633748 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:36.633693    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-g8zxq" podStartSLOduration=3.253098195 podStartE2EDuration="23.633678506s" totalImagesPullingTime="20.380580311s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:56:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:56:36.633411073 +0000 UTC m=+23.858640382" watchObservedRunningTime="2026-07-17 17:56:36.633678506 +0000 UTC m=+23.858907814"
Jul 17 17:56:36.649208 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:36.649156    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-h9rs6" podStartSLOduration=3.2899777869999998 podStartE2EDuration="23.649142487s" totalImagesPullingTime="20.3591647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:56:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:56:36.648655199 +0000 UTC m=+23.873884507" watchObservedRunningTime="2026-07-17 17:56:36.649142487 +0000 UTC m=+23.874371795"
Jul 17 17:56:37.065155 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:37.064943    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-h9rs6"
Jul 17 17:56:37.065518 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:37.065501    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-h9rs6"
Jul 17 17:56:37.082278 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:37.082231    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-226.ec2.internal" podStartSLOduration=23.082213562 podStartE2EDuration="23.082213562s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:56:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:56:36.662257675 +0000 UTC m=+23.887486984" watchObservedRunningTime="2026-07-17 17:56:37.082213562 +0000 UTC m=+24.307442853"
Jul 17 17:56:37.548522 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:37.548489    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z7vks" event={"ID":"2413fc9d-9cab-44ea-81d6-e40c84c215a9","Type":"ContainerStarted","Data":"89699977d61b2e56b49d7118ebbe283d3b8d5d2434bccc46ea1665fe34b056db"}
Jul 17 17:56:37.549566 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:37.549538    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-h9rs6"
Jul 17 17:56:37.550387 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:37.550180    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-h9rs6"
Jul 17 17:56:37.564172 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:37.564120    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z7vks" podStartSLOduration=4.198726543 podStartE2EDuration="24.564098152s" totalImagesPullingTime="20.365371609s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:56:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:56:37.56403809 +0000 UTC m=+24.789267397" watchObservedRunningTime="2026-07-17 17:56:37.564098152 +0000 UTC m=+24.789327459"
Jul 17 17:56:37.708571 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:37.708544    2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 17 17:56:38.418911 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:38.418792    2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-17T17:56:37.708563421Z","UUID":"415d682d-f93b-4789-90ea-16ac2e02d38b","Handler":null,"Name":"","Endpoint":""}
Jul 17 17:56:38.420863 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:38.420839    2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 17 17:56:38.421023 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:38.420884    2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 17 17:56:38.465328 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:38.465302    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:56:38.465455 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:38.465429    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldrq9" podUID="7403c99b-bdb6-4595-916c-b4b8d138f4d0"
Jul 17 17:56:38.465529 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:38.465514    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxdhr"
Jul 17 17:56:38.465633 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:38.465610    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxdhr" podUID="6deaf47f-3310-4d3e-825c-4b85347ad01e"
Jul 17 17:56:38.465694 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:38.465669    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz5w2"
Jul 17 17:56:38.465755 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:38.465733    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz5w2" podUID="d66f36e8-45f4-457e-b26e-44455cc4a850"
Jul 17 17:56:38.553898 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:38.553849    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-269bj" event={"ID":"ab2ebce0-5586-41be-8698-849ad8481836","Type":"ContainerStarted","Data":"2c662d9c208564b9afe25330a66c4d4aa7084b3c2d807b8cfa589b3974329e4c"}
Jul 17 17:56:38.557860 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:38.557833    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5mdx_2e3bd369-576e-4df1-8a76-aebd537cde58/ovn-acl-logging/0.log"
Jul 17 17:56:38.558241 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:38.558213    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx" event={"ID":"2e3bd369-576e-4df1-8a76-aebd537cde58","Type":"ContainerStarted","Data":"deda037e9201a8810e065d83cc5da8b52e6c7a99cff4d574814bb9994e7dade8"}
Jul 17 17:56:38.560200 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:38.560172    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-226.ec2.internal" event={"ID":"20554dd5d0f2d6efd09ccfb94678d149","Type":"ContainerStarted","Data":"3ad70baf71ac144886e7c29e102832e2018a5931eff645bdba080dd1ef1ea7cd"}
Jul 17 17:56:38.579010 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:38.578932    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-226.ec2.internal" podStartSLOduration=25.578914487 podStartE2EDuration="25.578914487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:56:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:56:38.57848795 +0000 UTC m=+25.803717258" watchObservedRunningTime="2026-07-17 17:56:38.578914487 +0000 UTC m=+25.804143797"
Jul 17 17:56:39.564472 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:39.564432    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-269bj" event={"ID":"ab2ebce0-5586-41be-8698-849ad8481836","Type":"ContainerStarted","Data":"07108c9fdda326df27356f8155940355bccaf51e337277d1598d1d4943212169"}
Jul 17 17:56:39.583963 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:39.583901    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-269bj" podStartSLOduration=3.536970406 podStartE2EDuration="26.583878873s" totalImagesPullingTime="23.046908467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:56:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:56:39.583174614 +0000 UTC m=+26.808403923" watchObservedRunningTime="2026-07-17 17:56:39.583878873 +0000 UTC m=+26.809108179"
Jul 17 17:56:40.465522 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:40.465492    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:56:40.465685 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:40.465495    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz5w2"
Jul 17 17:56:40.465685 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:40.465588    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldrq9" podUID="7403c99b-bdb6-4595-916c-b4b8d138f4d0"
Jul 17 17:56:40.465685 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:40.465613    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxdhr"
Jul 17 17:56:40.465778 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:40.465693    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz5w2" podUID="d66f36e8-45f4-457e-b26e-44455cc4a850"
Jul 17 17:56:40.465778 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:40.465751    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxdhr" podUID="6deaf47f-3310-4d3e-825c-4b85347ad01e"
Jul 17 17:56:42.465802 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:42.465600    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz5w2"
Jul 17 17:56:42.466549 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:42.465613    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:56:42.466549 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:42.465899    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz5w2" podUID="d66f36e8-45f4-457e-b26e-44455cc4a850"
Jul 17 17:56:42.466549 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:42.465977    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldrq9" podUID="7403c99b-bdb6-4595-916c-b4b8d138f4d0"
Jul 17 17:56:42.466549 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:42.465651    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxdhr"
Jul 17 17:56:42.466549 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:42.466084    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxdhr" podUID="6deaf47f-3310-4d3e-825c-4b85347ad01e"
Jul 17 17:56:42.575557 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:42.575316    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qsb98" event={"ID":"d3a85848-4964-41eb-ae52-6fbca6f695fb","Type":"ContainerStarted","Data":"6c9c9ff4a684446a4e8914530a16ea23b6aba78e09ade277720327feaa337478"}
Jul 17 17:56:42.578757 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:42.578731    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5mdx_2e3bd369-576e-4df1-8a76-aebd537cde58/ovn-acl-logging/0.log"
Jul 17 17:56:42.579193 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:42.579163    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx" event={"ID":"2e3bd369-576e-4df1-8a76-aebd537cde58","Type":"ContainerStarted","Data":"025ce4b8acb5defde293204e39c930c07671013c9a89a0f49e320722b794f2d2"}
Jul 17 17:56:42.579518 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:42.579493    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:42.579641 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:42.579571    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:42.579641 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:42.579624    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:42.579731 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:42.579623    2572 scope.go:117] "RemoveContainer" containerID="51c148d22fe184548f9c9a285a3319e92fc531e9a0e53816cdbb756c8b5476e9"
Jul 17 17:56:42.596560 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:42.596384    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:42.596560 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:42.596535    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:56:43.583277 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:43.583244    2572 generic.go:356] "Generic (PLEG): container finished" podID="d3a85848-4964-41eb-ae52-6fbca6f695fb" containerID="6c9c9ff4a684446a4e8914530a16ea23b6aba78e09ade277720327feaa337478" exitCode=0
Jul 17 17:56:43.583754 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:43.583336    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qsb98" event={"ID":"d3a85848-4964-41eb-ae52-6fbca6f695fb","Type":"ContainerDied","Data":"6c9c9ff4a684446a4e8914530a16ea23b6aba78e09ade277720327feaa337478"}
Jul 17 17:56:43.587504 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:43.587485    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5mdx_2e3bd369-576e-4df1-8a76-aebd537cde58/ovn-acl-logging/0.log"
Jul 17 17:56:43.587826 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:43.587799    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx" event={"ID":"2e3bd369-576e-4df1-8a76-aebd537cde58","Type":"ContainerStarted","Data":"51c8e47a5bdf9a4d22fd9718ed22d5a83801e5ed72b7a2089280b678483de331"}
Jul 17 17:56:43.648830 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:43.648763    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx" podStartSLOduration=10.217776086 podStartE2EDuration="30.648746159s" totalImagesPullingTime="20.430970073s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:56:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:56:43.648436465 +0000 UTC m=+30.873665774" watchObservedRunningTime="2026-07-17 17:56:43.648746159 +0000 UTC m=+30.873975506"
Jul 17 17:56:44.253561 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:44.253518    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ldrq9"]
Jul 17 17:56:44.253753 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:44.253647    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:56:44.253816 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:44.253764    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldrq9" podUID="7403c99b-bdb6-4595-916c-b4b8d138f4d0"
Jul 17 17:56:44.256480 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:44.256450    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sz5w2"]
Jul 17 17:56:44.256633 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:44.256561    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz5w2"
Jul 17 17:56:44.256701 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:44.256647    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz5w2" podUID="d66f36e8-45f4-457e-b26e-44455cc4a850"
Jul 17 17:56:44.257163 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:44.257142    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mxdhr"]
Jul 17 17:56:44.257284 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:44.257235    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxdhr"
Jul 17 17:56:44.257343 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:44.257328    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxdhr" podUID="6deaf47f-3310-4d3e-825c-4b85347ad01e"
Jul 17 17:56:45.465621 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:45.465586    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxdhr"
Jul 17 17:56:45.466049 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:45.465706    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxdhr" podUID="6deaf47f-3310-4d3e-825c-4b85347ad01e"
Jul 17 17:56:45.594198 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:45.594163    2572 generic.go:356] "Generic (PLEG): container finished" podID="d3a85848-4964-41eb-ae52-6fbca6f695fb" containerID="824b9ff63c32b53172d96ce85667b1b97bcab5b3d412987f6bf9a57941ffbe93" exitCode=0
Jul 17 17:56:45.594377 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:45.594228    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qsb98" event={"ID":"d3a85848-4964-41eb-ae52-6fbca6f695fb","Type":"ContainerDied","Data":"824b9ff63c32b53172d96ce85667b1b97bcab5b3d412987f6bf9a57941ffbe93"}
Jul 17 17:56:46.123416 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:46.123381    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6deaf47f-3310-4d3e-825c-4b85347ad01e-metrics-certs\") pod \"network-metrics-daemon-mxdhr\" (UID: \"6deaf47f-3310-4d3e-825c-4b85347ad01e\") " pod="openshift-multus/network-metrics-daemon-mxdhr"
Jul 17 17:56:46.123592 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:46.123521    2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 17:56:46.123592 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:46.123586    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6deaf47f-3310-4d3e-825c-4b85347ad01e-metrics-certs podName:6deaf47f-3310-4d3e-825c-4b85347ad01e nodeName:}" failed. No retries permitted until 2026-07-17 17:57:18.123567075 +0000 UTC m=+65.348796362 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6deaf47f-3310-4d3e-825c-4b85347ad01e-metrics-certs") pod "network-metrics-daemon-mxdhr" (UID: "6deaf47f-3310-4d3e-825c-4b85347ad01e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 17 17:56:46.224693 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:46.224654    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7403c99b-bdb6-4595-916c-b4b8d138f4d0-original-pull-secret\") pod \"global-pull-secret-syncer-ldrq9\" (UID: \"7403c99b-bdb6-4595-916c-b4b8d138f4d0\") " pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:56:46.224927 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:46.224723    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhhsg\" (UniqueName: \"kubernetes.io/projected/d66f36e8-45f4-457e-b26e-44455cc4a850-kube-api-access-fhhsg\") pod \"network-check-target-sz5w2\" (UID: \"d66f36e8-45f4-457e-b26e-44455cc4a850\") " pod="openshift-network-diagnostics/network-check-target-sz5w2"
Jul 17 17:56:46.224927 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:46.224811    2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 17 17:56:46.224927 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:46.224876    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 17 17:56:46.224927 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:46.224900    2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 17 17:56:46.224927 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:46.224915    2572 projected.go:196] Error preparing data for projected volume kube-api-access-fhhsg for pod openshift-network-diagnostics/network-check-target-sz5w2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 17:56:46.225319 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:46.224903    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7403c99b-bdb6-4595-916c-b4b8d138f4d0-original-pull-secret podName:7403c99b-bdb6-4595-916c-b4b8d138f4d0 nodeName:}" failed. No retries permitted until 2026-07-17 17:57:18.224876471 +0000 UTC m=+65.450105760 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7403c99b-bdb6-4595-916c-b4b8d138f4d0-original-pull-secret") pod "global-pull-secret-syncer-ldrq9" (UID: "7403c99b-bdb6-4595-916c-b4b8d138f4d0") : object "kube-system"/"original-pull-secret" not registered
Jul 17 17:56:46.225319 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:46.224987    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d66f36e8-45f4-457e-b26e-44455cc4a850-kube-api-access-fhhsg podName:d66f36e8-45f4-457e-b26e-44455cc4a850 nodeName:}" failed. No retries permitted until 2026-07-17 17:57:18.224963513 +0000 UTC m=+65.450192805 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fhhsg" (UniqueName: "kubernetes.io/projected/d66f36e8-45f4-457e-b26e-44455cc4a850-kube-api-access-fhhsg") pod "network-check-target-sz5w2" (UID: "d66f36e8-45f4-457e-b26e-44455cc4a850") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 17 17:56:46.466201 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:46.466166    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:56:46.466201 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:46.466209    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz5w2"
Jul 17 17:56:46.466681 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:46.466285    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldrq9" podUID="7403c99b-bdb6-4595-916c-b4b8d138f4d0"
Jul 17 17:56:46.466681 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:46.466415    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz5w2" podUID="d66f36e8-45f4-457e-b26e-44455cc4a850"
Jul 17 17:56:47.465871 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:47.465690    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxdhr"
Jul 17 17:56:47.466072 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:47.465967    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mxdhr" podUID="6deaf47f-3310-4d3e-825c-4b85347ad01e"
Jul 17 17:56:47.601481 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:47.601444    2572 generic.go:356] "Generic (PLEG): container finished" podID="d3a85848-4964-41eb-ae52-6fbca6f695fb" containerID="05af74a55acf37b42836e931fb9afaff2d92086a7cd7d7e9b5e93a9e97f9d43e" exitCode=0
Jul 17 17:56:47.602017 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:47.601505    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qsb98" event={"ID":"d3a85848-4964-41eb-ae52-6fbca6f695fb","Type":"ContainerDied","Data":"05af74a55acf37b42836e931fb9afaff2d92086a7cd7d7e9b5e93a9e97f9d43e"}
Jul 17 17:56:48.465713 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.465676    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:56:48.465910 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.465676    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz5w2"
Jul 17 17:56:48.465910 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:48.465798    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ldrq9" podUID="7403c99b-bdb6-4595-916c-b4b8d138f4d0"
Jul 17 17:56:48.465910 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:48.465829    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-sz5w2" podUID="d66f36e8-45f4-457e-b26e-44455cc4a850"
Jul 17 17:56:48.534718 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.534692    2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-226.ec2.internal" event="NodeReady"
Jul 17 17:56:48.534870 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.534836    2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 17 17:56:48.574134 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.574096    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-655959c9dc-dc87g"]
Jul 17 17:56:48.602888 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.602817    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-724gg"]
Jul 17 17:56:48.603364 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.603353    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:56:48.606629 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.606540    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-c22cb\""
Jul 17 17:56:48.606629 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.606550    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 17 17:56:48.606629 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.606565    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 17 17:56:48.606903 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.606838    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 17 17:56:48.613063 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.612863    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 17 17:56:48.618485 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.618463    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-555d9d7885-vdxt4"]
Jul 17 17:56:48.618638 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.618598    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-724gg"
Jul 17 17:56:48.621532 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.621508    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 17 17:56:48.621676 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.621545    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-s5mz4\""
Jul 17 17:56:48.621676 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.621603    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 17 17:56:48.621676 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.621641    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 17 17:56:48.621816 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.621734    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 17 17:56:48.642614 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.642576    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-66554f4bf4-w2s2r"]
Jul 17 17:56:48.642789 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.642730    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-vdxt4"
Jul 17 17:56:48.645527 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.645442    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 17 17:56:48.645527 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.645481    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 17 17:56:48.646050 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.646029    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 17 17:56:48.646050 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.646044    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 17 17:56:48.646500 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.645486    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rgrvs\""
Jul 17 17:56:48.652272 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.652247    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 17 17:56:48.662626 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.662599    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-4szzt"]
Jul 17 17:56:48.662754 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.662730    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-66554f4bf4-w2s2r"
Jul 17 17:56:48.665609 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.665587    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 17 17:56:48.665723 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.665594    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 17 17:56:48.666205 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.666188    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 17 17:56:48.666441 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.666418    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-pndnk\""
Jul 17 17:56:48.666536 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.666453    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 17 17:56:48.667179 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.667160    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 17 17:56:48.667506 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.667483    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 17 17:56:48.682212 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.682149    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-tp9qm"]
Jul 17 17:56:48.682359 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.682260    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-4szzt"
Jul 17 17:56:48.684874 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.684850    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 17 17:56:48.685028 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.684992    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-tft4b\""
Jul 17 17:56:48.685107 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.685036    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 17 17:56:48.694832 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.694796    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j829s"]
Jul 17 17:56:48.694968 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.694944    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-tp9qm"
Jul 17 17:56:48.698011 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.697969    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 17 17:56:48.698011 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.697979    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 17 17:56:48.698210 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.698024    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 17 17:56:48.698210 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.697993    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 17 17:56:48.698307 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.698293    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-68z5t\""
Jul 17 17:56:48.703618 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.703593    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 17 17:56:48.717261 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.717153    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-r5w6h"]
Jul 17 17:56:48.717479 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.717280    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j829s"
Jul 17 17:56:48.720233 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.720186    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 17 17:56:48.720376 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.720177    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 17 17:56:48.720591 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.720568    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5kn8q\""
Jul 17 17:56:48.720913 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.720892    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 17 17:56:48.737760 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.737728    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-724gg"]
Jul 17 17:56:48.737925 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.737771    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j829s"]
Jul 17 17:56:48.737925 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.737874    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-655959c9dc-dc87g"]
Jul 17 17:56:48.737925 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.737908    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-tp9qm"]
Jul 17 17:56:48.737925 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.737873    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r5w6h"
Jul 17 17:56:48.738141 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.737929    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-vdxt4"]
Jul 17 17:56:48.738212 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.738195    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-4szzt"]
Jul 17 17:56:48.738266 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.738232    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r5w6h"]
Jul 17 17:56:48.738266 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.738259    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-66554f4bf4-w2s2r"]
Jul 17 17:56:48.738348 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.738292    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rlgvg"]
Jul 17 17:56:48.740605 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.740584    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 17 17:56:48.740855 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.740839    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s6gdc\""
Jul 17 17:56:48.740957 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.740888    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 17 17:56:48.743710 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.743691    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/61298aa5-416d-4864-a479-762a86580bc9-registry-certificates\") pod \"image-registry-655959c9dc-dc87g\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") " pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:56:48.743818 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.743719    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af512024-2ccd-4dfd-8a9d-c5b12ab13655-service-ca-bundle\") pod \"insights-operator-555d9d7885-vdxt4\" (UID: \"af512024-2ccd-4dfd-8a9d-c5b12ab13655\") " pod="openshift-insights/insights-operator-555d9d7885-vdxt4"
Jul 17 17:56:48.743818 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.743751    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/61298aa5-416d-4864-a479-762a86580bc9-image-registry-private-configuration\") pod \"image-registry-655959c9dc-dc87g\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") " pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:56:48.743818 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.743806    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlpzq\" (UniqueName: \"kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-kube-api-access-nlpzq\") pod \"image-registry-655959c9dc-dc87g\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") " pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:56:48.743970 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.743842    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xvwc\" (UniqueName: \"kubernetes.io/projected/af512024-2ccd-4dfd-8a9d-c5b12ab13655-kube-api-access-8xvwc\") pod \"insights-operator-555d9d7885-vdxt4\" (UID: \"af512024-2ccd-4dfd-8a9d-c5b12ab13655\") " pod="openshift-insights/insights-operator-555d9d7885-vdxt4"
Jul 17 17:56:48.743970 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.743905    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61298aa5-416d-4864-a479-762a86580bc9-trusted-ca\") pod \"image-registry-655959c9dc-dc87g\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") " pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:56:48.743970 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.743931    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/61298aa5-416d-4864-a479-762a86580bc9-installation-pull-secrets\") pod \"image-registry-655959c9dc-dc87g\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") " pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:56:48.744118 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.743978    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-registry-tls\") pod \"image-registry-655959c9dc-dc87g\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") " pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:56:48.744118 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.744021    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-bound-sa-token\") pod \"image-registry-655959c9dc-dc87g\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") " pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:56:48.744118 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.744045    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/af512024-2ccd-4dfd-8a9d-c5b12ab13655-serving-cert\") pod \"insights-operator-555d9d7885-vdxt4\" (UID: \"af512024-2ccd-4dfd-8a9d-c5b12ab13655\") " pod="openshift-insights/insights-operator-555d9d7885-vdxt4"
Jul 17 17:56:48.744118 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.744067    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/64492602-a837-4470-a8e1-0dba2157232d-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-724gg\" (UID: \"64492602-a837-4470-a8e1-0dba2157232d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-724gg"
Jul 17 17:56:48.744118 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.744092    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/64492602-a837-4470-a8e1-0dba2157232d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-724gg\" (UID: \"64492602-a837-4470-a8e1-0dba2157232d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-724gg"
Jul 17 17:56:48.744294 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.744174    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af512024-2ccd-4dfd-8a9d-c5b12ab13655-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-vdxt4\" (UID: \"af512024-2ccd-4dfd-8a9d-c5b12ab13655\") " pod="openshift-insights/insights-operator-555d9d7885-vdxt4"
Jul 17 17:56:48.744294 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.744212    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af512024-2ccd-4dfd-8a9d-c5b12ab13655-tmp\") pod \"insights-operator-555d9d7885-vdxt4\" (UID: \"af512024-2ccd-4dfd-8a9d-c5b12ab13655\") " pod="openshift-insights/insights-operator-555d9d7885-vdxt4"
Jul 17 17:56:48.744294 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.744246    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/af512024-2ccd-4dfd-8a9d-c5b12ab13655-snapshots\") pod \"insights-operator-555d9d7885-vdxt4\" (UID: \"af512024-2ccd-4dfd-8a9d-c5b12ab13655\") " pod="openshift-insights/insights-operator-555d9d7885-vdxt4"
Jul 17 17:56:48.744294 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.744277    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwrdn\" (UniqueName: \"kubernetes.io/projected/64492602-a837-4470-a8e1-0dba2157232d-kube-api-access-lwrdn\") pod \"cluster-monitoring-operator-76cf8966f8-724gg\" (UID: \"64492602-a837-4470-a8e1-0dba2157232d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-724gg"
Jul 17 17:56:48.744484 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.744318    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/61298aa5-416d-4864-a479-762a86580bc9-ca-trust-extracted\") pod \"image-registry-655959c9dc-dc87g\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") " pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:56:48.760833 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.760797    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rlgvg"]
Jul 17 17:56:48.760982 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.760913    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rlgvg"
Jul 17 17:56:48.764037 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.763866    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 17 17:56:48.764037 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.763885    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 17 17:56:48.764037 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.763895    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 17 17:56:48.764037 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.763968    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hnrcx\""
Jul 17 17:56:48.844788 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.844746    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gcjk\" (UniqueName: \"kubernetes.io/projected/3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69-kube-api-access-5gcjk\") pod \"cluster-samples-operator-79b7c55f87-j829s\" (UID: \"3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j829s"
Jul 17 17:56:48.844955 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.844808    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-j829s\" (UID: \"3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j829s"
Jul 17 17:56:48.844955 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.844869    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/61298aa5-416d-4864-a479-762a86580bc9-registry-certificates\") pod \"image-registry-655959c9dc-dc87g\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") " pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:56:48.844955 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.844904    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51fe56fe-81e6-4151-99cc-4bc2192ef182-config-volume\") pod \"dns-default-r5w6h\" (UID: \"51fe56fe-81e6-4151-99cc-4bc2192ef182\") " pod="openshift-dns/dns-default-r5w6h"
Jul 17 17:56:48.844955 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.844922    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51fe56fe-81e6-4151-99cc-4bc2192ef182-metrics-tls\") pod \"dns-default-r5w6h\" (UID: \"51fe56fe-81e6-4151-99cc-4bc2192ef182\") " pod="openshift-dns/dns-default-r5w6h"
Jul 17 17:56:48.844955 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.844942    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v5m4\" (UniqueName: \"kubernetes.io/projected/a940a062-485b-4183-91ea-b6c674362b0a-kube-api-access-7v5m4\") pod \"router-default-66554f4bf4-w2s2r\" (UID: \"a940a062-485b-4183-91ea-b6c674362b0a\") " pod="openshift-ingress/router-default-66554f4bf4-w2s2r"
Jul 17 17:56:48.845308 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.844961    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a940a062-485b-4183-91ea-b6c674362b0a-stats-auth\") pod \"router-default-66554f4bf4-w2s2r\" (UID: \"a940a062-485b-4183-91ea-b6c674362b0a\") " pod="openshift-ingress/router-default-66554f4bf4-w2s2r"
Jul 17 17:56:48.845308 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.844982    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/61298aa5-416d-4864-a479-762a86580bc9-image-registry-private-configuration\") pod \"image-registry-655959c9dc-dc87g\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") " pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:56:48.845308 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.845060    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlpzq\" (UniqueName: \"kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-kube-api-access-nlpzq\") pod \"image-registry-655959c9dc-dc87g\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") " pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:56:48.845308 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.845146    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xvwc\" (UniqueName: \"kubernetes.io/projected/af512024-2ccd-4dfd-8a9d-c5b12ab13655-kube-api-access-8xvwc\") pod \"insights-operator-555d9d7885-vdxt4\" (UID: \"af512024-2ccd-4dfd-8a9d-c5b12ab13655\") " pod="openshift-insights/insights-operator-555d9d7885-vdxt4"
Jul 17 17:56:48.845308 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.845181    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a940a062-485b-4183-91ea-b6c674362b0a-metrics-certs\") pod \"router-default-66554f4bf4-w2s2r\" (UID: \"a940a062-485b-4183-91ea-b6c674362b0a\") " pod="openshift-ingress/router-default-66554f4bf4-w2s2r"
Jul 17 17:56:48.845308 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.845198    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6c101a17-a051-4e9d-a9dd-f72c67ba2a8a-serving-cert\") pod \"console-operator-565b7b569d-tp9qm\" (UID: \"6c101a17-a051-4e9d-a9dd-f72c67ba2a8a\") " pod="openshift-console-operator/console-operator-565b7b569d-tp9qm"
Jul 17 17:56:48.845308 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.845302    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/61298aa5-416d-4864-a479-762a86580bc9-installation-pull-secrets\") pod \"image-registry-655959c9dc-dc87g\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") " pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:56:48.845595 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.845325    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhtrl\" (UniqueName: \"kubernetes.io/projected/6c101a17-a051-4e9d-a9dd-f72c67ba2a8a-kube-api-access-jhtrl\") pod \"console-operator-565b7b569d-tp9qm\" (UID: \"6c101a17-a051-4e9d-a9dd-f72c67ba2a8a\") " pod="openshift-console-operator/console-operator-565b7b569d-tp9qm"
Jul 17 17:56:48.845595 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.845347    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xxmr\" (UniqueName: \"kubernetes.io/projected/51fe56fe-81e6-4151-99cc-4bc2192ef182-kube-api-access-2xxmr\") pod \"dns-default-r5w6h\" (UID: \"51fe56fe-81e6-4151-99cc-4bc2192ef182\") " pod="openshift-dns/dns-default-r5w6h"
Jul 17 17:56:48.845595 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.845396    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/af512024-2ccd-4dfd-8a9d-c5b12ab13655-serving-cert\") pod \"insights-operator-555d9d7885-vdxt4\" (UID: \"af512024-2ccd-4dfd-8a9d-c5b12ab13655\") " pod="openshift-insights/insights-operator-555d9d7885-vdxt4"
Jul 17 17:56:48.845595 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.845449    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/64492602-a837-4470-a8e1-0dba2157232d-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-724gg\" (UID: \"64492602-a837-4470-a8e1-0dba2157232d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-724gg"
Jul 17 17:56:48.845595 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.845502    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/61298aa5-416d-4864-a479-762a86580bc9-registry-certificates\") pod \"image-registry-655959c9dc-dc87g\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") " pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:56:48.845739 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.845639    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af512024-2ccd-4dfd-8a9d-c5b12ab13655-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-vdxt4\" (UID: \"af512024-2ccd-4dfd-8a9d-c5b12ab13655\") " pod="openshift-insights/insights-operator-555d9d7885-vdxt4"
Jul 17 17:56:48.845739 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.845663    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af512024-2ccd-4dfd-8a9d-c5b12ab13655-tmp\") pod \"insights-operator-555d9d7885-vdxt4\" (UID: \"af512024-2ccd-4dfd-8a9d-c5b12ab13655\") " pod="openshift-insights/insights-operator-555d9d7885-vdxt4"
Jul 17 17:56:48.845739 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.845682    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/af512024-2ccd-4dfd-8a9d-c5b12ab13655-snapshots\") pod \"insights-operator-555d9d7885-vdxt4\" (UID: \"af512024-2ccd-4dfd-8a9d-c5b12ab13655\") " pod="openshift-insights/insights-operator-555d9d7885-vdxt4"
Jul 17 17:56:48.845739 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.845701    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwrdn\" (UniqueName: \"kubernetes.io/projected/64492602-a837-4470-a8e1-0dba2157232d-kube-api-access-lwrdn\") pod \"cluster-monitoring-operator-76cf8966f8-724gg\" (UID: \"64492602-a837-4470-a8e1-0dba2157232d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-724gg"
Jul 17 17:56:48.845739 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.845727    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qddb\" (UniqueName: \"kubernetes.io/projected/483a6489-148d-4543-8831-c7be5d84e40b-kube-api-access-6qddb\") pod \"volume-data-source-validator-78cf4c6f6-4szzt\" (UID: \"483a6489-148d-4543-8831-c7be5d84e40b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-4szzt"
Jul 17 17:56:48.845941 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.845754    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/61298aa5-416d-4864-a479-762a86580bc9-ca-trust-extracted\") pod \"image-registry-655959c9dc-dc87g\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") " pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:56:48.845941 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.845770    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a940a062-485b-4183-91ea-b6c674362b0a-default-certificate\") pod \"router-default-66554f4bf4-w2s2r\" (UID: \"a940a062-485b-4183-91ea-b6c674362b0a\") " pod="openshift-ingress/router-default-66554f4bf4-w2s2r"
Jul 17 17:56:48.845941 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.845787    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a940a062-485b-4183-91ea-b6c674362b0a-service-ca-bundle\") pod \"router-default-66554f4bf4-w2s2r\" (UID: \"a940a062-485b-4183-91ea-b6c674362b0a\") " pod="openshift-ingress/router-default-66554f4bf4-w2s2r"
Jul 17 17:56:48.845941 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.845813    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af512024-2ccd-4dfd-8a9d-c5b12ab13655-service-ca-bundle\") pod \"insights-operator-555d9d7885-vdxt4\" (UID: \"af512024-2ccd-4dfd-8a9d-c5b12ab13655\") " pod="openshift-insights/insights-operator-555d9d7885-vdxt4"
Jul 17 17:56:48.845941 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.845886    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61298aa5-416d-4864-a479-762a86580bc9-trusted-ca\") pod \"image-registry-655959c9dc-dc87g\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") " pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:56:48.845941 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.845911    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6c101a17-a051-4e9d-a9dd-f72c67ba2a8a-config\") pod \"console-operator-565b7b569d-tp9qm\" (UID: \"6c101a17-a051-4e9d-a9dd-f72c67ba2a8a\") " pod="openshift-console-operator/console-operator-565b7b569d-tp9qm"
Jul 17 17:56:48.845941 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.845934    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51fe56fe-81e6-4151-99cc-4bc2192ef182-tmp-dir\") pod \"dns-default-r5w6h\" (UID: \"51fe56fe-81e6-4151-99cc-4bc2192ef182\") " pod="openshift-dns/dns-default-r5w6h"
Jul 17 17:56:48.846239 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.845959    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-registry-tls\") pod \"image-registry-655959c9dc-dc87g\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") " pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:56:48.846239 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.845979    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c101a17-a051-4e9d-a9dd-f72c67ba2a8a-trusted-ca\") pod \"console-operator-565b7b569d-tp9qm\" (UID: \"6c101a17-a051-4e9d-a9dd-f72c67ba2a8a\") " pod="openshift-console-operator/console-operator-565b7b569d-tp9qm"
Jul 17 17:56:48.846239 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.846020    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-bound-sa-token\") pod \"image-registry-655959c9dc-dc87g\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") " pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:56:48.846239 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.846043    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/64492602-a837-4470-a8e1-0dba2157232d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-724gg\" (UID: \"64492602-a837-4470-a8e1-0dba2157232d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-724gg"
Jul 17 17:56:48.846239 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:48.846148    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 17:56:48.846239 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.846171    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/af512024-2ccd-4dfd-8a9d-c5b12ab13655-tmp\") pod \"insights-operator-555d9d7885-vdxt4\" (UID: \"af512024-2ccd-4dfd-8a9d-c5b12ab13655\") " pod="openshift-insights/insights-operator-555d9d7885-vdxt4"
Jul 17 17:56:48.846239 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:48.846210    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64492602-a837-4470-a8e1-0dba2157232d-cluster-monitoring-operator-tls podName:64492602-a837-4470-a8e1-0dba2157232d nodeName:}" failed. No retries permitted until 2026-07-17 17:56:49.346193724 +0000 UTC m=+36.571423010 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/64492602-a837-4470-a8e1-0dba2157232d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-724gg" (UID: "64492602-a837-4470-a8e1-0dba2157232d") : secret "cluster-monitoring-operator-tls" not found
Jul 17 17:56:48.846524 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.846325    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/64492602-a837-4470-a8e1-0dba2157232d-telemetry-config\") pod \"cluster-monitoring-operator-76cf8966f8-724gg\" (UID: \"64492602-a837-4470-a8e1-0dba2157232d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-724gg"
Jul 17 17:56:48.846524 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.846367    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/af512024-2ccd-4dfd-8a9d-c5b12ab13655-snapshots\") pod \"insights-operator-555d9d7885-vdxt4\" (UID: \"af512024-2ccd-4dfd-8a9d-c5b12ab13655\") " pod="openshift-insights/insights-operator-555d9d7885-vdxt4"
Jul 17 17:56:48.846608 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.846586    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/61298aa5-416d-4864-a479-762a86580bc9-ca-trust-extracted\") pod \"image-registry-655959c9dc-dc87g\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") " pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:56:48.846701 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:48.846685    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 17:56:48.846759 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:48.846702    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-655959c9dc-dc87g: secret "image-registry-tls" not found
Jul 17 17:56:48.846759 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:48.846753    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-registry-tls podName:61298aa5-416d-4864-a479-762a86580bc9 nodeName:}" failed. No retries permitted until 2026-07-17 17:56:49.346738381 +0000 UTC m=+36.571967681 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-registry-tls") pod "image-registry-655959c9dc-dc87g" (UID: "61298aa5-416d-4864-a479-762a86580bc9") : secret "image-registry-tls" not found
Jul 17 17:56:48.846911 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.846876    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af512024-2ccd-4dfd-8a9d-c5b12ab13655-service-ca-bundle\") pod \"insights-operator-555d9d7885-vdxt4\" (UID: \"af512024-2ccd-4dfd-8a9d-c5b12ab13655\") " pod="openshift-insights/insights-operator-555d9d7885-vdxt4"
Jul 17 17:56:48.847064 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.847043    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61298aa5-416d-4864-a479-762a86580bc9-trusted-ca\") pod \"image-registry-655959c9dc-dc87g\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") " pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:56:48.847631 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.847608    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/af512024-2ccd-4dfd-8a9d-c5b12ab13655-trusted-ca-bundle\") pod \"insights-operator-555d9d7885-vdxt4\" (UID: \"af512024-2ccd-4dfd-8a9d-c5b12ab13655\") " pod="openshift-insights/insights-operator-555d9d7885-vdxt4"
Jul 17 17:56:48.849515 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.849488    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/af512024-2ccd-4dfd-8a9d-c5b12ab13655-serving-cert\") pod \"insights-operator-555d9d7885-vdxt4\" (UID: \"af512024-2ccd-4dfd-8a9d-c5b12ab13655\") " pod="openshift-insights/insights-operator-555d9d7885-vdxt4"
Jul 17 17:56:48.849687 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.849660    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/61298aa5-416d-4864-a479-762a86580bc9-image-registry-private-configuration\") pod \"image-registry-655959c9dc-dc87g\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") " pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:56:48.849727 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.849660    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/61298aa5-416d-4864-a479-762a86580bc9-installation-pull-secrets\") pod \"image-registry-655959c9dc-dc87g\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") " pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:56:48.853176 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.853154    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlpzq\" (UniqueName: \"kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-kube-api-access-nlpzq\") pod \"image-registry-655959c9dc-dc87g\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") " pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:56:48.853367 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.853348    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xvwc\" (UniqueName: \"kubernetes.io/projected/af512024-2ccd-4dfd-8a9d-c5b12ab13655-kube-api-access-8xvwc\") pod \"insights-operator-555d9d7885-vdxt4\" (UID: \"af512024-2ccd-4dfd-8a9d-c5b12ab13655\") " pod="openshift-insights/insights-operator-555d9d7885-vdxt4"
Jul 17 17:56:48.856495 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.856473    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-bound-sa-token\") pod \"image-registry-655959c9dc-dc87g\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") " pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:56:48.857138 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.857119    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwrdn\" (UniqueName: \"kubernetes.io/projected/64492602-a837-4470-a8e1-0dba2157232d-kube-api-access-lwrdn\") pod \"cluster-monitoring-operator-76cf8966f8-724gg\" (UID: \"64492602-a837-4470-a8e1-0dba2157232d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-724gg"
Jul 17 17:56:48.946614 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.946576    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-j829s\" (UID: \"3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j829s"
Jul 17 17:56:48.946614 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.946614    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51fe56fe-81e6-4151-99cc-4bc2192ef182-config-volume\") pod \"dns-default-r5w6h\" (UID: \"51fe56fe-81e6-4151-99cc-4bc2192ef182\") " pod="openshift-dns/dns-default-r5w6h"
Jul 17 17:56:48.946844 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.946634    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51fe56fe-81e6-4151-99cc-4bc2192ef182-metrics-tls\") pod \"dns-default-r5w6h\" (UID: \"51fe56fe-81e6-4151-99cc-4bc2192ef182\") " pod="openshift-dns/dns-default-r5w6h"
Jul 17 17:56:48.946844 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:48.946814    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 17:56:48.946947 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:48.946885    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69-samples-operator-tls podName:3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69 nodeName:}" failed. No retries permitted until 2026-07-17 17:56:49.446868492 +0000 UTC m=+36.672097781 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-j829s" (UID: "3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69") : secret "samples-operator-tls" not found
Jul 17 17:56:48.946947 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:48.946898    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 17:56:48.946947 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.946924    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v5m4\" (UniqueName: \"kubernetes.io/projected/a940a062-485b-4183-91ea-b6c674362b0a-kube-api-access-7v5m4\") pod \"router-default-66554f4bf4-w2s2r\" (UID: \"a940a062-485b-4183-91ea-b6c674362b0a\") " pod="openshift-ingress/router-default-66554f4bf4-w2s2r"
Jul 17 17:56:48.947134 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.946959    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a940a062-485b-4183-91ea-b6c674362b0a-stats-auth\") pod \"router-default-66554f4bf4-w2s2r\" (UID: \"a940a062-485b-4183-91ea-b6c674362b0a\") " pod="openshift-ingress/router-default-66554f4bf4-w2s2r"
Jul 17 17:56:48.947134 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:48.946976    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51fe56fe-81e6-4151-99cc-4bc2192ef182-metrics-tls podName:51fe56fe-81e6-4151-99cc-4bc2192ef182 nodeName:}" failed. No retries permitted until 2026-07-17 17:56:49.44695655 +0000 UTC m=+36.672185841 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51fe56fe-81e6-4151-99cc-4bc2192ef182-metrics-tls") pod "dns-default-r5w6h" (UID: "51fe56fe-81e6-4151-99cc-4bc2192ef182") : secret "dns-default-metrics-tls" not found
Jul 17 17:56:48.947134 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.947046    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a940a062-485b-4183-91ea-b6c674362b0a-metrics-certs\") pod \"router-default-66554f4bf4-w2s2r\" (UID: \"a940a062-485b-4183-91ea-b6c674362b0a\") " pod="openshift-ingress/router-default-66554f4bf4-w2s2r"
Jul 17 17:56:48.947134 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.947076    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6c101a17-a051-4e9d-a9dd-f72c67ba2a8a-serving-cert\") pod \"console-operator-565b7b569d-tp9qm\" (UID: \"6c101a17-a051-4e9d-a9dd-f72c67ba2a8a\") " pod="openshift-console-operator/console-operator-565b7b569d-tp9qm"
Jul 17 17:56:48.947134 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.947108    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhtrl\" (UniqueName: \"kubernetes.io/projected/6c101a17-a051-4e9d-a9dd-f72c67ba2a8a-kube-api-access-jhtrl\") pod \"console-operator-565b7b569d-tp9qm\" (UID: \"6c101a17-a051-4e9d-a9dd-f72c67ba2a8a\") " pod="openshift-console-operator/console-operator-565b7b569d-tp9qm"
Jul 17 17:56:48.947372 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.947146    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xxmr\" (UniqueName: \"kubernetes.io/projected/51fe56fe-81e6-4151-99cc-4bc2192ef182-kube-api-access-2xxmr\") pod \"dns-default-r5w6h\" (UID: \"51fe56fe-81e6-4151-99cc-4bc2192ef182\") " pod="openshift-dns/dns-default-r5w6h"
Jul 17 17:56:48.947372 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:48.947178    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 17:56:48.947372 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.947221    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b62cc888-90b6-4004-ac3b-ea40641b8d41-cert\") pod \"ingress-canary-rlgvg\" (UID: \"b62cc888-90b6-4004-ac3b-ea40641b8d41\") " pod="openshift-ingress-canary/ingress-canary-rlgvg"
Jul 17 17:56:48.947372 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.947255    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qddb\" (UniqueName: \"kubernetes.io/projected/483a6489-148d-4543-8831-c7be5d84e40b-kube-api-access-6qddb\") pod \"volume-data-source-validator-78cf4c6f6-4szzt\" (UID: \"483a6489-148d-4543-8831-c7be5d84e40b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-4szzt"
Jul 17 17:56:48.947372 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.947285    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a940a062-485b-4183-91ea-b6c674362b0a-default-certificate\") pod \"router-default-66554f4bf4-w2s2r\" (UID: \"a940a062-485b-4183-91ea-b6c674362b0a\") " pod="openshift-ingress/router-default-66554f4bf4-w2s2r"
Jul 17 17:56:48.947372 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.947285    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/51fe56fe-81e6-4151-99cc-4bc2192ef182-config-volume\") pod \"dns-default-r5w6h\" (UID: \"51fe56fe-81e6-4151-99cc-4bc2192ef182\") " pod="openshift-dns/dns-default-r5w6h"
Jul 17 17:56:48.947372 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:48.947329    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a940a062-485b-4183-91ea-b6c674362b0a-metrics-certs podName:a940a062-485b-4183-91ea-b6c674362b0a nodeName:}" failed. No retries permitted until 2026-07-17 17:56:49.447305872 +0000 UTC m=+36.672535170 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a940a062-485b-4183-91ea-b6c674362b0a-metrics-certs") pod "router-default-66554f4bf4-w2s2r" (UID: "a940a062-485b-4183-91ea-b6c674362b0a") : secret "router-metrics-certs-default" not found
Jul 17 17:56:48.947718 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.947487    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a940a062-485b-4183-91ea-b6c674362b0a-service-ca-bundle\") pod \"router-default-66554f4bf4-w2s2r\" (UID: \"a940a062-485b-4183-91ea-b6c674362b0a\") " pod="openshift-ingress/router-default-66554f4bf4-w2s2r"
Jul 17 17:56:48.947718 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.947527    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cswgt\" (UniqueName: \"kubernetes.io/projected/b62cc888-90b6-4004-ac3b-ea40641b8d41-kube-api-access-cswgt\") pod \"ingress-canary-rlgvg\" (UID: \"b62cc888-90b6-4004-ac3b-ea40641b8d41\") " pod="openshift-ingress-canary/ingress-canary-rlgvg"
Jul 17 17:56:48.947718 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.947590    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6c101a17-a051-4e9d-a9dd-f72c67ba2a8a-config\") pod \"console-operator-565b7b569d-tp9qm\" (UID: \"6c101a17-a051-4e9d-a9dd-f72c67ba2a8a\") " pod="openshift-console-operator/console-operator-565b7b569d-tp9qm"
Jul 17 17:56:48.947718 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:48.947671    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a940a062-485b-4183-91ea-b6c674362b0a-service-ca-bundle podName:a940a062-485b-4183-91ea-b6c674362b0a nodeName:}" failed. No retries permitted until 2026-07-17 17:56:49.447656906 +0000 UTC m=+36.672886193 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a940a062-485b-4183-91ea-b6c674362b0a-service-ca-bundle") pod "router-default-66554f4bf4-w2s2r" (UID: "a940a062-485b-4183-91ea-b6c674362b0a") : configmap references non-existent config key: service-ca.crt
Jul 17 17:56:48.947718 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.947695    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51fe56fe-81e6-4151-99cc-4bc2192ef182-tmp-dir\") pod \"dns-default-r5w6h\" (UID: \"51fe56fe-81e6-4151-99cc-4bc2192ef182\") " pod="openshift-dns/dns-default-r5w6h"
Jul 17 17:56:48.947949 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.947741    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c101a17-a051-4e9d-a9dd-f72c67ba2a8a-trusted-ca\") pod \"console-operator-565b7b569d-tp9qm\" (UID: \"6c101a17-a051-4e9d-a9dd-f72c67ba2a8a\") " pod="openshift-console-operator/console-operator-565b7b569d-tp9qm"
Jul 17 17:56:48.947949 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.947795    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gcjk\" (UniqueName: \"kubernetes.io/projected/3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69-kube-api-access-5gcjk\") pod \"cluster-samples-operator-79b7c55f87-j829s\" (UID: \"3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j829s"
Jul 17 17:56:48.948400 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.948378    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6c101a17-a051-4e9d-a9dd-f72c67ba2a8a-config\") pod \"console-operator-565b7b569d-tp9qm\" (UID: \"6c101a17-a051-4e9d-a9dd-f72c67ba2a8a\") " pod="openshift-console-operator/console-operator-565b7b569d-tp9qm"
Jul 17 17:56:48.948804 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.948778    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c101a17-a051-4e9d-a9dd-f72c67ba2a8a-trusted-ca\") pod \"console-operator-565b7b569d-tp9qm\" (UID: \"6c101a17-a051-4e9d-a9dd-f72c67ba2a8a\") " pod="openshift-console-operator/console-operator-565b7b569d-tp9qm"
Jul 17 17:56:48.948958 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.948940    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/51fe56fe-81e6-4151-99cc-4bc2192ef182-tmp-dir\") pod \"dns-default-r5w6h\" (UID: \"51fe56fe-81e6-4151-99cc-4bc2192ef182\") " pod="openshift-dns/dns-default-r5w6h"
Jul 17 17:56:48.950057 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.949934    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6c101a17-a051-4e9d-a9dd-f72c67ba2a8a-serving-cert\") pod \"console-operator-565b7b569d-tp9qm\" (UID: \"6c101a17-a051-4e9d-a9dd-f72c67ba2a8a\") " pod="openshift-console-operator/console-operator-565b7b569d-tp9qm"
Jul 17 17:56:48.950057 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.950017    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/a940a062-485b-4183-91ea-b6c674362b0a-default-certificate\") pod \"router-default-66554f4bf4-w2s2r\" (UID: \"a940a062-485b-4183-91ea-b6c674362b0a\") " pod="openshift-ingress/router-default-66554f4bf4-w2s2r"
Jul 17 17:56:48.950210 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.950158    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/a940a062-485b-4183-91ea-b6c674362b0a-stats-auth\") pod \"router-default-66554f4bf4-w2s2r\" (UID: \"a940a062-485b-4183-91ea-b6c674362b0a\") " pod="openshift-ingress/router-default-66554f4bf4-w2s2r"
Jul 17 17:56:48.955306 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.955285    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-555d9d7885-vdxt4"
Jul 17 17:56:48.958553 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.958478    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xxmr\" (UniqueName: \"kubernetes.io/projected/51fe56fe-81e6-4151-99cc-4bc2192ef182-kube-api-access-2xxmr\") pod \"dns-default-r5w6h\" (UID: \"51fe56fe-81e6-4151-99cc-4bc2192ef182\") " pod="openshift-dns/dns-default-r5w6h"
Jul 17 17:56:48.958667 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.958635    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v5m4\" (UniqueName: \"kubernetes.io/projected/a940a062-485b-4183-91ea-b6c674362b0a-kube-api-access-7v5m4\") pod \"router-default-66554f4bf4-w2s2r\" (UID: \"a940a062-485b-4183-91ea-b6c674362b0a\") " pod="openshift-ingress/router-default-66554f4bf4-w2s2r"
Jul 17 17:56:48.958850 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.958813    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qddb\" (UniqueName: \"kubernetes.io/projected/483a6489-148d-4543-8831-c7be5d84e40b-kube-api-access-6qddb\") pod \"volume-data-source-validator-78cf4c6f6-4szzt\" (UID: \"483a6489-148d-4543-8831-c7be5d84e40b\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-4szzt"
Jul 17 17:56:48.959054 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.959024    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhtrl\" (UniqueName: \"kubernetes.io/projected/6c101a17-a051-4e9d-a9dd-f72c67ba2a8a-kube-api-access-jhtrl\") pod \"console-operator-565b7b569d-tp9qm\" (UID: \"6c101a17-a051-4e9d-a9dd-f72c67ba2a8a\") " pod="openshift-console-operator/console-operator-565b7b569d-tp9qm"
Jul 17 17:56:48.959932 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.959912    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gcjk\" (UniqueName: \"kubernetes.io/projected/3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69-kube-api-access-5gcjk\") pod \"cluster-samples-operator-79b7c55f87-j829s\" (UID: \"3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j829s"
Jul 17 17:56:48.991445 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:48.991413    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-4szzt"
Jul 17 17:56:49.005652 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:49.005622    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-565b7b569d-tp9qm"
Jul 17 17:56:49.048355 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:49.048316    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b62cc888-90b6-4004-ac3b-ea40641b8d41-cert\") pod \"ingress-canary-rlgvg\" (UID: \"b62cc888-90b6-4004-ac3b-ea40641b8d41\") " pod="openshift-ingress-canary/ingress-canary-rlgvg"
Jul 17 17:56:49.048518 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:49.048388    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cswgt\" (UniqueName: \"kubernetes.io/projected/b62cc888-90b6-4004-ac3b-ea40641b8d41-kube-api-access-cswgt\") pod \"ingress-canary-rlgvg\" (UID: \"b62cc888-90b6-4004-ac3b-ea40641b8d41\") " pod="openshift-ingress-canary/ingress-canary-rlgvg"
Jul 17 17:56:49.051595 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:49.051565    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b62cc888-90b6-4004-ac3b-ea40641b8d41-cert\") pod \"ingress-canary-rlgvg\" (UID: \"b62cc888-90b6-4004-ac3b-ea40641b8d41\") " pod="openshift-ingress-canary/ingress-canary-rlgvg"
Jul 17 17:56:49.056983 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:49.056953    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cswgt\" (UniqueName: \"kubernetes.io/projected/b62cc888-90b6-4004-ac3b-ea40641b8d41-kube-api-access-cswgt\") pod \"ingress-canary-rlgvg\" (UID: \"b62cc888-90b6-4004-ac3b-ea40641b8d41\") " pod="openshift-ingress-canary/ingress-canary-rlgvg"
Jul 17 17:56:49.071337 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:49.071039    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rlgvg"
Jul 17 17:56:49.209573 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:49.209535    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-555d9d7885-vdxt4"]
Jul 17 17:56:49.214418 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:49.214081    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-4szzt"]
Jul 17 17:56:49.214627 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:49.214544    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf512024_2ccd_4dfd_8a9d_c5b12ab13655.slice/crio-13efd92c9af4b95b59be4b057481e387887cb6f9fefd9ac38066823519f289c3 WatchSource:0}: Error finding container 13efd92c9af4b95b59be4b057481e387887cb6f9fefd9ac38066823519f289c3: Status 404 returned error can't find the container with id 13efd92c9af4b95b59be4b057481e387887cb6f9fefd9ac38066823519f289c3
Jul 17 17:56:49.217669 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:49.217646    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod483a6489_148d_4543_8831_c7be5d84e40b.slice/crio-5555053b1a4f4bda475848a5241bdd8bf6220823daf06e110871d5916ac51088 WatchSource:0}: Error finding container 5555053b1a4f4bda475848a5241bdd8bf6220823daf06e110871d5916ac51088: Status 404 returned error can't find the container with id 5555053b1a4f4bda475848a5241bdd8bf6220823daf06e110871d5916ac51088
Jul 17 17:56:49.232695 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:49.232617    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-565b7b569d-tp9qm"]
Jul 17 17:56:49.239029 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:49.238969    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c101a17_a051_4e9d_a9dd_f72c67ba2a8a.slice/crio-366f224440f6ce9f2f5ecf0af699eeec8533e152d03bb3454122eb2d864364d5 WatchSource:0}: Error finding container 366f224440f6ce9f2f5ecf0af699eeec8533e152d03bb3454122eb2d864364d5: Status 404 returned error can't find the container with id 366f224440f6ce9f2f5ecf0af699eeec8533e152d03bb3454122eb2d864364d5
Jul 17 17:56:49.275153 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:49.275121    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rlgvg"]
Jul 17 17:56:49.278858 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:49.278821    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb62cc888_90b6_4004_ac3b_ea40641b8d41.slice/crio-b2f40de2019dba083d17417b0362bf358847457ebf3deaee024ca0f7463bd7ab WatchSource:0}: Error finding container b2f40de2019dba083d17417b0362bf358847457ebf3deaee024ca0f7463bd7ab: Status 404 returned error can't find the container with id b2f40de2019dba083d17417b0362bf358847457ebf3deaee024ca0f7463bd7ab
Jul 17 17:56:49.353194 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:49.353152    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-registry-tls\") pod \"image-registry-655959c9dc-dc87g\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") " pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:56:49.353373 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:49.353210    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/64492602-a837-4470-a8e1-0dba2157232d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-724gg\" (UID: \"64492602-a837-4470-a8e1-0dba2157232d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-724gg"
Jul 17 17:56:49.353373 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:49.353313    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 17:56:49.353373 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:49.353341    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 17:56:49.353373 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:49.353361    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-655959c9dc-dc87g: secret "image-registry-tls" not found
Jul 17 17:56:49.353556 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:49.353384    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64492602-a837-4470-a8e1-0dba2157232d-cluster-monitoring-operator-tls podName:64492602-a837-4470-a8e1-0dba2157232d nodeName:}" failed. No retries permitted until 2026-07-17 17:56:50.353364744 +0000 UTC m=+37.578594049 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/64492602-a837-4470-a8e1-0dba2157232d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-724gg" (UID: "64492602-a837-4470-a8e1-0dba2157232d") : secret "cluster-monitoring-operator-tls" not found
Jul 17 17:56:49.353556 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:49.353411    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-registry-tls podName:61298aa5-416d-4864-a479-762a86580bc9 nodeName:}" failed. No retries permitted until 2026-07-17 17:56:50.353394815 +0000 UTC m=+37.578624106 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-registry-tls") pod "image-registry-655959c9dc-dc87g" (UID: "61298aa5-416d-4864-a479-762a86580bc9") : secret "image-registry-tls" not found
Jul 17 17:56:49.453890 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:49.453851    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a940a062-485b-4183-91ea-b6c674362b0a-service-ca-bundle\") pod \"router-default-66554f4bf4-w2s2r\" (UID: \"a940a062-485b-4183-91ea-b6c674362b0a\") " pod="openshift-ingress/router-default-66554f4bf4-w2s2r"
Jul 17 17:56:49.454107 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:49.453962    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-j829s\" (UID: \"3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j829s"
Jul 17 17:56:49.454107 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:49.453991    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51fe56fe-81e6-4151-99cc-4bc2192ef182-metrics-tls\") pod \"dns-default-r5w6h\" (UID: \"51fe56fe-81e6-4151-99cc-4bc2192ef182\") " pod="openshift-dns/dns-default-r5w6h"
Jul 17 17:56:49.454107 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:49.454052    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a940a062-485b-4183-91ea-b6c674362b0a-service-ca-bundle podName:a940a062-485b-4183-91ea-b6c674362b0a nodeName:}" failed. No retries permitted until 2026-07-17 17:56:50.454025859 +0000 UTC m=+37.679255168 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a940a062-485b-4183-91ea-b6c674362b0a-service-ca-bundle") pod "router-default-66554f4bf4-w2s2r" (UID: "a940a062-485b-4183-91ea-b6c674362b0a") : configmap references non-existent config key: service-ca.crt
Jul 17 17:56:49.454107 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:49.454104    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 17:56:49.454330 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:49.454103    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a940a062-485b-4183-91ea-b6c674362b0a-metrics-certs\") pod \"router-default-66554f4bf4-w2s2r\" (UID: \"a940a062-485b-4183-91ea-b6c674362b0a\") " pod="openshift-ingress/router-default-66554f4bf4-w2s2r"
Jul 17 17:56:49.454330 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:49.454104    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 17:56:49.454330 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:49.454157    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 17:56:49.454330 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:49.454150    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69-samples-operator-tls podName:3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69 nodeName:}" failed. No retries permitted until 2026-07-17 17:56:50.454137296 +0000 UTC m=+37.679366602 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-j829s" (UID: "3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69") : secret "samples-operator-tls" not found
Jul 17 17:56:49.454330 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:49.454217    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a940a062-485b-4183-91ea-b6c674362b0a-metrics-certs podName:a940a062-485b-4183-91ea-b6c674362b0a nodeName:}" failed. No retries permitted until 2026-07-17 17:56:50.454200812 +0000 UTC m=+37.679430098 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a940a062-485b-4183-91ea-b6c674362b0a-metrics-certs") pod "router-default-66554f4bf4-w2s2r" (UID: "a940a062-485b-4183-91ea-b6c674362b0a") : secret "router-metrics-certs-default" not found
Jul 17 17:56:49.454330 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:49.454236    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51fe56fe-81e6-4151-99cc-4bc2192ef182-metrics-tls podName:51fe56fe-81e6-4151-99cc-4bc2192ef182 nodeName:}" failed. No retries permitted until 2026-07-17 17:56:50.454225545 +0000 UTC m=+37.679454836 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51fe56fe-81e6-4151-99cc-4bc2192ef182-metrics-tls") pod "dns-default-r5w6h" (UID: "51fe56fe-81e6-4151-99cc-4bc2192ef182") : secret "dns-default-metrics-tls" not found
Jul 17 17:56:49.465980 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:49.465951    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxdhr"
Jul 17 17:56:49.468664 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:49.468642    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 17:56:49.468664 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:49.468644    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dn68c\""
Jul 17 17:56:49.609108 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:49.608970    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rlgvg" event={"ID":"b62cc888-90b6-4004-ac3b-ea40641b8d41","Type":"ContainerStarted","Data":"b2f40de2019dba083d17417b0362bf358847457ebf3deaee024ca0f7463bd7ab"}
Jul 17 17:56:49.610330 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:49.610299    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-tp9qm" event={"ID":"6c101a17-a051-4e9d-a9dd-f72c67ba2a8a","Type":"ContainerStarted","Data":"366f224440f6ce9f2f5ecf0af699eeec8533e152d03bb3454122eb2d864364d5"}
Jul 17 17:56:49.611604 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:49.611569    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-4szzt" event={"ID":"483a6489-148d-4543-8831-c7be5d84e40b","Type":"ContainerStarted","Data":"5555053b1a4f4bda475848a5241bdd8bf6220823daf06e110871d5916ac51088"}
Jul 17 17:56:49.612739 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:49.612718    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-vdxt4" event={"ID":"af512024-2ccd-4dfd-8a9d-c5b12ab13655","Type":"ContainerStarted","Data":"13efd92c9af4b95b59be4b057481e387887cb6f9fefd9ac38066823519f289c3"}
Jul 17 17:56:50.363778 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:50.363738    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-registry-tls\") pod \"image-registry-655959c9dc-dc87g\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") " pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:56:50.363971 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:50.363796    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/64492602-a837-4470-a8e1-0dba2157232d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-724gg\" (UID: \"64492602-a837-4470-a8e1-0dba2157232d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-724gg"
Jul 17 17:56:50.363971 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:50.363950    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 17:56:50.364112 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:50.364033    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64492602-a837-4470-a8e1-0dba2157232d-cluster-monitoring-operator-tls podName:64492602-a837-4470-a8e1-0dba2157232d nodeName:}" failed. No retries permitted until 2026-07-17 17:56:52.364010103 +0000 UTC m=+39.589239405 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/64492602-a837-4470-a8e1-0dba2157232d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-724gg" (UID: "64492602-a837-4470-a8e1-0dba2157232d") : secret "cluster-monitoring-operator-tls" not found
Jul 17 17:56:50.364627 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:50.364439    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 17:56:50.364627 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:50.364460    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-655959c9dc-dc87g: secret "image-registry-tls" not found
Jul 17 17:56:50.364627 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:50.364507    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-registry-tls podName:61298aa5-416d-4864-a479-762a86580bc9 nodeName:}" failed. No retries permitted until 2026-07-17 17:56:52.364490833 +0000 UTC m=+39.589720142 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-registry-tls") pod "image-registry-655959c9dc-dc87g" (UID: "61298aa5-416d-4864-a479-762a86580bc9") : secret "image-registry-tls" not found
Jul 17 17:56:50.466025 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:50.465060    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-j829s\" (UID: \"3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j829s"
Jul 17 17:56:50.466025 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:50.465113    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51fe56fe-81e6-4151-99cc-4bc2192ef182-metrics-tls\") pod \"dns-default-r5w6h\" (UID: \"51fe56fe-81e6-4151-99cc-4bc2192ef182\") " pod="openshift-dns/dns-default-r5w6h"
Jul 17 17:56:50.466025 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:50.465150    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a940a062-485b-4183-91ea-b6c674362b0a-metrics-certs\") pod \"router-default-66554f4bf4-w2s2r\" (UID: \"a940a062-485b-4183-91ea-b6c674362b0a\") " pod="openshift-ingress/router-default-66554f4bf4-w2s2r"
Jul 17 17:56:50.466025 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:50.465159    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:56:50.466025 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:50.465224    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a940a062-485b-4183-91ea-b6c674362b0a-service-ca-bundle\") pod \"router-default-66554f4bf4-w2s2r\" (UID: \"a940a062-485b-4183-91ea-b6c674362b0a\") " pod="openshift-ingress/router-default-66554f4bf4-w2s2r"
Jul 17 17:56:50.466025 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:50.465371    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a940a062-485b-4183-91ea-b6c674362b0a-service-ca-bundle podName:a940a062-485b-4183-91ea-b6c674362b0a nodeName:}" failed. No retries permitted until 2026-07-17 17:56:52.465351873 +0000 UTC m=+39.690581166 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a940a062-485b-4183-91ea-b6c674362b0a-service-ca-bundle") pod "router-default-66554f4bf4-w2s2r" (UID: "a940a062-485b-4183-91ea-b6c674362b0a") : configmap references non-existent config key: service-ca.crt
Jul 17 17:56:50.466025 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:50.465457    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 17:56:50.466025 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:50.465493    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69-samples-operator-tls podName:3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69 nodeName:}" failed. No retries permitted until 2026-07-17 17:56:52.465481348 +0000 UTC m=+39.690710637 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-j829s" (UID: "3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69") : secret "samples-operator-tls" not found
Jul 17 17:56:50.466025 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:50.465554    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 17:56:50.466025 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:50.465583    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51fe56fe-81e6-4151-99cc-4bc2192ef182-metrics-tls podName:51fe56fe-81e6-4151-99cc-4bc2192ef182 nodeName:}" failed. No retries permitted until 2026-07-17 17:56:52.465572646 +0000 UTC m=+39.690801931 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51fe56fe-81e6-4151-99cc-4bc2192ef182-metrics-tls") pod "dns-default-r5w6h" (UID: "51fe56fe-81e6-4151-99cc-4bc2192ef182") : secret "dns-default-metrics-tls" not found
Jul 17 17:56:50.466025 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:50.465609    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz5w2"
Jul 17 17:56:50.466025 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:50.465642    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 17:56:50.466025 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:50.465672    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a940a062-485b-4183-91ea-b6c674362b0a-metrics-certs podName:a940a062-485b-4183-91ea-b6c674362b0a nodeName:}" failed. No retries permitted until 2026-07-17 17:56:52.465662676 +0000 UTC m=+39.690891967 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a940a062-485b-4183-91ea-b6c674362b0a-metrics-certs") pod "router-default-66554f4bf4-w2s2r" (UID: "a940a062-485b-4183-91ea-b6c674362b0a") : secret "router-metrics-certs-default" not found
Jul 17 17:56:50.469274 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:50.468539    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 17 17:56:50.469274 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:50.468807    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 17 17:56:50.470679 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:50.470156    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 17:56:50.470679 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:50.470396    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jb7qg\""
Jul 17 17:56:52.381702 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:52.381657    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-registry-tls\") pod \"image-registry-655959c9dc-dc87g\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") " pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:56:52.381702 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:52.381705    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/64492602-a837-4470-a8e1-0dba2157232d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-724gg\" (UID: \"64492602-a837-4470-a8e1-0dba2157232d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-724gg"
Jul 17 17:56:52.382191 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:52.381807    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 17:56:52.382191 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:52.381828    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-655959c9dc-dc87g: secret "image-registry-tls" not found
Jul 17 17:56:52.382191 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:52.381870    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 17:56:52.382191 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:52.381885    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-registry-tls podName:61298aa5-416d-4864-a479-762a86580bc9 nodeName:}" failed. No retries permitted until 2026-07-17 17:56:56.38186938 +0000 UTC m=+43.607098667 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-registry-tls") pod "image-registry-655959c9dc-dc87g" (UID: "61298aa5-416d-4864-a479-762a86580bc9") : secret "image-registry-tls" not found
Jul 17 17:56:52.382191 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:52.381923    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64492602-a837-4470-a8e1-0dba2157232d-cluster-monitoring-operator-tls podName:64492602-a837-4470-a8e1-0dba2157232d nodeName:}" failed. No retries permitted until 2026-07-17 17:56:56.381910272 +0000 UTC m=+43.607139563 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/64492602-a837-4470-a8e1-0dba2157232d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-724gg" (UID: "64492602-a837-4470-a8e1-0dba2157232d") : secret "cluster-monitoring-operator-tls" not found
Jul 17 17:56:52.482639 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:52.482597    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a940a062-485b-4183-91ea-b6c674362b0a-service-ca-bundle\") pod \"router-default-66554f4bf4-w2s2r\" (UID: \"a940a062-485b-4183-91ea-b6c674362b0a\") " pod="openshift-ingress/router-default-66554f4bf4-w2s2r"
Jul 17 17:56:52.482822 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:52.482690    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-j829s\" (UID: \"3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j829s"
Jul 17 17:56:52.482822 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:52.482711    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51fe56fe-81e6-4151-99cc-4bc2192ef182-metrics-tls\") pod \"dns-default-r5w6h\" (UID: \"51fe56fe-81e6-4151-99cc-4bc2192ef182\") " pod="openshift-dns/dns-default-r5w6h"
Jul 17 17:56:52.482822 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:52.482790    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a940a062-485b-4183-91ea-b6c674362b0a-service-ca-bundle podName:a940a062-485b-4183-91ea-b6c674362b0a nodeName:}" failed. No retries permitted until 2026-07-17 17:56:56.482762518 +0000 UTC m=+43.707991804 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a940a062-485b-4183-91ea-b6c674362b0a-service-ca-bundle") pod "router-default-66554f4bf4-w2s2r" (UID: "a940a062-485b-4183-91ea-b6c674362b0a") : configmap references non-existent config key: service-ca.crt
Jul 17 17:56:52.482961 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:52.482837    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a940a062-485b-4183-91ea-b6c674362b0a-metrics-certs\") pod \"router-default-66554f4bf4-w2s2r\" (UID: \"a940a062-485b-4183-91ea-b6c674362b0a\") " pod="openshift-ingress/router-default-66554f4bf4-w2s2r"
Jul 17 17:56:52.482961 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:52.482797    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 17:56:52.482961 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:52.482905    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51fe56fe-81e6-4151-99cc-4bc2192ef182-metrics-tls podName:51fe56fe-81e6-4151-99cc-4bc2192ef182 nodeName:}" failed. No retries permitted until 2026-07-17 17:56:56.482889802 +0000 UTC m=+43.708119101 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51fe56fe-81e6-4151-99cc-4bc2192ef182-metrics-tls") pod "dns-default-r5w6h" (UID: "51fe56fe-81e6-4151-99cc-4bc2192ef182") : secret "dns-default-metrics-tls" not found
Jul 17 17:56:52.482961 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:52.482850    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 17:56:52.482961 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:52.482960    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 17:56:52.483140 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:52.482976    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69-samples-operator-tls podName:3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69 nodeName:}" failed. No retries permitted until 2026-07-17 17:56:56.482960871 +0000 UTC m=+43.708190157 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-j829s" (UID: "3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69") : secret "samples-operator-tls" not found
Jul 17 17:56:52.483140 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:52.482991    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a940a062-485b-4183-91ea-b6c674362b0a-metrics-certs podName:a940a062-485b-4183-91ea-b6c674362b0a nodeName:}" failed. No retries permitted until 2026-07-17 17:56:56.482984817 +0000 UTC m=+43.708214103 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a940a062-485b-4183-91ea-b6c674362b0a-metrics-certs") pod "router-default-66554f4bf4-w2s2r" (UID: "a940a062-485b-4183-91ea-b6c674362b0a") : secret "router-metrics-certs-default" not found
Jul 17 17:56:52.572543 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:52.572508    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6wzn9"]
Jul 17 17:56:52.593629 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:52.593575    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6wzn9"]
Jul 17 17:56:52.593799 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:52.593713    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6wzn9"
Jul 17 17:56:52.596794 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:52.596555    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-s2m8w\""
Jul 17 17:56:52.596794 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:52.596722    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 17 17:56:52.597030 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:52.596855    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 17 17:56:52.597030 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:52.596857    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 17 17:56:52.597525 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:52.597363    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 17 17:56:52.684848 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:52.684752    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eb991050-0ab3-4599-823c-f9dd86d13174-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-6wzn9\" (UID: \"eb991050-0ab3-4599-823c-f9dd86d13174\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6wzn9"
Jul 17 17:56:52.685021 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:52.684868    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xlk9\" (UniqueName: \"kubernetes.io/projected/eb991050-0ab3-4599-823c-f9dd86d13174-kube-api-access-2xlk9\") pod \"kube-storage-version-migrator-operator-7658d9b749-6wzn9\" (UID: \"eb991050-0ab3-4599-823c-f9dd86d13174\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6wzn9"
Jul 17 17:56:52.685021 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:52.684905    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb991050-0ab3-4599-823c-f9dd86d13174-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-6wzn9\" (UID: \"eb991050-0ab3-4599-823c-f9dd86d13174\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6wzn9"
Jul 17 17:56:52.786251 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:52.786211    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eb991050-0ab3-4599-823c-f9dd86d13174-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-6wzn9\" (UID: \"eb991050-0ab3-4599-823c-f9dd86d13174\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6wzn9"
Jul 17 17:56:52.786439 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:52.786325    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xlk9\" (UniqueName: \"kubernetes.io/projected/eb991050-0ab3-4599-823c-f9dd86d13174-kube-api-access-2xlk9\") pod \"kube-storage-version-migrator-operator-7658d9b749-6wzn9\" (UID: \"eb991050-0ab3-4599-823c-f9dd86d13174\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6wzn9"
Jul 17 17:56:52.786439 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:52.786370    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb991050-0ab3-4599-823c-f9dd86d13174-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-6wzn9\" (UID: \"eb991050-0ab3-4599-823c-f9dd86d13174\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6wzn9"
Jul 17 17:56:52.786900 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:52.786877    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eb991050-0ab3-4599-823c-f9dd86d13174-config\") pod \"kube-storage-version-migrator-operator-7658d9b749-6wzn9\" (UID: \"eb991050-0ab3-4599-823c-f9dd86d13174\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6wzn9"
Jul 17 17:56:52.790040 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:52.789990    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb991050-0ab3-4599-823c-f9dd86d13174-serving-cert\") pod \"kube-storage-version-migrator-operator-7658d9b749-6wzn9\" (UID: \"eb991050-0ab3-4599-823c-f9dd86d13174\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6wzn9"
Jul 17 17:56:52.796072 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:52.796049    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xlk9\" (UniqueName: \"kubernetes.io/projected/eb991050-0ab3-4599-823c-f9dd86d13174-kube-api-access-2xlk9\") pod \"kube-storage-version-migrator-operator-7658d9b749-6wzn9\" (UID: \"eb991050-0ab3-4599-823c-f9dd86d13174\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6wzn9"
Jul 17 17:56:52.904097 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:52.904054    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6wzn9"
Jul 17 17:56:53.833106 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:53.833070    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-vr85l"]
Jul 17 17:56:53.851275 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:53.851244    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-vr85l"]
Jul 17 17:56:53.851438 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:53.851344    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-vr85l"
Jul 17 17:56:53.853827 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:53.853802    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-wq8ln\""
Jul 17 17:56:53.897085 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:53.897048    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kwqv\" (UniqueName: \"kubernetes.io/projected/1b08383c-127a-450b-96de-25f3313fb0b5-kube-api-access-9kwqv\") pod \"network-check-source-7bc5b6bf85-vr85l\" (UID: \"1b08383c-127a-450b-96de-25f3313fb0b5\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-vr85l"
Jul 17 17:56:53.998709 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:53.998672    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kwqv\" (UniqueName: \"kubernetes.io/projected/1b08383c-127a-450b-96de-25f3313fb0b5-kube-api-access-9kwqv\") pod \"network-check-source-7bc5b6bf85-vr85l\" (UID: \"1b08383c-127a-450b-96de-25f3313fb0b5\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-vr85l"
Jul 17 17:56:54.009679 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:54.009648    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kwqv\" (UniqueName: \"kubernetes.io/projected/1b08383c-127a-450b-96de-25f3313fb0b5-kube-api-access-9kwqv\") pod \"network-check-source-7bc5b6bf85-vr85l\" (UID: \"1b08383c-127a-450b-96de-25f3313fb0b5\") " pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-vr85l"
Jul 17 17:56:54.161679 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:54.161599    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-vr85l"
Jul 17 17:56:54.659344 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:54.659302    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:56:54.738979 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:54.738934    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:56:54.796886 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:54.796824    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:56:55.538498 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:55.538225    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6wzn9"]
Jul 17 17:56:55.544380 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:55.544355    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb991050_0ab3_4599_823c_f9dd86d13174.slice/crio-32be8f68c062d10ed1837a3602d4a554aa60d28493d11692595613da91e9546d WatchSource:0}: Error finding container 32be8f68c062d10ed1837a3602d4a554aa60d28493d11692595613da91e9546d: Status 404 returned error can't find the container with id 32be8f68c062d10ed1837a3602d4a554aa60d28493d11692595613da91e9546d
Jul 17 17:56:55.549368 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:55.549342    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7bc5b6bf85-vr85l"]
Jul 17 17:56:55.567568 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:55.567546    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9wgzc"]
Jul 17 17:56:55.588650 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:55.588622    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9wgzc"]
Jul 17 17:56:55.588781 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:55.588736    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9wgzc"
Jul 17 17:56:55.591261 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:55.591217    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-6twhl\""
Jul 17 17:56:55.591431 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:55.591261    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 17 17:56:55.591431 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:55.591378    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 17 17:56:55.591431 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:55.591384    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 17 17:56:55.591654 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:55.591546    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 17 17:56:55.613133 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:55.612981    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75141c58-8adf-4427-80f5-3ea8a2d8081f-config\") pod \"service-ca-operator-5bcbc94c78-9wgzc\" (UID: \"75141c58-8adf-4427-80f5-3ea8a2d8081f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9wgzc"
Jul 17 17:56:55.613133 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:55.613111    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/75141c58-8adf-4427-80f5-3ea8a2d8081f-serving-cert\") pod \"service-ca-operator-5bcbc94c78-9wgzc\" (UID: \"75141c58-8adf-4427-80f5-3ea8a2d8081f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9wgzc"
Jul 17 17:56:55.613349 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:55.613189    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwtn4\" (UniqueName: \"kubernetes.io/projected/75141c58-8adf-4427-80f5-3ea8a2d8081f-kube-api-access-qwtn4\") pod \"service-ca-operator-5bcbc94c78-9wgzc\" (UID: \"75141c58-8adf-4427-80f5-3ea8a2d8081f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9wgzc"
Jul 17 17:56:55.636335 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:55.636304    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qsb98" event={"ID":"d3a85848-4964-41eb-ae52-6fbca6f695fb","Type":"ContainerStarted","Data":"fc3a216a03b2dac3fd151d5a7dc4a2245ff3acebc626dd2c7811defffbef0d90"}
Jul 17 17:56:55.637909 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:55.637772    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-tp9qm" event={"ID":"6c101a17-a051-4e9d-a9dd-f72c67ba2a8a","Type":"ContainerStarted","Data":"74c6bb7c75a058ef970d2bf148421e7464c7097266cda32a57896839ca89495d"}
Jul 17 17:56:55.638070 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:55.638022    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-tp9qm"
Jul 17 17:56:55.639462 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:55.639305    2572 patch_prober.go:28] interesting pod/console-operator-565b7b569d-tp9qm container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.9:8443/readyz\": dial tcp 10.132.0.9:8443: connect: connection refused" start-of-body=
Jul 17 17:56:55.639462 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:55.639344    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-565b7b569d-tp9qm" podUID="6c101a17-a051-4e9d-a9dd-f72c67ba2a8a" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.9:8443/readyz\": dial tcp 10.132.0.9:8443: connect: connection refused"
Jul 17 17:56:55.640269 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:55.640236    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6wzn9" event={"ID":"eb991050-0ab3-4599-823c-f9dd86d13174","Type":"ContainerStarted","Data":"32be8f68c062d10ed1837a3602d4a554aa60d28493d11692595613da91e9546d"}
Jul 17 17:56:55.642886 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:55.642862    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-4szzt" event={"ID":"483a6489-148d-4543-8831-c7be5d84e40b","Type":"ContainerStarted","Data":"f3fcbf4e9ed9080b8b2e4963b2bb8b9bcf6fdfda04a0c3aab180df1b8c7524e1"}
Jul 17 17:56:55.644641 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:55.644609    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-vr85l" event={"ID":"1b08383c-127a-450b-96de-25f3313fb0b5","Type":"ContainerStarted","Data":"ad6f1edc06c293d565b80612e9c0691e3d6802457a4d434f490837a2c558b145"}
Jul 17 17:56:55.645838 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:55.645817    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-vdxt4" event={"ID":"af512024-2ccd-4dfd-8a9d-c5b12ab13655","Type":"ContainerStarted","Data":"dd7061b8307cb0dfb7bc8217952e2bc91b2eacf35abc0118f2f146a7e7dd5791"}
Jul 17 17:56:55.657788 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:55.657740    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-565b7b569d-tp9qm" podStartSLOduration=1.500308978 podStartE2EDuration="7.657725368s" totalImagesPullingTime="6.15741639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:56:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:56:55.65657323 +0000 UTC m=+42.881802539" watchObservedRunningTime="2026-07-17 17:56:55.657725368 +0000 UTC m=+42.882954684"
Jul 17 17:56:55.671972 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:55.671395    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-555d9d7885-vdxt4" podStartSLOduration=3.489755766 podStartE2EDuration="9.671374982s" totalImagesPullingTime="6.181619216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:56:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:56:55.671072019 +0000 UTC m=+42.896301328" watchObservedRunningTime="2026-07-17 17:56:55.671374982 +0000 UTC m=+42.896604291"
Jul 17 17:56:55.686906 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:55.686848    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78cf4c6f6-4szzt" podStartSLOduration=2.5135675600000003 podStartE2EDuration="8.686826697s" totalImagesPullingTime="6.173259137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:56:55.685912762 +0000 UTC m=+42.911142069" watchObservedRunningTime="2026-07-17 17:56:55.686826697 +0000 UTC m=+42.912056006"
Jul 17 17:56:55.714697 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:55.713916    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/75141c58-8adf-4427-80f5-3ea8a2d8081f-serving-cert\") pod \"service-ca-operator-5bcbc94c78-9wgzc\" (UID: \"75141c58-8adf-4427-80f5-3ea8a2d8081f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9wgzc"
Jul 17 17:56:55.714697 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:55.714260    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwtn4\" (UniqueName: \"kubernetes.io/projected/75141c58-8adf-4427-80f5-3ea8a2d8081f-kube-api-access-qwtn4\") pod \"service-ca-operator-5bcbc94c78-9wgzc\" (UID: \"75141c58-8adf-4427-80f5-3ea8a2d8081f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9wgzc"
Jul 17 17:56:55.714697 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:55.714387    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75141c58-8adf-4427-80f5-3ea8a2d8081f-config\") pod \"service-ca-operator-5bcbc94c78-9wgzc\" (UID: \"75141c58-8adf-4427-80f5-3ea8a2d8081f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9wgzc"
Jul 17 17:56:55.715570 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:55.715538    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75141c58-8adf-4427-80f5-3ea8a2d8081f-config\") pod \"service-ca-operator-5bcbc94c78-9wgzc\" (UID: \"75141c58-8adf-4427-80f5-3ea8a2d8081f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9wgzc"
Jul 17 17:56:55.717438 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:55.717416    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/75141c58-8adf-4427-80f5-3ea8a2d8081f-serving-cert\") pod \"service-ca-operator-5bcbc94c78-9wgzc\" (UID: \"75141c58-8adf-4427-80f5-3ea8a2d8081f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9wgzc"
Jul 17 17:56:55.725400 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:55.725373    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwtn4\" (UniqueName: \"kubernetes.io/projected/75141c58-8adf-4427-80f5-3ea8a2d8081f-kube-api-access-qwtn4\") pod \"service-ca-operator-5bcbc94c78-9wgzc\" (UID: \"75141c58-8adf-4427-80f5-3ea8a2d8081f\") " pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9wgzc"
Jul 17 17:56:55.764984 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:55.764941    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:56:55.898603 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:55.898576    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9wgzc"
Jul 17 17:56:56.071899 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:56.071564    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9wgzc"]
Jul 17 17:56:56.075161 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:56:56.075127    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75141c58_8adf_4427_80f5_3ea8a2d8081f.slice/crio-4cc90203b257d61c5ce5cadf8227bd2c9fd7835543269bde13c712688bc6668c WatchSource:0}: Error finding container 4cc90203b257d61c5ce5cadf8227bd2c9fd7835543269bde13c712688bc6668c: Status 404 returned error can't find the container with id 4cc90203b257d61c5ce5cadf8227bd2c9fd7835543269bde13c712688bc6668c
Jul 17 17:56:56.421236 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:56.421194    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-registry-tls\") pod \"image-registry-655959c9dc-dc87g\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") " pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:56:56.421417 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:56.421253    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/64492602-a837-4470-a8e1-0dba2157232d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-724gg\" (UID: \"64492602-a837-4470-a8e1-0dba2157232d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-724gg"
Jul 17 17:56:56.421541 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:56.421525    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 17:56:56.421597 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:56.421588    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64492602-a837-4470-a8e1-0dba2157232d-cluster-monitoring-operator-tls podName:64492602-a837-4470-a8e1-0dba2157232d nodeName:}" failed. No retries permitted until 2026-07-17 17:57:04.421568982 +0000 UTC m=+51.646798274 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/64492602-a837-4470-a8e1-0dba2157232d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-724gg" (UID: "64492602-a837-4470-a8e1-0dba2157232d") : secret "cluster-monitoring-operator-tls" not found
Jul 17 17:56:56.422043 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:56.422024    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 17:56:56.422043 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:56.422046    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-655959c9dc-dc87g: secret "image-registry-tls" not found
Jul 17 17:56:56.422195 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:56.422102    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-registry-tls podName:61298aa5-416d-4864-a479-762a86580bc9 nodeName:}" failed. No retries permitted until 2026-07-17 17:57:04.42208625 +0000 UTC m=+51.647315552 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-registry-tls") pod "image-registry-655959c9dc-dc87g" (UID: "61298aa5-416d-4864-a479-762a86580bc9") : secret "image-registry-tls" not found
Jul 17 17:56:56.522078 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:56.521838    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a940a062-485b-4183-91ea-b6c674362b0a-metrics-certs\") pod \"router-default-66554f4bf4-w2s2r\" (UID: \"a940a062-485b-4183-91ea-b6c674362b0a\") " pod="openshift-ingress/router-default-66554f4bf4-w2s2r"
Jul 17 17:56:56.522078 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:56.521939    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a940a062-485b-4183-91ea-b6c674362b0a-service-ca-bundle\") pod \"router-default-66554f4bf4-w2s2r\" (UID: \"a940a062-485b-4183-91ea-b6c674362b0a\") " pod="openshift-ingress/router-default-66554f4bf4-w2s2r"
Jul 17 17:56:56.522078 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:56.521960    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 17:56:56.522078 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:56.522062    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a940a062-485b-4183-91ea-b6c674362b0a-metrics-certs podName:a940a062-485b-4183-91ea-b6c674362b0a nodeName:}" failed. No retries permitted until 2026-07-17 17:57:04.522043555 +0000 UTC m=+51.747272845 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a940a062-485b-4183-91ea-b6c674362b0a-metrics-certs") pod "router-default-66554f4bf4-w2s2r" (UID: "a940a062-485b-4183-91ea-b6c674362b0a") : secret "router-metrics-certs-default" not found
Jul 17 17:56:56.522399 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:56.522090    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-j829s\" (UID: \"3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j829s"
Jul 17 17:56:56.522399 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:56.522121    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51fe56fe-81e6-4151-99cc-4bc2192ef182-metrics-tls\") pod \"dns-default-r5w6h\" (UID: \"51fe56fe-81e6-4151-99cc-4bc2192ef182\") " pod="openshift-dns/dns-default-r5w6h"
Jul 17 17:56:56.522399 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:56.522158    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a940a062-485b-4183-91ea-b6c674362b0a-service-ca-bundle podName:a940a062-485b-4183-91ea-b6c674362b0a nodeName:}" failed. No retries permitted until 2026-07-17 17:57:04.522136681 +0000 UTC m=+51.747365971 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a940a062-485b-4183-91ea-b6c674362b0a-service-ca-bundle") pod "router-default-66554f4bf4-w2s2r" (UID: "a940a062-485b-4183-91ea-b6c674362b0a") : configmap references non-existent config key: service-ca.crt
Jul 17 17:56:56.522399 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:56.522221    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 17:56:56.522399 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:56.522256    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51fe56fe-81e6-4151-99cc-4bc2192ef182-metrics-tls podName:51fe56fe-81e6-4151-99cc-4bc2192ef182 nodeName:}" failed. No retries permitted until 2026-07-17 17:57:04.522245724 +0000 UTC m=+51.747475009 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51fe56fe-81e6-4151-99cc-4bc2192ef182-metrics-tls") pod "dns-default-r5w6h" (UID: "51fe56fe-81e6-4151-99cc-4bc2192ef182") : secret "dns-default-metrics-tls" not found
Jul 17 17:56:56.522399 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:56.522220    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 17:56:56.522399 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:56.522293    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69-samples-operator-tls podName:3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69 nodeName:}" failed. No retries permitted until 2026-07-17 17:57:04.522283842 +0000 UTC m=+51.747513133 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-j829s" (UID: "3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69") : secret "samples-operator-tls" not found
Jul 17 17:56:56.652283 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:56.652249    2572 generic.go:356] "Generic (PLEG): container finished" podID="d3a85848-4964-41eb-ae52-6fbca6f695fb" containerID="fc3a216a03b2dac3fd151d5a7dc4a2245ff3acebc626dd2c7811defffbef0d90" exitCode=0
Jul 17 17:56:56.653216 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:56.652334    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qsb98" event={"ID":"d3a85848-4964-41eb-ae52-6fbca6f695fb","Type":"ContainerDied","Data":"fc3a216a03b2dac3fd151d5a7dc4a2245ff3acebc626dd2c7811defffbef0d90"}
Jul 17 17:56:56.655283 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:56.655129    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rlgvg" event={"ID":"b62cc888-90b6-4004-ac3b-ea40641b8d41","Type":"ContainerStarted","Data":"52c985c5c583bf141e4adde55fed121f0b7774f56d5e7aed9460558a458bab89"}
Jul 17 17:56:56.657906 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:56.657678    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tp9qm_6c101a17-a051-4e9d-a9dd-f72c67ba2a8a/console-operator/0.log"
Jul 17 17:56:56.657906 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:56.657713    2572 generic.go:356] "Generic (PLEG): container finished" podID="6c101a17-a051-4e9d-a9dd-f72c67ba2a8a" containerID="74c6bb7c75a058ef970d2bf148421e7464c7097266cda32a57896839ca89495d" exitCode=255
Jul 17 17:56:56.657906 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:56.657834    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-tp9qm" event={"ID":"6c101a17-a051-4e9d-a9dd-f72c67ba2a8a","Type":"ContainerDied","Data":"74c6bb7c75a058ef970d2bf148421e7464c7097266cda32a57896839ca89495d"}
Jul 17 17:56:56.658630 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:56.658347    2572 scope.go:117] "RemoveContainer" containerID="74c6bb7c75a058ef970d2bf148421e7464c7097266cda32a57896839ca89495d"
Jul 17 17:56:56.659658 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:56.659636    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9wgzc" event={"ID":"75141c58-8adf-4427-80f5-3ea8a2d8081f","Type":"ContainerStarted","Data":"4cc90203b257d61c5ce5cadf8227bd2c9fd7835543269bde13c712688bc6668c"}
Jul 17 17:56:56.711224 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:56.711046    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rlgvg" podStartSLOduration=2.156750421 podStartE2EDuration="8.711021327s" totalImagesPullingTime="6.554270906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:56:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:56:56.709975737 +0000 UTC m=+43.935205045" watchObservedRunningTime="2026-07-17 17:56:56.711021327 +0000 UTC m=+43.936250629"
Jul 17 17:56:57.109706 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:57.109134    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kkl4n"]
Jul 17 17:56:57.129546 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:57.129393    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kkl4n"]
Jul 17 17:56:57.131387 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:57.130407    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kkl4n"
Jul 17 17:56:57.134542 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:57.133159    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ns7ff\""
Jul 17 17:56:57.134542 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:57.133523    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 17 17:56:57.134542 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:57.133733    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 17 17:56:57.142276 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:57.142145    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:56:57.228688 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:57.228626    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kkl4n\" (UID: \"dcf5ab59-2a15-44b3-84b7-3f6facab15b9\") " pod="openshift-insights/insights-runtime-extractor-kkl4n"
Jul 17 17:56:57.228890 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:57.228790    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-data-volume\") pod \"insights-runtime-extractor-kkl4n\" (UID: \"dcf5ab59-2a15-44b3-84b7-3f6facab15b9\") " pod="openshift-insights/insights-runtime-extractor-kkl4n"
Jul 17 17:56:57.228974 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:57.228892    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-crio-socket\") pod \"insights-runtime-extractor-kkl4n\" (UID: \"dcf5ab59-2a15-44b3-84b7-3f6facab15b9\") " pod="openshift-insights/insights-runtime-extractor-kkl4n"
Jul 17 17:56:57.228974 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:57.228946    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-977rs\" (UniqueName: \"kubernetes.io/projected/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-kube-api-access-977rs\") pod \"insights-runtime-extractor-kkl4n\" (UID: \"dcf5ab59-2a15-44b3-84b7-3f6facab15b9\") " pod="openshift-insights/insights-runtime-extractor-kkl4n"
Jul 17 17:56:57.229102 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:57.228972    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kkl4n\" (UID: \"dcf5ab59-2a15-44b3-84b7-3f6facab15b9\") " pod="openshift-insights/insights-runtime-extractor-kkl4n"
Jul 17 17:56:57.234863 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:57.234808    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:56:57.329451 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:57.329413    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-crio-socket\") pod \"insights-runtime-extractor-kkl4n\" (UID: \"dcf5ab59-2a15-44b3-84b7-3f6facab15b9\") " pod="openshift-insights/insights-runtime-extractor-kkl4n"
Jul 17 17:56:57.330129 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:57.329468    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-977rs\" (UniqueName: \"kubernetes.io/projected/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-kube-api-access-977rs\") pod \"insights-runtime-extractor-kkl4n\" (UID: \"dcf5ab59-2a15-44b3-84b7-3f6facab15b9\") " pod="openshift-insights/insights-runtime-extractor-kkl4n"
Jul 17 17:56:57.330129 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:57.329497    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kkl4n\" (UID: \"dcf5ab59-2a15-44b3-84b7-3f6facab15b9\") " pod="openshift-insights/insights-runtime-extractor-kkl4n"
Jul 17 17:56:57.330129 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:57.329522    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kkl4n\" (UID: \"dcf5ab59-2a15-44b3-84b7-3f6facab15b9\") " pod="openshift-insights/insights-runtime-extractor-kkl4n"
Jul 17 17:56:57.330129 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:57.329927    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-crio-socket\") pod \"insights-runtime-extractor-kkl4n\" (UID: \"dcf5ab59-2a15-44b3-84b7-3f6facab15b9\") " pod="openshift-insights/insights-runtime-extractor-kkl4n"
Jul 17 17:56:57.330129 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:57.330035    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 17:56:57.330129 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:57.330088    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-insights-runtime-extractor-tls podName:dcf5ab59-2a15-44b3-84b7-3f6facab15b9 nodeName:}" failed. No retries permitted until 2026-07-17 17:56:57.830069743 +0000 UTC m=+45.055299032 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kkl4n" (UID: "dcf5ab59-2a15-44b3-84b7-3f6facab15b9") : secret "insights-runtime-extractor-tls" not found
Jul 17 17:56:57.330552 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:57.330177    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 17:56:57.330552 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:57.330240    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-kube-rbac-proxy-cm podName:dcf5ab59-2a15-44b3-84b7-3f6facab15b9 nodeName:}" failed. No retries permitted until 2026-07-17 17:56:57.830222658 +0000 UTC m=+45.055451960 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kkl4n" (UID: "dcf5ab59-2a15-44b3-84b7-3f6facab15b9") : configmap "kube-rbac-proxy" not found
Jul 17 17:56:57.330552 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:57.330269    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-data-volume\") pod \"insights-runtime-extractor-kkl4n\" (UID: \"dcf5ab59-2a15-44b3-84b7-3f6facab15b9\") " pod="openshift-insights/insights-runtime-extractor-kkl4n"
Jul 17 17:56:57.330698 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:57.330656    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-data-volume\") pod \"insights-runtime-extractor-kkl4n\" (UID: \"dcf5ab59-2a15-44b3-84b7-3f6facab15b9\") " pod="openshift-insights/insights-runtime-extractor-kkl4n"
Jul 17 17:56:57.341057 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:57.340872    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-977rs\" (UniqueName: \"kubernetes.io/projected/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-kube-api-access-977rs\") pod \"insights-runtime-extractor-kkl4n\" (UID: \"dcf5ab59-2a15-44b3-84b7-3f6facab15b9\") " pod="openshift-insights/insights-runtime-extractor-kkl4n"
Jul 17 17:56:57.665900 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:57.665814    2572 generic.go:356] "Generic (PLEG): container finished" podID="d3a85848-4964-41eb-ae52-6fbca6f695fb" containerID="70efbd3dbf024ac9d036a493ea4cf5fcefa7397acf998e052bcf1e92459b1b1c" exitCode=0
Jul 17 17:56:57.666334 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:57.665895    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qsb98" event={"ID":"d3a85848-4964-41eb-ae52-6fbca6f695fb","Type":"ContainerDied","Data":"70efbd3dbf024ac9d036a493ea4cf5fcefa7397acf998e052bcf1e92459b1b1c"}
Jul 17 17:56:57.667742 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:57.667722    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tp9qm_6c101a17-a051-4e9d-a9dd-f72c67ba2a8a/console-operator/1.log"
Jul 17 17:56:57.668123 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:57.668107    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tp9qm_6c101a17-a051-4e9d-a9dd-f72c67ba2a8a/console-operator/0.log"
Jul 17 17:56:57.668199 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:57.668143    2572 generic.go:356] "Generic (PLEG): container finished" podID="6c101a17-a051-4e9d-a9dd-f72c67ba2a8a" containerID="11370b742997b28ed24691ae953a72af04d5e562365e7f342de695d051388d34" exitCode=255
Jul 17 17:56:57.668261 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:57.668218    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-tp9qm" event={"ID":"6c101a17-a051-4e9d-a9dd-f72c67ba2a8a","Type":"ContainerDied","Data":"11370b742997b28ed24691ae953a72af04d5e562365e7f342de695d051388d34"}
Jul 17 17:56:57.668310 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:57.668269    2572 scope.go:117] "RemoveContainer" containerID="74c6bb7c75a058ef970d2bf148421e7464c7097266cda32a57896839ca89495d"
Jul 17 17:56:57.668542 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:57.668523    2572 scope.go:117] "RemoveContainer" containerID="11370b742997b28ed24691ae953a72af04d5e562365e7f342de695d051388d34"
Jul 17 17:56:57.668716 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:57.668695    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-tp9qm_openshift-console-operator(6c101a17-a051-4e9d-a9dd-f72c67ba2a8a)\"" pod="openshift-console-operator/console-operator-565b7b569d-tp9qm" podUID="6c101a17-a051-4e9d-a9dd-f72c67ba2a8a"
Jul 17 17:56:57.836202 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:57.836034    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kkl4n\" (UID: \"dcf5ab59-2a15-44b3-84b7-3f6facab15b9\") " pod="openshift-insights/insights-runtime-extractor-kkl4n"
Jul 17 17:56:57.836202 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:57.836080    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kkl4n\" (UID: \"dcf5ab59-2a15-44b3-84b7-3f6facab15b9\") " pod="openshift-insights/insights-runtime-extractor-kkl4n"
Jul 17 17:56:57.836487 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:57.836221    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 17:56:57.836487 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:57.836249    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 17:56:57.836487 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:57.836285    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-insights-runtime-extractor-tls podName:dcf5ab59-2a15-44b3-84b7-3f6facab15b9 nodeName:}" failed. No retries permitted until 2026-07-17 17:56:58.836265965 +0000 UTC m=+46.061495255 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kkl4n" (UID: "dcf5ab59-2a15-44b3-84b7-3f6facab15b9") : secret "insights-runtime-extractor-tls" not found
Jul 17 17:56:57.836487 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:57.836319    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-kube-rbac-proxy-cm podName:dcf5ab59-2a15-44b3-84b7-3f6facab15b9 nodeName:}" failed. No retries permitted until 2026-07-17 17:56:58.836299151 +0000 UTC m=+46.061528449 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kkl4n" (UID: "dcf5ab59-2a15-44b3-84b7-3f6facab15b9") : configmap "kube-rbac-proxy" not found
Jul 17 17:56:58.307625 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:58.307596    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rnhqt_cd3b555f-c848-4492-a111-1a007f3d469d/dns-node-resolver/0.log"
Jul 17 17:56:58.674613 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:58.674578    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qsb98" event={"ID":"d3a85848-4964-41eb-ae52-6fbca6f695fb","Type":"ContainerStarted","Data":"6f3057adb5303609f93b8074973597949c2018a6a49eb303e65154575ca71765"}
Jul 17 17:56:58.676299 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:58.676279    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tp9qm_6c101a17-a051-4e9d-a9dd-f72c67ba2a8a/console-operator/1.log"
Jul 17 17:56:58.676575 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:58.676560    2572 scope.go:117] "RemoveContainer" containerID="11370b742997b28ed24691ae953a72af04d5e562365e7f342de695d051388d34"
Jul 17 17:56:58.676721 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:58.676702    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-tp9qm_openshift-console-operator(6c101a17-a051-4e9d-a9dd-f72c67ba2a8a)\"" pod="openshift-console-operator/console-operator-565b7b569d-tp9qm" podUID="6c101a17-a051-4e9d-a9dd-f72c67ba2a8a"
Jul 17 17:56:58.701813 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:58.701756    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qsb98" podStartSLOduration=9.16061247 podStartE2EDuration="45.701736554s" totalImagesPullingTime="36.541124084s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:56:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:56:58.700339824 +0000 UTC m=+45.925569135" watchObservedRunningTime="2026-07-17 17:56:58.701736554 +0000 UTC m=+45.926965864"
Jul 17 17:56:58.823653 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:58.823610    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:56:58.846858 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:58.846820    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kkl4n\" (UID: \"dcf5ab59-2a15-44b3-84b7-3f6facab15b9\") " pod="openshift-insights/insights-runtime-extractor-kkl4n"
Jul 17 17:56:58.847062 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:58.846879    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kkl4n\" (UID: \"dcf5ab59-2a15-44b3-84b7-3f6facab15b9\") " pod="openshift-insights/insights-runtime-extractor-kkl4n"
Jul 17 17:56:58.847062 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:58.846936    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 17:56:58.847062 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:58.847020    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 17:56:58.847062 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:58.847027    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-insights-runtime-extractor-tls podName:dcf5ab59-2a15-44b3-84b7-3f6facab15b9 nodeName:}" failed. No retries permitted until 2026-07-17 17:57:00.846987143 +0000 UTC m=+48.072216442 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kkl4n" (UID: "dcf5ab59-2a15-44b3-84b7-3f6facab15b9") : secret "insights-runtime-extractor-tls" not found
Jul 17 17:56:58.847276 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:58.847078    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-kube-rbac-proxy-cm podName:dcf5ab59-2a15-44b3-84b7-3f6facab15b9 nodeName:}" failed. No retries permitted until 2026-07-17 17:57:00.84706053 +0000 UTC m=+48.072289838 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kkl4n" (UID: "dcf5ab59-2a15-44b3-84b7-3f6facab15b9") : configmap "kube-rbac-proxy" not found
Jul 17 17:56:58.924241 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:58.924121    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:56:59.006338 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:59.006293    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-tp9qm"
Jul 17 17:56:59.107969 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:59.107941    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b4t9q_1e914c47-eaed-4241-b5f8-9c3d2f0a3be8/node-ca/0.log"
Jul 17 17:56:59.678660 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:59.678635    2572 scope.go:117] "RemoveContainer" containerID="11370b742997b28ed24691ae953a72af04d5e562365e7f342de695d051388d34"
Jul 17 17:56:59.679045 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:56:59.678809    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-tp9qm_openshift-console-operator(6c101a17-a051-4e9d-a9dd-f72c67ba2a8a)\"" pod="openshift-console-operator/console-operator-565b7b569d-tp9qm" podUID="6c101a17-a051-4e9d-a9dd-f72c67ba2a8a"
Jul 17 17:56:59.906907 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:56:59.906881    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rlgvg_b62cc888-90b6-4004-ac3b-ea40641b8d41/serve-healthcheck-canary/0.log"
Jul 17 17:57:00.686083 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:00.686046    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6wzn9" event={"ID":"eb991050-0ab3-4599-823c-f9dd86d13174","Type":"ContainerStarted","Data":"1cd369fd0c3ffe96cd2546debb62aa805054b98438701430e1cdcaa75956b463"}
Jul 17 17:57:00.687714 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:00.687681    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-vr85l" event={"ID":"1b08383c-127a-450b-96de-25f3313fb0b5","Type":"ContainerStarted","Data":"ff2a0c6e6f7182f20d34695559838ccba2db91576a11ae14968e2995a5c158cf"}
Jul 17 17:57:00.689411 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:00.689368    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9wgzc" event={"ID":"75141c58-8adf-4427-80f5-3ea8a2d8081f","Type":"ContainerStarted","Data":"9d672e67cc2c95185ef23a18664f7c4bffbbbe2ac5651506542d5f97c571a71c"}
Jul 17 17:57:00.704765 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:00.704679    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6wzn9" podStartSLOduration=4.204652485 podStartE2EDuration="8.704665483s" totalImagesPullingTime="4.500012998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:56:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:57:00.703222133 +0000 UTC m=+47.928451442" watchObservedRunningTime="2026-07-17 17:57:00.704665483 +0000 UTC m=+47.929894792"
Jul 17 17:57:00.718797 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:00.718746    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7bc5b6bf85-vr85l" podStartSLOduration=3.2043525170000002 podStartE2EDuration="7.718727659s" totalImagesPullingTime="4.514375142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:56:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:57:00.718286475 +0000 UTC m=+47.943515784" watchObservedRunningTime="2026-07-17 17:57:00.718727659 +0000 UTC m=+47.943956968"
Jul 17 17:57:00.742273 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:00.742211    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9wgzc" podStartSLOduration=1.758467885 podStartE2EDuration="5.742188533s" totalImagesPullingTime="3.983720648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:56:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:57:00.739257665 +0000 UTC m=+47.964486975" watchObservedRunningTime="2026-07-17 17:57:00.742188533 +0000 UTC m=+47.967417842"
Jul 17 17:57:00.868014 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:00.867950    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kkl4n\" (UID: \"dcf5ab59-2a15-44b3-84b7-3f6facab15b9\") " pod="openshift-insights/insights-runtime-extractor-kkl4n"
Jul 17 17:57:00.868219 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:00.868027    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kkl4n\" (UID: \"dcf5ab59-2a15-44b3-84b7-3f6facab15b9\") " pod="openshift-insights/insights-runtime-extractor-kkl4n"
Jul 17 17:57:00.868219 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:57:00.868130    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 17:57:00.868219 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:57:00.868165    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 17:57:00.868219 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:57:00.868219    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-insights-runtime-extractor-tls podName:dcf5ab59-2a15-44b3-84b7-3f6facab15b9 nodeName:}" failed. No retries permitted until 2026-07-17 17:57:04.868197604 +0000 UTC m=+52.093426897 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kkl4n" (UID: "dcf5ab59-2a15-44b3-84b7-3f6facab15b9") : secret "insights-runtime-extractor-tls" not found
Jul 17 17:57:00.868382 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:57:00.868241    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-kube-rbac-proxy-cm podName:dcf5ab59-2a15-44b3-84b7-3f6facab15b9 nodeName:}" failed. No retries permitted until 2026-07-17 17:57:04.868230478 +0000 UTC m=+52.093459767 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kkl4n" (UID: "dcf5ab59-2a15-44b3-84b7-3f6facab15b9") : configmap "kube-rbac-proxy" not found
Jul 17 17:57:01.543343 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:01.543300    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:01.608850 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:01.608808    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:01.959728 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:01.959695    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:01.987417 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:01.987383    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5559d"]
Jul 17 17:57:02.020632 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:02.020595    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5559d"]
Jul 17 17:57:02.020810 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:02.020735    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5559d"
Jul 17 17:57:02.023710 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:02.023679    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 17 17:57:02.023911 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:02.023689    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 17 17:57:02.025795 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:02.025773    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-mr4vf\""
Jul 17 17:57:02.041144 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:02.041116    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:02.078422 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:02.078389    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7qb6\" (UniqueName: \"kubernetes.io/projected/dfb8bc21-ba4d-4c3d-8cce-ecf7214666c2-kube-api-access-c7qb6\") pod \"migrator-7cc9c7ffd7-5559d\" (UID: \"dfb8bc21-ba4d-4c3d-8cce-ecf7214666c2\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5559d"
Jul 17 17:57:02.101327 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:02.101291    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:02.179930 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:02.179888    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7qb6\" (UniqueName: \"kubernetes.io/projected/dfb8bc21-ba4d-4c3d-8cce-ecf7214666c2-kube-api-access-c7qb6\") pod \"migrator-7cc9c7ffd7-5559d\" (UID: \"dfb8bc21-ba4d-4c3d-8cce-ecf7214666c2\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5559d"
Jul 17 17:57:02.189696 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:02.189661    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7qb6\" (UniqueName: \"kubernetes.io/projected/dfb8bc21-ba4d-4c3d-8cce-ecf7214666c2-kube-api-access-c7qb6\") pod \"migrator-7cc9c7ffd7-5559d\" (UID: \"dfb8bc21-ba4d-4c3d-8cce-ecf7214666c2\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5559d"
Jul 17 17:57:02.252156 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:02.252073    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:02.312426 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:02.312385    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:02.331345 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:02.331313    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5559d"
Jul 17 17:57:02.475951 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:02.475661    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5559d"]
Jul 17 17:57:02.480509 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:57:02.480486    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfb8bc21_ba4d_4c3d_8cce_ecf7214666c2.slice/crio-b5a9008cc82d15bc7b7a2f87d0876f2daac7416fc38925d3a4aa80895c51a566 WatchSource:0}: Error finding container b5a9008cc82d15bc7b7a2f87d0876f2daac7416fc38925d3a4aa80895c51a566: Status 404 returned error can't find the container with id b5a9008cc82d15bc7b7a2f87d0876f2daac7416fc38925d3a4aa80895c51a566
Jul 17 17:57:02.698121 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:02.698087    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5559d" event={"ID":"dfb8bc21-ba4d-4c3d-8cce-ecf7214666c2","Type":"ContainerStarted","Data":"b5a9008cc82d15bc7b7a2f87d0876f2daac7416fc38925d3a4aa80895c51a566"}
Jul 17 17:57:03.837474 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:03.837437    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-4lgqb"]
Jul 17 17:57:03.841098 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:03.841071    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-4lgqb"
Jul 17 17:57:03.843719 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:03.843588    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 17 17:57:03.843719 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:03.843613    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 17 17:57:03.843719 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:03.843707    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-qdjr6\""
Jul 17 17:57:03.844603 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:03.844586    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 17 17:57:03.844736 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:03.844713    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 17 17:57:03.851402 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:03.851374    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-4lgqb"]
Jul 17 17:57:03.873075 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:03.873036    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:03.896801 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:03.896771    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c4e36946-7064-416e-9986-c5401af55d8b-signing-cabundle\") pod \"service-ca-58598695f7-4lgqb\" (UID: \"c4e36946-7064-416e-9986-c5401af55d8b\") " pod="openshift-service-ca/service-ca-58598695f7-4lgqb"
Jul 17 17:57:03.896973 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:03.896824    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c4e36946-7064-416e-9986-c5401af55d8b-signing-key\") pod \"service-ca-58598695f7-4lgqb\" (UID: \"c4e36946-7064-416e-9986-c5401af55d8b\") " pod="openshift-service-ca/service-ca-58598695f7-4lgqb"
Jul 17 17:57:03.897041 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:03.897008    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqbkj\" (UniqueName: \"kubernetes.io/projected/c4e36946-7064-416e-9986-c5401af55d8b-kube-api-access-vqbkj\") pod \"service-ca-58598695f7-4lgqb\" (UID: \"c4e36946-7064-416e-9986-c5401af55d8b\") " pod="openshift-service-ca/service-ca-58598695f7-4lgqb"
Jul 17 17:57:03.930351 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:03.930321    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:03.998493 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:03.998459    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqbkj\" (UniqueName: \"kubernetes.io/projected/c4e36946-7064-416e-9986-c5401af55d8b-kube-api-access-vqbkj\") pod \"service-ca-58598695f7-4lgqb\" (UID: \"c4e36946-7064-416e-9986-c5401af55d8b\") " pod="openshift-service-ca/service-ca-58598695f7-4lgqb"
Jul 17 17:57:03.998654 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:03.998593    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c4e36946-7064-416e-9986-c5401af55d8b-signing-cabundle\") pod \"service-ca-58598695f7-4lgqb\" (UID: \"c4e36946-7064-416e-9986-c5401af55d8b\") " pod="openshift-service-ca/service-ca-58598695f7-4lgqb"
Jul 17 17:57:03.998654 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:03.998634    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c4e36946-7064-416e-9986-c5401af55d8b-signing-key\") pod \"service-ca-58598695f7-4lgqb\" (UID: \"c4e36946-7064-416e-9986-c5401af55d8b\") " pod="openshift-service-ca/service-ca-58598695f7-4lgqb"
Jul 17 17:57:03.999456 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:03.999434    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c4e36946-7064-416e-9986-c5401af55d8b-signing-cabundle\") pod \"service-ca-58598695f7-4lgqb\" (UID: \"c4e36946-7064-416e-9986-c5401af55d8b\") " pod="openshift-service-ca/service-ca-58598695f7-4lgqb"
Jul 17 17:57:04.002040 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:04.001872    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c4e36946-7064-416e-9986-c5401af55d8b-signing-key\") pod \"service-ca-58598695f7-4lgqb\" (UID: \"c4e36946-7064-416e-9986-c5401af55d8b\") " pod="openshift-service-ca/service-ca-58598695f7-4lgqb"
Jul 17 17:57:04.006300 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:04.006281    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqbkj\" (UniqueName: \"kubernetes.io/projected/c4e36946-7064-416e-9986-c5401af55d8b-kube-api-access-vqbkj\") pod \"service-ca-58598695f7-4lgqb\" (UID: \"c4e36946-7064-416e-9986-c5401af55d8b\") " pod="openshift-service-ca/service-ca-58598695f7-4lgqb"
Jul 17 17:57:04.152503 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:04.152463    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-4lgqb"
Jul 17 17:57:04.279517 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:04.279479    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-4lgqb"]
Jul 17 17:57:04.282180 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:57:04.282151    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4e36946_7064_416e_9986_c5401af55d8b.slice/crio-84d79fef50b9cc36728000741d9f038e9eae518c15debd8c95e784369bbef274 WatchSource:0}: Error finding container 84d79fef50b9cc36728000741d9f038e9eae518c15debd8c95e784369bbef274: Status 404 returned error can't find the container with id 84d79fef50b9cc36728000741d9f038e9eae518c15debd8c95e784369bbef274
Jul 17 17:57:04.503523 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:04.503483    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-registry-tls\") pod \"image-registry-655959c9dc-dc87g\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") " pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:57:04.503523 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:04.503523    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/64492602-a837-4470-a8e1-0dba2157232d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-724gg\" (UID: \"64492602-a837-4470-a8e1-0dba2157232d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-724gg"
Jul 17 17:57:04.503744 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:57:04.503676    2572 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 17 17:57:04.503744 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:57:04.503701    2572 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-655959c9dc-dc87g: secret "image-registry-tls" not found
Jul 17 17:57:04.503820 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:57:04.503767    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-registry-tls podName:61298aa5-416d-4864-a479-762a86580bc9 nodeName:}" failed. No retries permitted until 2026-07-17 17:57:20.503747081 +0000 UTC m=+67.728976371 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-registry-tls") pod "image-registry-655959c9dc-dc87g" (UID: "61298aa5-416d-4864-a479-762a86580bc9") : secret "image-registry-tls" not found
Jul 17 17:57:04.503820 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:57:04.503797    2572 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 17 17:57:04.503901 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:57:04.503860    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64492602-a837-4470-a8e1-0dba2157232d-cluster-monitoring-operator-tls podName:64492602-a837-4470-a8e1-0dba2157232d nodeName:}" failed. No retries permitted until 2026-07-17 17:57:20.503844933 +0000 UTC m=+67.729074236 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/64492602-a837-4470-a8e1-0dba2157232d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-76cf8966f8-724gg" (UID: "64492602-a837-4470-a8e1-0dba2157232d") : secret "cluster-monitoring-operator-tls" not found
Jul 17 17:57:04.605221 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:04.605123    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a940a062-485b-4183-91ea-b6c674362b0a-metrics-certs\") pod \"router-default-66554f4bf4-w2s2r\" (UID: \"a940a062-485b-4183-91ea-b6c674362b0a\") " pod="openshift-ingress/router-default-66554f4bf4-w2s2r"
Jul 17 17:57:04.605221 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:04.605191    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a940a062-485b-4183-91ea-b6c674362b0a-service-ca-bundle\") pod \"router-default-66554f4bf4-w2s2r\" (UID: \"a940a062-485b-4183-91ea-b6c674362b0a\") " pod="openshift-ingress/router-default-66554f4bf4-w2s2r"
Jul 17 17:57:04.605469 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:57:04.605287    2572 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 17 17:57:04.605469 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:57:04.605309    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a940a062-485b-4183-91ea-b6c674362b0a-service-ca-bundle podName:a940a062-485b-4183-91ea-b6c674362b0a nodeName:}" failed. No retries permitted until 2026-07-17 17:57:20.605292564 +0000 UTC m=+67.830521854 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/a940a062-485b-4183-91ea-b6c674362b0a-service-ca-bundle") pod "router-default-66554f4bf4-w2s2r" (UID: "a940a062-485b-4183-91ea-b6c674362b0a") : configmap references non-existent config key: service-ca.crt
Jul 17 17:57:04.605469 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:57:04.605349    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a940a062-485b-4183-91ea-b6c674362b0a-metrics-certs podName:a940a062-485b-4183-91ea-b6c674362b0a nodeName:}" failed. No retries permitted until 2026-07-17 17:57:20.605333898 +0000 UTC m=+67.830563184 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a940a062-485b-4183-91ea-b6c674362b0a-metrics-certs") pod "router-default-66554f4bf4-w2s2r" (UID: "a940a062-485b-4183-91ea-b6c674362b0a") : secret "router-metrics-certs-default" not found
Jul 17 17:57:04.605469 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:04.605289    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-j829s\" (UID: \"3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j829s"
Jul 17 17:57:04.605469 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:04.605397    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51fe56fe-81e6-4151-99cc-4bc2192ef182-metrics-tls\") pod \"dns-default-r5w6h\" (UID: \"51fe56fe-81e6-4151-99cc-4bc2192ef182\") " pod="openshift-dns/dns-default-r5w6h"
Jul 17 17:57:04.605469 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:57:04.605362    2572 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 17 17:57:04.605705 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:57:04.605476    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69-samples-operator-tls podName:3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69 nodeName:}" failed. No retries permitted until 2026-07-17 17:57:20.605465492 +0000 UTC m=+67.830694781 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69-samples-operator-tls") pod "cluster-samples-operator-79b7c55f87-j829s" (UID: "3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69") : secret "samples-operator-tls" not found
Jul 17 17:57:04.605705 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:57:04.605502    2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 17 17:57:04.605705 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:57:04.605547    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51fe56fe-81e6-4151-99cc-4bc2192ef182-metrics-tls podName:51fe56fe-81e6-4151-99cc-4bc2192ef182 nodeName:}" failed. No retries permitted until 2026-07-17 17:57:20.605535724 +0000 UTC m=+67.830765016 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/51fe56fe-81e6-4151-99cc-4bc2192ef182-metrics-tls") pod "dns-default-r5w6h" (UID: "51fe56fe-81e6-4151-99cc-4bc2192ef182") : secret "dns-default-metrics-tls" not found
Jul 17 17:57:04.707981 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:04.707940    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-4lgqb" event={"ID":"c4e36946-7064-416e-9986-c5401af55d8b","Type":"ContainerStarted","Data":"65d72c09ac66402600fb00f9af2d11f168b285964e6b2f8cb0014d36f41df0c4"}
Jul 17 17:57:04.708173 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:04.708018    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-4lgqb" event={"ID":"c4e36946-7064-416e-9986-c5401af55d8b","Type":"ContainerStarted","Data":"84d79fef50b9cc36728000741d9f038e9eae518c15debd8c95e784369bbef274"}
Jul 17 17:57:04.709691 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:04.709663    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5559d" event={"ID":"dfb8bc21-ba4d-4c3d-8cce-ecf7214666c2","Type":"ContainerStarted","Data":"0411e4e454a7606bb324a1a342602a4763c221529da3c0f8d9524095a7203c6c"}
Jul 17 17:57:04.709828 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:04.709705    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5559d" event={"ID":"dfb8bc21-ba4d-4c3d-8cce-ecf7214666c2","Type":"ContainerStarted","Data":"9eb39200a5ae7f2a4e1e6f4b57f7da1b23a6bbbff5069c697f0fe94f5ec4a425"}
Jul 17 17:57:04.724805 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:04.724752    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-4lgqb" podStartSLOduration=1.724735898 podStartE2EDuration="1.724735898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:57:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:57:04.723813043 +0000 UTC m=+51.949042352" watchObservedRunningTime="2026-07-17 17:57:04.724735898 +0000 UTC m=+51.949965188"
Jul 17 17:57:04.741043 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:04.740972    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-5559d" podStartSLOduration=2.248925231 podStartE2EDuration="3.740957843s" totalImagesPullingTime="1.492032612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:57:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:57:04.73968401 +0000 UTC m=+51.964913317" watchObservedRunningTime="2026-07-17 17:57:04.740957843 +0000 UTC m=+51.966187152"
Jul 17 17:57:04.874853 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:04.874762    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:04.908234 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:04.908191    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kkl4n\" (UID: \"dcf5ab59-2a15-44b3-84b7-3f6facab15b9\") " pod="openshift-insights/insights-runtime-extractor-kkl4n"
Jul 17 17:57:04.908234 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:04.908236    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kkl4n\" (UID: \"dcf5ab59-2a15-44b3-84b7-3f6facab15b9\") " pod="openshift-insights/insights-runtime-extractor-kkl4n"
Jul 17 17:57:04.908461 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:57:04.908373    2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 17 17:57:04.908461 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:57:04.908425    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-insights-runtime-extractor-tls podName:dcf5ab59-2a15-44b3-84b7-3f6facab15b9 nodeName:}" failed. No retries permitted until 2026-07-17 17:57:12.908409724 +0000 UTC m=+60.133639017 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kkl4n" (UID: "dcf5ab59-2a15-44b3-84b7-3f6facab15b9") : secret "insights-runtime-extractor-tls" not found
Jul 17 17:57:04.908572 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:57:04.908459    2572 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 17 17:57:04.908572 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:57:04.908532    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-kube-rbac-proxy-cm podName:dcf5ab59-2a15-44b3-84b7-3f6facab15b9 nodeName:}" failed. No retries permitted until 2026-07-17 17:57:12.908513933 +0000 UTC m=+60.133743232 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kkl4n" (UID: "dcf5ab59-2a15-44b3-84b7-3f6facab15b9") : configmap "kube-rbac-proxy" not found
Jul 17 17:57:05.170602 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:05.170483    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:05.290263 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:05.289981    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:05.390833 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:05.390790    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:05.491776 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:05.491741    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:05.606184 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:05.606145    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:05.639045 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:05.638989    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-tp9qm"
Jul 17 17:57:05.639488 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:05.639474    2572 scope.go:117] "RemoveContainer" containerID="11370b742997b28ed24691ae953a72af04d5e562365e7f342de695d051388d34"
Jul 17 17:57:05.639684 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:57:05.639661    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-565b7b569d-tp9qm_openshift-console-operator(6c101a17-a051-4e9d-a9dd-f72c67ba2a8a)\"" pod="openshift-console-operator/console-operator-565b7b569d-tp9qm" podUID="6c101a17-a051-4e9d-a9dd-f72c67ba2a8a"
Jul 17 17:57:05.692418 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:05.692376    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:05.792440 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:05.792324    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:06.385773 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:06.385735    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:06.993292 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:06.993255    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:07.191299 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:07.191268    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:07.579414 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:07.579384    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:07.795210 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:07.795177    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:08.192362 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:08.192318    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:08.291866 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:08.291820    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:08.391335 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:08.391300    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:08.983516 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:08.983480    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:09.036408 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:09.036371    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:09.387018 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:09.386909    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:09.600884 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:09.600850    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:09.706693 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:09.706660    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:09.810185 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:09.810144    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:09.875337 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:09.875305    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:09.984506 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:09.984414    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:10.993041 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:10.992987    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:11.092251 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:11.092221    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:11.194165 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:11.194133    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:11.379458 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:11.379376    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:11.594335 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:11.594302    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:11.650498 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:11.650412    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:11.788293 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:11.788256    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:11.990402 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:11.990360    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:12.982514 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:12.982476    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kkl4n\" (UID: \"dcf5ab59-2a15-44b3-84b7-3f6facab15b9\") " pod="openshift-insights/insights-runtime-extractor-kkl4n"
Jul 17 17:57:12.982514 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:12.982518    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kkl4n\" (UID: \"dcf5ab59-2a15-44b3-84b7-3f6facab15b9\") " pod="openshift-insights/insights-runtime-extractor-kkl4n"
Jul 17 17:57:12.983133 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:12.983113    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kkl4n\" (UID: \"dcf5ab59-2a15-44b3-84b7-3f6facab15b9\") " pod="openshift-insights/insights-runtime-extractor-kkl4n"
Jul 17 17:57:12.983382 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:12.983354    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:12.986235 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:12.986216    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/dcf5ab59-2a15-44b3-84b7-3f6facab15b9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kkl4n\" (UID: \"dcf5ab59-2a15-44b3-84b7-3f6facab15b9\") " pod="openshift-insights/insights-runtime-extractor-kkl4n"
Jul 17 17:57:13.045616 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:13.045579    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kkl4n"
Jul 17 17:57:13.180451 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:13.180427    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kkl4n"]
Jul 17 17:57:13.184338 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:57:13.183190    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcf5ab59_2a15_44b3_84b7_3f6facab15b9.slice/crio-79f1c3e331181b593ac78e6757373247a394a4786bfa755ef2725cccac254efc WatchSource:0}: Error finding container 79f1c3e331181b593ac78e6757373247a394a4786bfa755ef2725cccac254efc: Status 404 returned error can't find the container with id 79f1c3e331181b593ac78e6757373247a394a4786bfa755ef2725cccac254efc
Jul 17 17:57:13.377170 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:13.377084    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:13.607072 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:13.607036    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:13.742818 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:13.742728    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kkl4n" event={"ID":"dcf5ab59-2a15-44b3-84b7-3f6facab15b9","Type":"ContainerStarted","Data":"79f1c3e331181b593ac78e6757373247a394a4786bfa755ef2725cccac254efc"}
Jul 17 17:57:13.785632 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:13.785492    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:13.982888 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:13.982842    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:14.602108 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:14.602077    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v5mdx"
Jul 17 17:57:14.984841 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:14.984799    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:15.180401 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:15.180354    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:15.388406 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:15.388313    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:15.799935 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:15.799894    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:16.059399 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:16.059304    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:16.699062 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:16.699024    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:18.132728 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:18.132691    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6deaf47f-3310-4d3e-825c-4b85347ad01e-metrics-certs\") pod \"network-metrics-daemon-mxdhr\" (UID: \"6deaf47f-3310-4d3e-825c-4b85347ad01e\") " pod="openshift-multus/network-metrics-daemon-mxdhr"
Jul 17 17:57:18.135570 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:18.135544    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 17 17:57:18.146150 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:18.146125    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6deaf47f-3310-4d3e-825c-4b85347ad01e-metrics-certs\") pod \"network-metrics-daemon-mxdhr\" (UID: \"6deaf47f-3310-4d3e-825c-4b85347ad01e\") " pod="openshift-multus/network-metrics-daemon-mxdhr"
Jul 17 17:57:18.233305 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:18.233272    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7403c99b-bdb6-4595-916c-b4b8d138f4d0-original-pull-secret\") pod \"global-pull-secret-syncer-ldrq9\" (UID: \"7403c99b-bdb6-4595-916c-b4b8d138f4d0\") " pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:57:18.233457 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:18.233382    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhhsg\" (UniqueName: \"kubernetes.io/projected/d66f36e8-45f4-457e-b26e-44455cc4a850-kube-api-access-fhhsg\") pod \"network-check-target-sz5w2\" (UID: \"d66f36e8-45f4-457e-b26e-44455cc4a850\") " pod="openshift-network-diagnostics/network-check-target-sz5w2"
Jul 17 17:57:18.235768 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:18.235747    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhhsg\" (UniqueName: \"kubernetes.io/projected/d66f36e8-45f4-457e-b26e-44455cc4a850-kube-api-access-fhhsg\") pod \"network-check-target-sz5w2\" (UID: \"d66f36e8-45f4-457e-b26e-44455cc4a850\") " pod="openshift-network-diagnostics/network-check-target-sz5w2"
Jul 17 17:57:18.236063 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:18.236044    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 17 17:57:18.246135 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:18.246110    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7403c99b-bdb6-4595-916c-b4b8d138f4d0-original-pull-secret\") pod \"global-pull-secret-syncer-ldrq9\" (UID: \"7403c99b-bdb6-4595-916c-b4b8d138f4d0\") " pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:57:18.279008 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:18.278967    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dn68c\""
Jul 17 17:57:18.287209 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:18.287192    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mxdhr"
Jul 17 17:57:18.384736 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:18.384672    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ldrq9"
Jul 17 17:57:18.395861 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:18.395798    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jb7qg\""
Jul 17 17:57:18.403825 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:18.403799    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-sz5w2"
Jul 17 17:57:18.420588 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:18.420549    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mxdhr"]
Jul 17 17:57:18.422627 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:57:18.422590    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6deaf47f_3310_4d3e_825c_4b85347ad01e.slice/crio-02a5fa69a7cfabd4ecda89754ab71a4d096ba76b346e12307b4cbd075f366f6a WatchSource:0}: Error finding container 02a5fa69a7cfabd4ecda89754ab71a4d096ba76b346e12307b4cbd075f366f6a: Status 404 returned error can't find the container with id 02a5fa69a7cfabd4ecda89754ab71a4d096ba76b346e12307b4cbd075f366f6a
Jul 17 17:57:18.540705 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:18.540677    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ldrq9"]
Jul 17 17:57:18.544157 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:57:18.544127    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7403c99b_bdb6_4595_916c_b4b8d138f4d0.slice/crio-16a5050b47d48b54ea15dfc311b2df9157d42ebc32f9fc0d36915fb420af1c4e WatchSource:0}: Error finding container 16a5050b47d48b54ea15dfc311b2df9157d42ebc32f9fc0d36915fb420af1c4e: Status 404 returned error can't find the container with id 16a5050b47d48b54ea15dfc311b2df9157d42ebc32f9fc0d36915fb420af1c4e
Jul 17 17:57:18.558688 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:18.558656    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-sz5w2"]
Jul 17 17:57:18.562485 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:57:18.562457    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd66f36e8_45f4_457e_b26e_44455cc4a850.slice/crio-fc5ce58e679b0303cca771aa5679a2caa8bc4077a120c4aa8f8315261dfdea2f WatchSource:0}: Error finding container fc5ce58e679b0303cca771aa5679a2caa8bc4077a120c4aa8f8315261dfdea2f: Status 404 returned error can't find the container with id fc5ce58e679b0303cca771aa5679a2caa8bc4077a120c4aa8f8315261dfdea2f
Jul 17 17:57:18.763153 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:18.763116    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ldrq9" event={"ID":"7403c99b-bdb6-4595-916c-b4b8d138f4d0","Type":"ContainerStarted","Data":"16a5050b47d48b54ea15dfc311b2df9157d42ebc32f9fc0d36915fb420af1c4e"}
Jul 17 17:57:18.764596 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:18.764570    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kkl4n" event={"ID":"dcf5ab59-2a15-44b3-84b7-3f6facab15b9","Type":"ContainerStarted","Data":"92799baa599f584334229a7ea65ef5c8d827765da4902b3e53fe4eb8b4a56945"}
Jul 17 17:57:18.765780 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:18.765751    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mxdhr" event={"ID":"6deaf47f-3310-4d3e-825c-4b85347ad01e","Type":"ContainerStarted","Data":"02a5fa69a7cfabd4ecda89754ab71a4d096ba76b346e12307b4cbd075f366f6a"}
Jul 17 17:57:18.767075 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:18.767050    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sz5w2" event={"ID":"d66f36e8-45f4-457e-b26e-44455cc4a850","Type":"ContainerStarted","Data":"357740a2259828f01d292d424c17be355578fcfad5540a44879af49135290d1b"}
Jul 17 17:57:18.767163 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:18.767087    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-sz5w2" event={"ID":"d66f36e8-45f4-457e-b26e-44455cc4a850","Type":"ContainerStarted","Data":"fc5ce58e679b0303cca771aa5679a2caa8bc4077a120c4aa8f8315261dfdea2f"}
Jul 17 17:57:18.767213 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:18.767178    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-sz5w2"
Jul 17 17:57:18.782731 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:18.782691    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-sz5w2" podStartSLOduration=65.782676528 podStartE2EDuration="1m5.782676528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:56:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:57:18.781507152 +0000 UTC m=+66.006736463" watchObservedRunningTime="2026-07-17 17:57:18.782676528 +0000 UTC m=+66.007905835"
Jul 17 17:57:18.988764 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:57:18.988720    2572 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" image="quay.io/openshift/origin-insights-runtime-exporter:latest"
Jul 17 17:57:18.988939 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:57:18.988863    2572 kuberuntime_manager.go:1459] "Unhandled Error" err="container exporter start failed in pod insights-runtime-extractor-kkl4n_openshift-insights(dcf5ab59-2a15-44b3-84b7-3f6facab15b9): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" logger="UnhandledError"
Jul 17 17:57:20.465644 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:20.465615    2572 scope.go:117] "RemoveContainer" containerID="11370b742997b28ed24691ae953a72af04d5e562365e7f342de695d051388d34"
Jul 17 17:57:20.554722 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:20.554690    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-registry-tls\") pod \"image-registry-655959c9dc-dc87g\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") " pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:57:20.554874 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:20.554742    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/64492602-a837-4470-a8e1-0dba2157232d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-724gg\" (UID: \"64492602-a837-4470-a8e1-0dba2157232d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-724gg"
Jul 17 17:57:20.560710 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:20.560639    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-registry-tls\") pod \"image-registry-655959c9dc-dc87g\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") " pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:57:20.567881 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:20.567826    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/64492602-a837-4470-a8e1-0dba2157232d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-76cf8966f8-724gg\" (UID: \"64492602-a837-4470-a8e1-0dba2157232d\") " pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-724gg"
Jul 17 17:57:20.655296 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:20.655261    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-j829s\" (UID: \"3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j829s"
Jul 17 17:57:20.655453 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:20.655312    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51fe56fe-81e6-4151-99cc-4bc2192ef182-metrics-tls\") pod \"dns-default-r5w6h\" (UID: \"51fe56fe-81e6-4151-99cc-4bc2192ef182\") " pod="openshift-dns/dns-default-r5w6h"
Jul 17 17:57:20.655453 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:20.655343    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a940a062-485b-4183-91ea-b6c674362b0a-metrics-certs\") pod \"router-default-66554f4bf4-w2s2r\" (UID: \"a940a062-485b-4183-91ea-b6c674362b0a\") " pod="openshift-ingress/router-default-66554f4bf4-w2s2r"
Jul 17 17:57:20.655453 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:20.655430    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a940a062-485b-4183-91ea-b6c674362b0a-service-ca-bundle\") pod \"router-default-66554f4bf4-w2s2r\" (UID: \"a940a062-485b-4183-91ea-b6c674362b0a\") " pod="openshift-ingress/router-default-66554f4bf4-w2s2r"
Jul 17 17:57:20.657564 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:20.656144    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a940a062-485b-4183-91ea-b6c674362b0a-service-ca-bundle\") pod \"router-default-66554f4bf4-w2s2r\" (UID: \"a940a062-485b-4183-91ea-b6c674362b0a\") " pod="openshift-ingress/router-default-66554f4bf4-w2s2r"
Jul 17 17:57:20.660581 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:20.660537    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a940a062-485b-4183-91ea-b6c674362b0a-metrics-certs\") pod \"router-default-66554f4bf4-w2s2r\" (UID: \"a940a062-485b-4183-91ea-b6c674362b0a\") " pod="openshift-ingress/router-default-66554f4bf4-w2s2r"
Jul 17 17:57:20.661116 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:20.661057    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/51fe56fe-81e6-4151-99cc-4bc2192ef182-metrics-tls\") pod \"dns-default-r5w6h\" (UID: \"51fe56fe-81e6-4151-99cc-4bc2192ef182\") " pod="openshift-dns/dns-default-r5w6h"
Jul 17 17:57:20.661629 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:20.661607    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69-samples-operator-tls\") pod \"cluster-samples-operator-79b7c55f87-j829s\" (UID: \"3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j829s"
Jul 17 17:57:20.718792 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:20.718525    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-c22cb\""
Jul 17 17:57:20.726858 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:20.726541    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:57:20.731840 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:20.731806    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-s5mz4\""
Jul 17 17:57:20.739744 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:20.739718    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-724gg"
Jul 17 17:57:20.774064 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:20.773831    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-pndnk\""
Jul 17 17:57:20.784799 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:20.780394    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tp9qm_6c101a17-a051-4e9d-a9dd-f72c67ba2a8a/console-operator/2.log"
Jul 17 17:57:20.784799 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:20.780950    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tp9qm_6c101a17-a051-4e9d-a9dd-f72c67ba2a8a/console-operator/1.log"
Jul 17 17:57:20.784799 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:20.780981    2572 generic.go:356] "Generic (PLEG): container finished" podID="6c101a17-a051-4e9d-a9dd-f72c67ba2a8a" containerID="22fc32a0bc719f2180f74da10a1466af544128b4e42297dbc3350563cb38b016" exitCode=255
Jul 17 17:57:20.784799 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:20.781122    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-tp9qm" event={"ID":"6c101a17-a051-4e9d-a9dd-f72c67ba2a8a","Type":"ContainerDied","Data":"22fc32a0bc719f2180f74da10a1466af544128b4e42297dbc3350563cb38b016"}
Jul 17 17:57:20.784799 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:20.781215    2572 scope.go:117] "RemoveContainer" containerID="11370b742997b28ed24691ae953a72af04d5e562365e7f342de695d051388d34"
Jul 17 17:57:20.784799 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:20.781601    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-66554f4bf4-w2s2r"
Jul 17 17:57:20.784799 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:20.781700    2572 scope.go:117] "RemoveContainer" containerID="22fc32a0bc719f2180f74da10a1466af544128b4e42297dbc3350563cb38b016"
Jul 17 17:57:20.784799 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:57:20.781939    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-tp9qm_openshift-console-operator(6c101a17-a051-4e9d-a9dd-f72c67ba2a8a)\"" pod="openshift-console-operator/console-operator-565b7b569d-tp9qm" podUID="6c101a17-a051-4e9d-a9dd-f72c67ba2a8a"
Jul 17 17:57:20.795074 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:20.794429    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mxdhr" event={"ID":"6deaf47f-3310-4d3e-825c-4b85347ad01e","Type":"ContainerStarted","Data":"db760074090a580782b6a8a963a837e6a0528a984ebfa4a78665decff5026422"}
Jul 17 17:57:20.795074 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:20.794500    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mxdhr" event={"ID":"6deaf47f-3310-4d3e-825c-4b85347ad01e","Type":"ContainerStarted","Data":"5f0ff332a23280fc8bd3e3a535f8555b3c3a216e21bb8eb5c9b51d7b24e3614c"}
Jul 17 17:57:20.820316 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:20.819957    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mxdhr" podStartSLOduration=66.384663316 podStartE2EDuration="1m7.819935747s" totalImagesPullingTime="1.435272431s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:56:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:57:20.819619044 +0000 UTC m=+68.044848352" watchObservedRunningTime="2026-07-17 17:57:20.819935747 +0000 UTC m=+68.045165057"
Jul 17 17:57:20.830529 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:20.830304    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-5kn8q\""
Jul 17 17:57:20.838577 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:20.838298    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j829s"
Jul 17 17:57:20.853242 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:20.853211    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s6gdc\""
Jul 17 17:57:20.863901 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:20.861906    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r5w6h"
Jul 17 17:57:20.926532 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:20.926150    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-76cf8966f8-724gg"]
Jul 17 17:57:20.961164 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:20.960023    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-655959c9dc-dc87g"]
Jul 17 17:57:20.967887 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:57:20.967844    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61298aa5_416d_4864_a479_762a86580bc9.slice/crio-8aef6ea6b121fa9cfe36c21f2c9ece9e3bfdbfef134a8867fe0b5a5f11a6f251 WatchSource:0}: Error finding container 8aef6ea6b121fa9cfe36c21f2c9ece9e3bfdbfef134a8867fe0b5a5f11a6f251: Status 404 returned error can't find the container with id 8aef6ea6b121fa9cfe36c21f2c9ece9e3bfdbfef134a8867fe0b5a5f11a6f251
Jul 17 17:57:21.030310 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:21.030235    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-66554f4bf4-w2s2r"]
Jul 17 17:57:21.046375 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:57:21.046337    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda940a062_485b_4183_91ea_b6c674362b0a.slice/crio-f457b6740c03f5ebbbbad9f577f6d0ebfe10322ac711edf9faae2834df5a2455 WatchSource:0}: Error finding container f457b6740c03f5ebbbbad9f577f6d0ebfe10322ac711edf9faae2834df5a2455: Status 404 returned error can't find the container with id f457b6740c03f5ebbbbad9f577f6d0ebfe10322ac711edf9faae2834df5a2455
Jul 17 17:57:21.053559 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:21.053487    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j829s"]
Jul 17 17:57:21.079678 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:21.079596    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r5w6h"]
Jul 17 17:57:21.084216 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:57:21.084168    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51fe56fe_81e6_4151_99cc_4bc2192ef182.slice/crio-8990abf10dd6ddf3818453c4e2434b4362bdcb116cfd698e2a2547eb7a71f9d0 WatchSource:0}: Error finding container 8990abf10dd6ddf3818453c4e2434b4362bdcb116cfd698e2a2547eb7a71f9d0: Status 404 returned error can't find the container with id 8990abf10dd6ddf3818453c4e2434b4362bdcb116cfd698e2a2547eb7a71f9d0
Jul 17 17:57:21.801401 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:21.801339    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r5w6h" event={"ID":"51fe56fe-81e6-4151-99cc-4bc2192ef182","Type":"ContainerStarted","Data":"8990abf10dd6ddf3818453c4e2434b4362bdcb116cfd698e2a2547eb7a71f9d0"}
Jul 17 17:57:21.803913 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:21.803880    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tp9qm_6c101a17-a051-4e9d-a9dd-f72c67ba2a8a/console-operator/2.log"
Jul 17 17:57:21.805766 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:21.805698    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j829s" event={"ID":"3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69","Type":"ContainerStarted","Data":"b2e27b731a346658133be5600deb2e7dfe1823ed96decc10a7ea64cb9dffb218"}
Jul 17 17:57:21.807682 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:21.807637    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-655959c9dc-dc87g" event={"ID":"61298aa5-416d-4864-a479-762a86580bc9","Type":"ContainerStarted","Data":"c7cc9ebbf8a1ecf77d232911573e5dccad0686009ff5817d82927d3b112f515e"}
Jul 17 17:57:21.807816 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:21.807687    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:57:21.807816 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:21.807709    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-655959c9dc-dc87g" event={"ID":"61298aa5-416d-4864-a479-762a86580bc9","Type":"ContainerStarted","Data":"8aef6ea6b121fa9cfe36c21f2c9ece9e3bfdbfef134a8867fe0b5a5f11a6f251"}
Jul 17 17:57:21.810023 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:21.809972    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-66554f4bf4-w2s2r" event={"ID":"a940a062-485b-4183-91ea-b6c674362b0a","Type":"ContainerStarted","Data":"1151ed46c492c2583ca4301eb3c302ccd8fa21cbfb668ed46feb77cb0b1bc736"}
Jul 17 17:57:21.810168 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:21.810039    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-66554f4bf4-w2s2r" event={"ID":"a940a062-485b-4183-91ea-b6c674362b0a","Type":"ContainerStarted","Data":"f457b6740c03f5ebbbbad9f577f6d0ebfe10322ac711edf9faae2834df5a2455"}
Jul 17 17:57:21.812148 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:21.812091    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-724gg" event={"ID":"64492602-a837-4470-a8e1-0dba2157232d","Type":"ContainerStarted","Data":"eb5af41d8dab5a63e5a48a7b3cc53be1767e429cc548d2fcd6ff3062ddfb4b59"}
Jul 17 17:57:21.828913 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:21.828813    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-655959c9dc-dc87g" podStartSLOduration=67.828790759 podStartE2EDuration="1m7.828790759s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:56:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:57:21.828662722 +0000 UTC m=+69.053892030" watchObservedRunningTime="2026-07-17 17:57:21.828790759 +0000 UTC m=+69.054020076"
Jul 17 17:57:22.782666 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:22.782623    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-66554f4bf4-w2s2r"
Jul 17 17:57:22.785427 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:22.785400    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-66554f4bf4-w2s2r"
Jul 17 17:57:22.805811 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:22.805756    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-66554f4bf4-w2s2r" podStartSLOduration=36.805738157 podStartE2EDuration="36.805738157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:56:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:57:21.846477507 +0000 UTC m=+69.071706814" watchObservedRunningTime="2026-07-17 17:57:22.805738157 +0000 UTC m=+70.030967464"
Jul 17 17:57:22.816535 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:22.816499    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-66554f4bf4-w2s2r"
Jul 17 17:57:22.817537 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:22.817508    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-66554f4bf4-w2s2r"
Jul 17 17:57:23.651214 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:23.651108    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:23.705969 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:23.705920    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:24.618035 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:24.617979    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:24.677643 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:24.677609    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:25.638306 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:25.638273    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-tp9qm"
Jul 17 17:57:25.638688 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:25.638668    2572 scope.go:117] "RemoveContainer" containerID="22fc32a0bc719f2180f74da10a1466af544128b4e42297dbc3350563cb38b016"
Jul 17 17:57:25.638857 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:57:25.638831    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-tp9qm_openshift-console-operator(6c101a17-a051-4e9d-a9dd-f72c67ba2a8a)\"" pod="openshift-console-operator/console-operator-565b7b569d-tp9qm" podUID="6c101a17-a051-4e9d-a9dd-f72c67ba2a8a"
Jul 17 17:57:27.156802 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.156759    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55d648d9c8-h6xpk"]
Jul 17 17:57:27.302412 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.302380    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:27.323652 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.323618    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-bffcb999d-j6q9h"]
Jul 17 17:57:27.323826 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.323752    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55d648d9c8-h6xpk"
Jul 17 17:57:27.326438 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.326409    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 17 17:57:27.327589 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.327564    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 17 17:57:27.327717 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.327592    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 17 17:57:27.327717 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.327574    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-m7r8z\""
Jul 17 17:57:27.327717 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.327564    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 17 17:57:27.367884 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.367846    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cc67bd775-hlndl"]
Jul 17 17:57:27.368100 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.367979    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bffcb999d-j6q9h"
Jul 17 17:57:27.371331 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.371309    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 17 17:57:27.394477 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.394439    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:27.413082 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.412987    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh9qb\" (UniqueName: \"kubernetes.io/projected/8287fdf3-d01f-476c-ba92-e5e57348afb1-kube-api-access-xh9qb\") pod \"klusterlet-addon-workmgr-bffcb999d-j6q9h\" (UID: \"8287fdf3-d01f-476c-ba92-e5e57348afb1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bffcb999d-j6q9h"
Jul 17 17:57:27.413082 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.413039    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8287fdf3-d01f-476c-ba92-e5e57348afb1-tmp\") pod \"klusterlet-addon-workmgr-bffcb999d-j6q9h\" (UID: \"8287fdf3-d01f-476c-ba92-e5e57348afb1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bffcb999d-j6q9h"
Jul 17 17:57:27.413082 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.413059    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8287fdf3-d01f-476c-ba92-e5e57348afb1-klusterlet-config\") pod \"klusterlet-addon-workmgr-bffcb999d-j6q9h\" (UID: \"8287fdf3-d01f-476c-ba92-e5e57348afb1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bffcb999d-j6q9h"
Jul 17 17:57:27.413288 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.413090    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xwxw\" (UniqueName: \"kubernetes.io/projected/13f183ed-29eb-4e69-ba7a-64d9a974d642-kube-api-access-5xwxw\") pod \"managed-serviceaccount-addon-agent-55d648d9c8-h6xpk\" (UID: \"13f183ed-29eb-4e69-ba7a-64d9a974d642\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55d648d9c8-h6xpk"
Jul 17 17:57:27.413288 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.413111    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/13f183ed-29eb-4e69-ba7a-64d9a974d642-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55d648d9c8-h6xpk\" (UID: \"13f183ed-29eb-4e69-ba7a-64d9a974d642\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55d648d9c8-h6xpk"
Jul 17 17:57:27.413740 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.413722    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55d648d9c8-h6xpk"]
Jul 17 17:57:27.413774 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.413749    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cc67bd775-hlndl"]
Jul 17 17:57:27.413774 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.413765    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-bffcb999d-j6q9h"]
Jul 17 17:57:27.413833 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.413798    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-2bl9v"]
Jul 17 17:57:27.413957 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.413940    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cc67bd775-hlndl"
Jul 17 17:57:27.416407 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.416368    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 17 17:57:27.416651 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.416631    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 17 17:57:27.416743 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.416631    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 17 17:57:27.416743 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.416733    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 17 17:57:27.450228 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.450194    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-2bl9v"]
Jul 17 17:57:27.450375 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.450287    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-2bl9v"
Jul 17 17:57:27.452873 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.452845    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 17 17:57:27.452873 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.452867    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 17 17:57:27.453065 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.452846    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-k6xmh\""
Jul 17 17:57:27.514445 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.514415    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xwxw\" (UniqueName: \"kubernetes.io/projected/13f183ed-29eb-4e69-ba7a-64d9a974d642-kube-api-access-5xwxw\") pod \"managed-serviceaccount-addon-agent-55d648d9c8-h6xpk\" (UID: \"13f183ed-29eb-4e69-ba7a-64d9a974d642\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55d648d9c8-h6xpk"
Jul 17 17:57:27.514445 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.514454    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/13f183ed-29eb-4e69-ba7a-64d9a974d642-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55d648d9c8-h6xpk\" (UID: \"13f183ed-29eb-4e69-ba7a-64d9a974d642\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55d648d9c8-h6xpk"
Jul 17 17:57:27.514668 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.514483    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9dbae37d-620b-45a5-a903-177293265c8d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-2bl9v\" (UID: \"9dbae37d-620b-45a5-a903-177293265c8d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-2bl9v"
Jul 17 17:57:27.514668 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.514507    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b8f414a7-3a6c-454d-a269-c38678e677c1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7cc67bd775-hlndl\" (UID: \"b8f414a7-3a6c-454d-a269-c38678e677c1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cc67bd775-hlndl"
Jul 17 17:57:27.514668 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.514626    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b8f414a7-3a6c-454d-a269-c38678e677c1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7cc67bd775-hlndl\" (UID: \"b8f414a7-3a6c-454d-a269-c38678e677c1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cc67bd775-hlndl"
Jul 17 17:57:27.514668 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.514661    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b8f414a7-3a6c-454d-a269-c38678e677c1-ca\") pod \"cluster-proxy-proxy-agent-7cc67bd775-hlndl\" (UID: \"b8f414a7-3a6c-454d-a269-c38678e677c1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cc67bd775-hlndl"
Jul 17 17:57:27.514873 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.514697    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh9qb\" (UniqueName: \"kubernetes.io/projected/8287fdf3-d01f-476c-ba92-e5e57348afb1-kube-api-access-xh9qb\") pod \"klusterlet-addon-workmgr-bffcb999d-j6q9h\" (UID: \"8287fdf3-d01f-476c-ba92-e5e57348afb1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bffcb999d-j6q9h"
Jul 17 17:57:27.514873 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.514721    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9dbae37d-620b-45a5-a903-177293265c8d-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-2bl9v\" (UID: \"9dbae37d-620b-45a5-a903-177293265c8d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-2bl9v"
Jul 17 17:57:27.514873 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.514744    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8287fdf3-d01f-476c-ba92-e5e57348afb1-tmp\") pod \"klusterlet-addon-workmgr-bffcb999d-j6q9h\" (UID: \"8287fdf3-d01f-476c-ba92-e5e57348afb1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bffcb999d-j6q9h"
Jul 17 17:57:27.514873 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.514768    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8287fdf3-d01f-476c-ba92-e5e57348afb1-klusterlet-config\") pod \"klusterlet-addon-workmgr-bffcb999d-j6q9h\" (UID: \"8287fdf3-d01f-476c-ba92-e5e57348afb1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bffcb999d-j6q9h"
Jul 17 17:57:27.514873 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.514799    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b8f414a7-3a6c-454d-a269-c38678e677c1-hub\") pod \"cluster-proxy-proxy-agent-7cc67bd775-hlndl\" (UID: \"b8f414a7-3a6c-454d-a269-c38678e677c1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cc67bd775-hlndl"
Jul 17 17:57:27.514873 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.514869    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m769h\" (UniqueName: \"kubernetes.io/projected/b8f414a7-3a6c-454d-a269-c38678e677c1-kube-api-access-m769h\") pod \"cluster-proxy-proxy-agent-7cc67bd775-hlndl\" (UID: \"b8f414a7-3a6c-454d-a269-c38678e677c1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cc67bd775-hlndl"
Jul 17 17:57:27.515162 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.514900    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8f414a7-3a6c-454d-a269-c38678e677c1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7cc67bd775-hlndl\" (UID: \"b8f414a7-3a6c-454d-a269-c38678e677c1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cc67bd775-hlndl"
Jul 17 17:57:27.515381 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.515334    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8287fdf3-d01f-476c-ba92-e5e57348afb1-tmp\") pod \"klusterlet-addon-workmgr-bffcb999d-j6q9h\" (UID: \"8287fdf3-d01f-476c-ba92-e5e57348afb1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bffcb999d-j6q9h"
Jul 17 17:57:27.517587 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.517563    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8287fdf3-d01f-476c-ba92-e5e57348afb1-klusterlet-config\") pod \"klusterlet-addon-workmgr-bffcb999d-j6q9h\" (UID: \"8287fdf3-d01f-476c-ba92-e5e57348afb1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bffcb999d-j6q9h"
Jul 17 17:57:27.517694 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.517563    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/13f183ed-29eb-4e69-ba7a-64d9a974d642-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55d648d9c8-h6xpk\" (UID: \"13f183ed-29eb-4e69-ba7a-64d9a974d642\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55d648d9c8-h6xpk"
Jul 17 17:57:27.527557 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.527524    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh9qb\" (UniqueName: \"kubernetes.io/projected/8287fdf3-d01f-476c-ba92-e5e57348afb1-kube-api-access-xh9qb\") pod \"klusterlet-addon-workmgr-bffcb999d-j6q9h\" (UID: \"8287fdf3-d01f-476c-ba92-e5e57348afb1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bffcb999d-j6q9h"
Jul 17 17:57:27.527712 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.527671    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xwxw\" (UniqueName: \"kubernetes.io/projected/13f183ed-29eb-4e69-ba7a-64d9a974d642-kube-api-access-5xwxw\") pod \"managed-serviceaccount-addon-agent-55d648d9c8-h6xpk\" (UID: \"13f183ed-29eb-4e69-ba7a-64d9a974d642\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55d648d9c8-h6xpk"
Jul 17 17:57:27.529933 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.529900    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:27.615694 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.615656    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b8f414a7-3a6c-454d-a269-c38678e677c1-ca\") pod \"cluster-proxy-proxy-agent-7cc67bd775-hlndl\" (UID: \"b8f414a7-3a6c-454d-a269-c38678e677c1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cc67bd775-hlndl"
Jul 17 17:57:27.615893 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.615714    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9dbae37d-620b-45a5-a903-177293265c8d-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-2bl9v\" (UID: \"9dbae37d-620b-45a5-a903-177293265c8d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-2bl9v"
Jul 17 17:57:27.615893 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.615750    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b8f414a7-3a6c-454d-a269-c38678e677c1-hub\") pod \"cluster-proxy-proxy-agent-7cc67bd775-hlndl\" (UID: \"b8f414a7-3a6c-454d-a269-c38678e677c1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cc67bd775-hlndl"
Jul 17 17:57:27.615893 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.615771    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m769h\" (UniqueName: \"kubernetes.io/projected/b8f414a7-3a6c-454d-a269-c38678e677c1-kube-api-access-m769h\") pod \"cluster-proxy-proxy-agent-7cc67bd775-hlndl\" (UID: \"b8f414a7-3a6c-454d-a269-c38678e677c1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cc67bd775-hlndl"
Jul 17 17:57:27.615893 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.615792    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8f414a7-3a6c-454d-a269-c38678e677c1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7cc67bd775-hlndl\" (UID: \"b8f414a7-3a6c-454d-a269-c38678e677c1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cc67bd775-hlndl"
Jul 17 17:57:27.615893 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.615845    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9dbae37d-620b-45a5-a903-177293265c8d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-2bl9v\" (UID: \"9dbae37d-620b-45a5-a903-177293265c8d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-2bl9v"
Jul 17 17:57:27.615893 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.615878    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b8f414a7-3a6c-454d-a269-c38678e677c1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7cc67bd775-hlndl\" (UID: \"b8f414a7-3a6c-454d-a269-c38678e677c1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cc67bd775-hlndl"
Jul 17 17:57:27.616248 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.615908    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b8f414a7-3a6c-454d-a269-c38678e677c1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7cc67bd775-hlndl\" (UID: \"b8f414a7-3a6c-454d-a269-c38678e677c1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cc67bd775-hlndl"
Jul 17 17:57:27.616628 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.616582    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9dbae37d-620b-45a5-a903-177293265c8d-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-2bl9v\" (UID: \"9dbae37d-620b-45a5-a903-177293265c8d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-2bl9v"
Jul 17 17:57:27.616992 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.616918    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b8f414a7-3a6c-454d-a269-c38678e677c1-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7cc67bd775-hlndl\" (UID: \"b8f414a7-3a6c-454d-a269-c38678e677c1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cc67bd775-hlndl"
Jul 17 17:57:27.618753 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.618689    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b8f414a7-3a6c-454d-a269-c38678e677c1-ca\") pod \"cluster-proxy-proxy-agent-7cc67bd775-hlndl\" (UID: \"b8f414a7-3a6c-454d-a269-c38678e677c1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cc67bd775-hlndl"
Jul 17 17:57:27.618880 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.618821    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b8f414a7-3a6c-454d-a269-c38678e677c1-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7cc67bd775-hlndl\" (UID: \"b8f414a7-3a6c-454d-a269-c38678e677c1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cc67bd775-hlndl"
Jul 17 17:57:27.619031 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.618880    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9dbae37d-620b-45a5-a903-177293265c8d-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-2bl9v\" (UID: \"9dbae37d-620b-45a5-a903-177293265c8d\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-2bl9v"
Jul 17 17:57:27.619213 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.619189    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b8f414a7-3a6c-454d-a269-c38678e677c1-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7cc67bd775-hlndl\" (UID: \"b8f414a7-3a6c-454d-a269-c38678e677c1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cc67bd775-hlndl"
Jul 17 17:57:27.619611 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.619574    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b8f414a7-3a6c-454d-a269-c38678e677c1-hub\") pod \"cluster-proxy-proxy-agent-7cc67bd775-hlndl\" (UID: \"b8f414a7-3a6c-454d-a269-c38678e677c1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cc67bd775-hlndl"
Jul 17 17:57:27.624239 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.624218    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m769h\" (UniqueName: \"kubernetes.io/projected/b8f414a7-3a6c-454d-a269-c38678e677c1-kube-api-access-m769h\") pod \"cluster-proxy-proxy-agent-7cc67bd775-hlndl\" (UID: \"b8f414a7-3a6c-454d-a269-c38678e677c1\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cc67bd775-hlndl"
Jul 17 17:57:27.627913 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.627882    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:27.644581 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.644555    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55d648d9c8-h6xpk"
Jul 17 17:57:27.678801 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.678775    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bffcb999d-j6q9h"
Jul 17 17:57:27.723532 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.723493    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cc67bd775-hlndl"
Jul 17 17:57:27.779385 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:27.779351    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-2bl9v"
Jul 17 17:57:29.006442 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:29.006361    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-565b7b569d-tp9qm"
Jul 17 17:57:29.006799 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:29.006768    2572 scope.go:117] "RemoveContainer" containerID="22fc32a0bc719f2180f74da10a1466af544128b4e42297dbc3350563cb38b016"
Jul 17 17:57:29.006946 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:57:29.006926    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-565b7b569d-tp9qm_openshift-console-operator(6c101a17-a051-4e9d-a9dd-f72c67ba2a8a)\"" pod="openshift-console-operator/console-operator-565b7b569d-tp9qm" podUID="6c101a17-a051-4e9d-a9dd-f72c67ba2a8a"
Jul 17 17:57:29.948415 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:29.945711    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cc67bd775-hlndl"]
Jul 17 17:57:29.948725 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:29.948631    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-bffcb999d-j6q9h"]
Jul 17 17:57:29.961045 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:29.960630    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55d648d9c8-h6xpk"]
Jul 17 17:57:29.963730 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:57:29.962656    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8287fdf3_d01f_476c_ba92_e5e57348afb1.slice/crio-957bf8490a206ceee201f4f371a9384d97c477ff31f0190b29f0d703904677e5 WatchSource:0}: Error finding container 957bf8490a206ceee201f4f371a9384d97c477ff31f0190b29f0d703904677e5: Status 404 returned error can't find the container with id 957bf8490a206ceee201f4f371a9384d97c477ff31f0190b29f0d703904677e5
Jul 17 17:57:29.963730 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:57:29.963108    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb8f414a7_3a6c_454d_a269_c38678e677c1.slice/crio-5d95ad979c20a307e3372b2e0fb9649e2a497467076ba20ea0b66a4829f9bf17 WatchSource:0}: Error finding container 5d95ad979c20a307e3372b2e0fb9649e2a497467076ba20ea0b66a4829f9bf17: Status 404 returned error can't find the container with id 5d95ad979c20a307e3372b2e0fb9649e2a497467076ba20ea0b66a4829f9bf17
Jul 17 17:57:29.968876 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:57:29.966983    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"exporter\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="openshift-insights/insights-runtime-extractor-kkl4n" podUID="dcf5ab59-2a15-44b3-84b7-3f6facab15b9"
Jul 17 17:57:29.987057 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:29.986975    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-2bl9v"]
Jul 17 17:57:29.999103 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:57:29.999054    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dbae37d_620b_45a5_a903_177293265c8d.slice/crio-49a0193229a5cdb9ecdf4d9890dd0a7c694237dd1fedfa425bd92ea999e71d47 WatchSource:0}: Error finding container 49a0193229a5cdb9ecdf4d9890dd0a7c694237dd1fedfa425bd92ea999e71d47: Status 404 returned error can't find the container with id 49a0193229a5cdb9ecdf4d9890dd0a7c694237dd1fedfa425bd92ea999e71d47
Jul 17 17:57:30.242798 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:30.242763    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:30.345961 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:30.345873    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:30.392200 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:30.392167    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jm4nt"]
Jul 17 17:57:30.418964 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:30.418931    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jm4nt"]
Jul 17 17:57:30.419134 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:30.419090    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jm4nt"
Jul 17 17:57:30.421627 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:30.421606    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-xjr77\""
Jul 17 17:57:30.421627 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:30.421618    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 17 17:57:30.443178 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:30.443145    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:30.444031 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:30.443984    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/15418031-8434-4b11-aeec-f204858ccece-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-jm4nt\" (UID: \"15418031-8434-4b11-aeec-f204858ccece\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jm4nt"
Jul 17 17:57:30.545520 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:30.545428    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/15418031-8434-4b11-aeec-f204858ccece-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-jm4nt\" (UID: \"15418031-8434-4b11-aeec-f204858ccece\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jm4nt"
Jul 17 17:57:30.545691 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:57:30.545564    2572 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 17 17:57:30.545691 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:57:30.545649    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/15418031-8434-4b11-aeec-f204858ccece-tls-certificates podName:15418031-8434-4b11-aeec-f204858ccece nodeName:}" failed. No retries permitted until 2026-07-17 17:57:31.045625475 +0000 UTC m=+78.270854766 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/15418031-8434-4b11-aeec-f204858ccece-tls-certificates") pod "prometheus-operator-admission-webhook-85574b5f49-jm4nt" (UID: "15418031-8434-4b11-aeec-f204858ccece") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 17 17:57:30.877934 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:30.877291    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ldrq9" event={"ID":"7403c99b-bdb6-4595-916c-b4b8d138f4d0","Type":"ContainerStarted","Data":"b4655b6fa6a159f5e5bea97ab4434e184c8e78ec5bfbf954d4cf8cad3034adcd"}
Jul 17 17:57:30.879828 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:30.879798    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-724gg" event={"ID":"64492602-a837-4470-a8e1-0dba2157232d","Type":"ContainerStarted","Data":"b6e2763f58d8ea937ff15f7afeb46eddb960ab91fe5eedbf5bf0ab68138d2a2f"}
Jul 17 17:57:30.883792 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:30.883763    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r5w6h" event={"ID":"51fe56fe-81e6-4151-99cc-4bc2192ef182","Type":"ContainerStarted","Data":"4601d5e8ddc1096ef8003b57fa9f733e4fb023184a58eac4e24a6e0dc98e8ae7"}
Jul 17 17:57:30.883916 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:30.883816    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r5w6h" event={"ID":"51fe56fe-81e6-4151-99cc-4bc2192ef182","Type":"ContainerStarted","Data":"ff57f6be87e1b35dd243f6cb534e68d86366ebafcea1dc23b8d6de42ceae8181"}
Jul 17 17:57:30.884386 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:30.884365    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-r5w6h"
Jul 17 17:57:30.887334 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:30.887286    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55d648d9c8-h6xpk" event={"ID":"13f183ed-29eb-4e69-ba7a-64d9a974d642","Type":"ContainerStarted","Data":"f81427ec7032572eddafa0d87cd34a12ea4af830ff459b39e1deb1fd876d6ba9"}
Jul 17 17:57:30.892146 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:30.890781    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kkl4n" event={"ID":"dcf5ab59-2a15-44b3-84b7-3f6facab15b9","Type":"ContainerStarted","Data":"6ba11d65eaf3b8af64989cbd1e51d2da04c9ade78a28753ef73387ca26f950c2"}
Jul 17 17:57:30.899415 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:30.898728    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j829s" event={"ID":"3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69","Type":"ContainerStarted","Data":"ff5fe7099cda1c72d85bc80ecb58436a2d3db52120f5b82588972bfcc171a32a"}
Jul 17 17:57:30.899415 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:30.898788    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j829s" event={"ID":"3ce6cb97-ebd1-4bd3-a8b7-5a6c652bff69","Type":"ContainerStarted","Data":"424ddcafe543176e65f0e05f1f2bf0522780bbd4a632f2720a45606568dde3de"}
Jul 17 17:57:30.903014 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:30.902011    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-2bl9v" event={"ID":"9dbae37d-620b-45a5-a903-177293265c8d","Type":"ContainerStarted","Data":"49a0193229a5cdb9ecdf4d9890dd0a7c694237dd1fedfa425bd92ea999e71d47"}
Jul 17 17:57:30.909695 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:30.909311    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bffcb999d-j6q9h" event={"ID":"8287fdf3-d01f-476c-ba92-e5e57348afb1","Type":"ContainerStarted","Data":"957bf8490a206ceee201f4f371a9384d97c477ff31f0190b29f0d703904677e5"}
Jul 17 17:57:30.915270 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:30.915204    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cc67bd775-hlndl" event={"ID":"b8f414a7-3a6c-454d-a269-c38678e677c1","Type":"ContainerStarted","Data":"5d95ad979c20a307e3372b2e0fb9649e2a497467076ba20ea0b66a4829f9bf17"}
Jul 17 17:57:30.920783 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:30.920399    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ldrq9" podStartSLOduration=66.72727851 podStartE2EDuration="1m16.920379439s" totalImagesPullingTime="10.193100929s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:56:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:57:30.895886595 +0000 UTC m=+78.121115895" watchObservedRunningTime="2026-07-17 17:57:30.920379439 +0000 UTC m=+78.145608742"
Jul 17 17:57:30.939043 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:30.938967    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-76cf8966f8-724gg" podStartSLOduration=36.146303974 podStartE2EDuration="44.938948044s" totalImagesPullingTime="8.79264407s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:56:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:57:30.936917533 +0000 UTC m=+78.162146845" watchObservedRunningTime="2026-07-17 17:57:30.938948044 +0000 UTC m=+78.164177353"
Jul 17 17:57:30.957126 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:30.956849    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-r5w6h" podStartSLOduration=34.068532229 podStartE2EDuration="42.956828699s" totalImagesPullingTime="8.88829647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:56:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:57:30.956790537 +0000 UTC m=+78.182019846" watchObservedRunningTime="2026-07-17 17:57:30.956828699 +0000 UTC m=+78.182058008"
Jul 17 17:57:30.973891 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:30.973596    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-79b7c55f87-j829s" podStartSLOduration=35.348828495 podStartE2EDuration="43.973572661s" totalImagesPullingTime="8.624744166s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:56:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:57:30.97328937 +0000 UTC m=+78.198518683" watchObservedRunningTime="2026-07-17 17:57:30.973572661 +0000 UTC m=+78.198801970"
Jul 17 17:57:30.996509 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:30.996468    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:31.051597 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:31.051062    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/15418031-8434-4b11-aeec-f204858ccece-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-jm4nt\" (UID: \"15418031-8434-4b11-aeec-f204858ccece\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jm4nt"
Jul 17 17:57:31.074695 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:31.074660    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/15418031-8434-4b11-aeec-f204858ccece-tls-certificates\") pod \"prometheus-operator-admission-webhook-85574b5f49-jm4nt\" (UID: \"15418031-8434-4b11-aeec-f204858ccece\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jm4nt"
Jul 17 17:57:31.329058 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:31.328716    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jm4nt"
Jul 17 17:57:31.550903 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:31.550869    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jm4nt"]
Jul 17 17:57:32.382543 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:57:32.382506    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15418031_8434_4b11_aeec_f204858ccece.slice/crio-8736c0542818868e2ce008517461e4efd33fb174541fff2627d4de19dd52b24e WatchSource:0}: Error finding container 8736c0542818868e2ce008517461e4efd33fb174541fff2627d4de19dd52b24e: Status 404 returned error can't find the container with id 8736c0542818868e2ce008517461e4efd33fb174541fff2627d4de19dd52b24e
Jul 17 17:57:32.706028 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:32.705979    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:32.810865 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:32.810830    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:32.936337 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:32.936292    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jm4nt" event={"ID":"15418031-8434-4b11-aeec-f204858ccece","Type":"ContainerStarted","Data":"8736c0542818868e2ce008517461e4efd33fb174541fff2627d4de19dd52b24e"}
Jul 17 17:57:33.329732 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:33.329684    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:33.388845 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:33.388766    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:36.954463 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:36.954422    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jm4nt" event={"ID":"15418031-8434-4b11-aeec-f204858ccece","Type":"ContainerStarted","Data":"69bf8a1e1ff7119a27839869db5bd4a2cd551e5b1e2ece4657fc259cb09cb171"}
Jul 17 17:57:36.954907 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:36.954589    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jm4nt"
Jul 17 17:57:36.955977 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:36.955950    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55d648d9c8-h6xpk" event={"ID":"13f183ed-29eb-4e69-ba7a-64d9a974d642","Type":"ContainerStarted","Data":"ec2bae5e0ab13bc456133411a09d3426602666097f601c609bd9bcc1a43d5e23"}
Jul 17 17:57:36.958166 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:36.958143    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kkl4n" event={"ID":"dcf5ab59-2a15-44b3-84b7-3f6facab15b9","Type":"ContainerStarted","Data":"a00c7c336fea9244f8577cf9ee33b4f29a141e084eed8112190422fa2bf5907e"}
Jul 17 17:57:36.959706 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:36.959685    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-2bl9v" event={"ID":"9dbae37d-620b-45a5-a903-177293265c8d","Type":"ContainerStarted","Data":"2af22fc75cc73699673248f8154e24c391cdf9de4fb00eb094889f53ad22a128"}
Jul 17 17:57:36.959895 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:36.959878    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jm4nt"
Jul 17 17:57:36.961109 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:36.961089    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bffcb999d-j6q9h" event={"ID":"8287fdf3-d01f-476c-ba92-e5e57348afb1","Type":"ContainerStarted","Data":"7fad5eafb7bf1c9278c98c4def3f36bd159d90a94011f0cdc55bdb01c8b92354"}
Jul 17 17:57:36.961208 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:36.961195    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bffcb999d-j6q9h"
Jul 17 17:57:36.962754 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:36.962737    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bffcb999d-j6q9h"
Jul 17 17:57:36.963159 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:36.963142    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cc67bd775-hlndl" event={"ID":"b8f414a7-3a6c-454d-a269-c38678e677c1","Type":"ContainerStarted","Data":"43848ad86d6e8708942fe98ce74e4d57f7223f576ee7a80ab79cfa2387529d63"}
Jul 17 17:57:36.963237 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:36.963169    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cc67bd775-hlndl" event={"ID":"b8f414a7-3a6c-454d-a269-c38678e677c1","Type":"ContainerStarted","Data":"b0509bc82bc564e57ec53854eb6d7dc341385bad160b262da1ae5533e0937fe2"}
Jul 17 17:57:36.963237 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:36.963181    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cc67bd775-hlndl" event={"ID":"b8f414a7-3a6c-454d-a269-c38678e677c1","Type":"ContainerStarted","Data":"0b4b91b43f86105aa6cf84ecb6d6c4c94b62d72f89247907cbecbfcd6818dbf0"}
Jul 17 17:57:36.972311 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:36.972272    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-85574b5f49-jm4nt" podStartSLOduration=2.900873927 podStartE2EDuration="6.972260188s" totalImagesPullingTime="4.071386261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:57:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:57:36.971518209 +0000 UTC m=+84.196747517" watchObservedRunningTime="2026-07-17 17:57:36.972260188 +0000 UTC m=+84.197489493"
Jul 17 17:57:36.987469 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:36.987423    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55d648d9c8-h6xpk" podStartSLOduration=3.560216803 podStartE2EDuration="9.987410618s" totalImagesPullingTime="6.427193815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:57:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:57:36.986394444 +0000 UTC m=+84.211623753" watchObservedRunningTime="2026-07-17 17:57:36.987410618 +0000 UTC m=+84.212639926"
Jul 17 17:57:37.003147 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:37.003084    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-2bl9v" podStartSLOduration=3.61299429 podStartE2EDuration="10.003067854s" totalImagesPullingTime="6.390073564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:57:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:57:37.002837649 +0000 UTC m=+84.228066956" watchObservedRunningTime="2026-07-17 17:57:37.003067854 +0000 UTC m=+84.228297161"
Jul 17 17:57:37.022407 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:37.022354    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7cc67bd775-hlndl" podStartSLOduration=3.545964159 podStartE2EDuration="10.02233707s" totalImagesPullingTime="6.476372911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:57:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:57:37.020709514 +0000 UTC m=+84.245938823" watchObservedRunningTime="2026-07-17 17:57:37.02233707 +0000 UTC m=+84.247566355"
Jul 17 17:57:37.052235 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:37.052178    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-bffcb999d-j6q9h" podStartSLOduration=3.575826507 podStartE2EDuration="10.052162877s" totalImagesPullingTime="6.47633637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 17:57:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:57:37.050682652 +0000 UTC m=+84.275911962" watchObservedRunningTime="2026-07-17 17:57:37.052162877 +0000 UTC m=+84.277392185"
Jul 17 17:57:37.071136 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:37.071091    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kkl4n" podStartSLOduration=16.937708322 podStartE2EDuration="40.071074773s" totalImagesPullingTime="23.133366451s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 17:56:57 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-17 17:57:37.069919352 +0000 UTC m=+84.295148660" watchObservedRunningTime="2026-07-17 17:57:37.071074773 +0000 UTC m=+84.296304080"
Jul 17 17:57:37.134823 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:37.134788    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:37.193319 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:37.193284    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:37.413868 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:37.413790    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:37.514308 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:37.514273    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:38.903521 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:38.903484    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:39.003885 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:39.003846    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:39.055226 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:39.055190    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:40.700890 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:40.700842    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:40.731112 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:40.731084    2572 patch_prober.go:28] interesting pod/image-registry-655959c9dc-dc87g container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 17 17:57:40.731236 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:40.731134    2572 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-655959c9dc-dc87g" podUID="61298aa5-416d-4864-a479-762a86580bc9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 17:57:40.803318 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:40.803288    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:41.215686 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:41.215653    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:41.939290 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:41.939256    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-r5w6h"
Jul 17 17:57:42.546281 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.546241    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:42.766871 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.766805    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:42.808035 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.807917    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-f7m5g"]
Jul 17 17:57:42.812991 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.812968    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f7m5g"
Jul 17 17:57:42.816421 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.816275    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 17 17:57:42.816421 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.816301    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 17 17:57:42.816421 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.816302    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 17 17:57:42.817330 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.817209    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 17 17:57:42.817330 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.817218    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4h8ql\""
Jul 17 17:57:42.823471 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.823196    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:57:42.853980 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.853944    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4cd14467-3251-4512-9c15-3b76bce4243a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f7m5g\" (UID: \"4cd14467-3251-4512-9c15-3b76bce4243a\") " pod="openshift-monitoring/node-exporter-f7m5g"
Jul 17 17:57:42.854153 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.853981    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4cd14467-3251-4512-9c15-3b76bce4243a-root\") pod \"node-exporter-f7m5g\" (UID: \"4cd14467-3251-4512-9c15-3b76bce4243a\") " pod="openshift-monitoring/node-exporter-f7m5g"
Jul 17 17:57:42.854153 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.854030    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4cd14467-3251-4512-9c15-3b76bce4243a-node-exporter-accelerators-collector-config\") pod \"node-exporter-f7m5g\" (UID: \"4cd14467-3251-4512-9c15-3b76bce4243a\") " pod="openshift-monitoring/node-exporter-f7m5g"
Jul 17 17:57:42.854153 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.854049    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cd14467-3251-4512-9c15-3b76bce4243a-sys\") pod \"node-exporter-f7m5g\" (UID: \"4cd14467-3251-4512-9c15-3b76bce4243a\") " pod="openshift-monitoring/node-exporter-f7m5g"
Jul 17 17:57:42.854153 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.854080    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4cd14467-3251-4512-9c15-3b76bce4243a-node-exporter-wtmp\") pod \"node-exporter-f7m5g\" (UID: \"4cd14467-3251-4512-9c15-3b76bce4243a\") " pod="openshift-monitoring/node-exporter-f7m5g"
Jul 17 17:57:42.854153 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.854103    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtqhj\" (UniqueName: \"kubernetes.io/projected/4cd14467-3251-4512-9c15-3b76bce4243a-kube-api-access-mtqhj\") pod \"node-exporter-f7m5g\" (UID: \"4cd14467-3251-4512-9c15-3b76bce4243a\") " pod="openshift-monitoring/node-exporter-f7m5g"
Jul 17 17:57:42.854153 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.854122    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4cd14467-3251-4512-9c15-3b76bce4243a-node-exporter-tls\") pod \"node-exporter-f7m5g\" (UID: \"4cd14467-3251-4512-9c15-3b76bce4243a\") " pod="openshift-monitoring/node-exporter-f7m5g"
Jul 17 17:57:42.854153 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.854156    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4cd14467-3251-4512-9c15-3b76bce4243a-metrics-client-ca\") pod \"node-exporter-f7m5g\" (UID: \"4cd14467-3251-4512-9c15-3b76bce4243a\") " pod="openshift-monitoring/node-exporter-f7m5g"
Jul 17 17:57:42.854486 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.854193    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4cd14467-3251-4512-9c15-3b76bce4243a-node-exporter-textfile\") pod \"node-exporter-f7m5g\" (UID: \"4cd14467-3251-4512-9c15-3b76bce4243a\") " pod="openshift-monitoring/node-exporter-f7m5g"
Jul 17 17:57:42.856982 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.856957    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:42.937210 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.937156    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:42.954902 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.954857    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtqhj\" (UniqueName: \"kubernetes.io/projected/4cd14467-3251-4512-9c15-3b76bce4243a-kube-api-access-mtqhj\") pod \"node-exporter-f7m5g\" (UID: \"4cd14467-3251-4512-9c15-3b76bce4243a\") " pod="openshift-monitoring/node-exporter-f7m5g"
Jul 17 17:57:42.955367 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.954948    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4cd14467-3251-4512-9c15-3b76bce4243a-node-exporter-tls\") pod \"node-exporter-f7m5g\" (UID: \"4cd14467-3251-4512-9c15-3b76bce4243a\") " pod="openshift-monitoring/node-exporter-f7m5g"
Jul 17 17:57:42.955367 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.955041    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4cd14467-3251-4512-9c15-3b76bce4243a-metrics-client-ca\") pod \"node-exporter-f7m5g\" (UID: \"4cd14467-3251-4512-9c15-3b76bce4243a\") " pod="openshift-monitoring/node-exporter-f7m5g"
Jul 17 17:57:42.955367 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.955108    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4cd14467-3251-4512-9c15-3b76bce4243a-node-exporter-textfile\") pod \"node-exporter-f7m5g\" (UID: \"4cd14467-3251-4512-9c15-3b76bce4243a\") " pod="openshift-monitoring/node-exporter-f7m5g"
Jul 17 17:57:42.955367 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.955141    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4cd14467-3251-4512-9c15-3b76bce4243a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f7m5g\" (UID: \"4cd14467-3251-4512-9c15-3b76bce4243a\") " pod="openshift-monitoring/node-exporter-f7m5g"
Jul 17 17:57:42.955367 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.955235    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4cd14467-3251-4512-9c15-3b76bce4243a-root\") pod \"node-exporter-f7m5g\" (UID: \"4cd14467-3251-4512-9c15-3b76bce4243a\") " pod="openshift-monitoring/node-exporter-f7m5g"
Jul 17 17:57:42.955367 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.955285    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4cd14467-3251-4512-9c15-3b76bce4243a-node-exporter-accelerators-collector-config\") pod \"node-exporter-f7m5g\" (UID: \"4cd14467-3251-4512-9c15-3b76bce4243a\") " pod="openshift-monitoring/node-exporter-f7m5g"
Jul 17 17:57:42.955367 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.955328    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cd14467-3251-4512-9c15-3b76bce4243a-sys\") pod \"node-exporter-f7m5g\" (UID: \"4cd14467-3251-4512-9c15-3b76bce4243a\") " pod="openshift-monitoring/node-exporter-f7m5g"
Jul 17 17:57:42.955367 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.955362    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4cd14467-3251-4512-9c15-3b76bce4243a-node-exporter-wtmp\") pod \"node-exporter-f7m5g\" (UID: \"4cd14467-3251-4512-9c15-3b76bce4243a\") " pod="openshift-monitoring/node-exporter-f7m5g"
Jul 17 17:57:42.957069 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.956295    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4cd14467-3251-4512-9c15-3b76bce4243a-root\") pod \"node-exporter-f7m5g\" (UID: \"4cd14467-3251-4512-9c15-3b76bce4243a\") " pod="openshift-monitoring/node-exporter-f7m5g"
Jul 17 17:57:42.957069 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.956726    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4cd14467-3251-4512-9c15-3b76bce4243a-sys\") pod \"node-exporter-f7m5g\" (UID: \"4cd14467-3251-4512-9c15-3b76bce4243a\") " pod="openshift-monitoring/node-exporter-f7m5g"
Jul 17 17:57:42.957069 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.956843    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4cd14467-3251-4512-9c15-3b76bce4243a-node-exporter-wtmp\") pod \"node-exporter-f7m5g\" (UID: \"4cd14467-3251-4512-9c15-3b76bce4243a\") " pod="openshift-monitoring/node-exporter-f7m5g"
Jul 17 17:57:42.957069 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:57:42.956921    2572 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 17 17:57:42.957069 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:57:42.956972    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cd14467-3251-4512-9c15-3b76bce4243a-node-exporter-tls podName:4cd14467-3251-4512-9c15-3b76bce4243a nodeName:}" failed. No retries permitted until 2026-07-17 17:57:43.456953612 +0000 UTC m=+90.682182905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4cd14467-3251-4512-9c15-3b76bce4243a-node-exporter-tls") pod "node-exporter-f7m5g" (UID: "4cd14467-3251-4512-9c15-3b76bce4243a") : secret "node-exporter-tls" not found
Jul 17 17:57:42.957387 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.957130    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4cd14467-3251-4512-9c15-3b76bce4243a-node-exporter-accelerators-collector-config\") pod \"node-exporter-f7m5g\" (UID: \"4cd14467-3251-4512-9c15-3b76bce4243a\") " pod="openshift-monitoring/node-exporter-f7m5g"
Jul 17 17:57:42.957963 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.957842    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4cd14467-3251-4512-9c15-3b76bce4243a-node-exporter-textfile\") pod \"node-exporter-f7m5g\" (UID: \"4cd14467-3251-4512-9c15-3b76bce4243a\") " pod="openshift-monitoring/node-exporter-f7m5g"
Jul 17 17:57:42.957963 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.957927    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4cd14467-3251-4512-9c15-3b76bce4243a-metrics-client-ca\") pod \"node-exporter-f7m5g\" (UID: \"4cd14467-3251-4512-9c15-3b76bce4243a\") " pod="openshift-monitoring/node-exporter-f7m5g"
Jul 17 17:57:42.959567 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.959546    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4cd14467-3251-4512-9c15-3b76bce4243a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-f7m5g\" (UID: \"4cd14467-3251-4512-9c15-3b76bce4243a\") " pod="openshift-monitoring/node-exporter-f7m5g"
Jul 17 17:57:42.964249 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:42.964225    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtqhj\" (UniqueName: \"kubernetes.io/projected/4cd14467-3251-4512-9c15-3b76bce4243a-kube-api-access-mtqhj\") pod \"node-exporter-f7m5g\" (UID: \"4cd14467-3251-4512-9c15-3b76bce4243a\") " pod="openshift-monitoring/node-exporter-f7m5g"
Jul 17 17:57:43.049546 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:43.049420    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:43.155788 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:43.155701    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:43.256389 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:43.256350    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:43.356804 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:43.356765    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:43.458262 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:43.458229    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4cd14467-3251-4512-9c15-3b76bce4243a-node-exporter-tls\") pod \"node-exporter-f7m5g\" (UID: \"4cd14467-3251-4512-9c15-3b76bce4243a\") " pod="openshift-monitoring/node-exporter-f7m5g"
Jul 17 17:57:43.460595 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:43.460575    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4cd14467-3251-4512-9c15-3b76bce4243a-node-exporter-tls\") pod \"node-exporter-f7m5g\" (UID: \"4cd14467-3251-4512-9c15-3b76bce4243a\") " pod="openshift-monitoring/node-exporter-f7m5g"
Jul 17 17:57:43.470442 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:43.470412    2572 scope.go:117] "RemoveContainer" containerID="22fc32a0bc719f2180f74da10a1466af544128b4e42297dbc3350563cb38b016"
Jul 17 17:57:43.473485 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:43.473455    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:43.563292 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:43.563258    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:43.725124 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:43.725038    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-f7m5g"
Jul 17 17:57:43.738983 ip-10-0-132-226 kubenswrapper[2572]: W0717 17:57:43.738926    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cd14467_3251_4512_9c15_3b76bce4243a.slice/crio-57dea9369ff7b3d81a96211a270fc0d4b0e7cecb0b7dbb654abbb79ae362aeec WatchSource:0}: Error finding container 57dea9369ff7b3d81a96211a270fc0d4b0e7cecb0b7dbb654abbb79ae362aeec: Status 404 returned error can't find the container with id 57dea9369ff7b3d81a96211a270fc0d4b0e7cecb0b7dbb654abbb79ae362aeec
Jul 17 17:57:43.771553 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:43.771518    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:43.868348 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:43.868302    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:43.994260 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:43.994159    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f7m5g" event={"ID":"4cd14467-3251-4512-9c15-3b76bce4243a","Type":"ContainerStarted","Data":"57dea9369ff7b3d81a96211a270fc0d4b0e7cecb0b7dbb654abbb79ae362aeec"}
Jul 17 17:57:43.996325 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:43.996304    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tp9qm_6c101a17-a051-4e9d-a9dd-f72c67ba2a8a/console-operator/2.log"
Jul 17 17:57:43.996441 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:43.996408    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-565b7b569d-tp9qm" event={"ID":"6c101a17-a051-4e9d-a9dd-f72c67ba2a8a","Type":"ContainerStarted","Data":"629cd3217c86d23a58e69fded647f0c95e360881c341c83b0267efd713aa773e"}
Jul 17 17:57:43.996742 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:43.996712    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-565b7b569d-tp9qm"
Jul 17 17:57:44.224691 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:44.224654    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-565b7b569d-tp9qm"
Jul 17 17:57:44.338493 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:44.338373    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:44.412420 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:44.412367    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:44.475534 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:44.475489    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:44.576647 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:44.576605    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:44.675526 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:44.675435    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:44.773971 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:44.773919    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:45.004979 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:45.004944    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f7m5g" event={"ID":"4cd14467-3251-4512-9c15-3b76bce4243a","Type":"ContainerStarted","Data":"9ae6b124ac2d5b05d4e7736ea62350e7b3c1d9b396c36e2c68a40c80a7c37bd1"}
Jul 17 17:57:45.088783 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:45.088753    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:45.193443 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:45.193395    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:45.295849 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:45.295817    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:45.392520 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:45.392465    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:45.493403 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:45.493306    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:45.573920 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:45.573892    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:45.675317 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:45.675282    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:45.777105 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:45.776991    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:46.001434 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:46.001399    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:46.012612 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:46.012571    2572 generic.go:356] "Generic (PLEG): container finished" podID="4cd14467-3251-4512-9c15-3b76bce4243a" containerID="9ae6b124ac2d5b05d4e7736ea62350e7b3c1d9b396c36e2c68a40c80a7c37bd1" exitCode=0
Jul 17 17:57:46.013212 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:46.013180    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f7m5g" event={"ID":"4cd14467-3251-4512-9c15-3b76bce4243a","Type":"ContainerDied","Data":"9ae6b124ac2d5b05d4e7736ea62350e7b3c1d9b396c36e2c68a40c80a7c37bd1"}
Jul 17 17:57:46.163840 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:46.163806    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:46.364990 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:46.364889    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:46.596166 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:46.596136    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:47.019391 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:47.019341    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f7m5g" event={"ID":"4cd14467-3251-4512-9c15-3b76bce4243a","Type":"ContainerStarted","Data":"0bb052c6d935ad9b13ddf594ea78510a34eed1dda3b66105c6b49a0b504e2803"}
Jul 17 17:57:47.019784 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:47.019421    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-f7m5g" event={"ID":"4cd14467-3251-4512-9c15-3b76bce4243a","Type":"ContainerStarted","Data":"5c3d6b3fe2cfdafe8eecdfbb17183b8dc897e6c7c604ea9de6ed3d954d1fb585"}
Jul 17 17:57:47.042200 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:47.042126    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-f7m5g" podStartSLOduration=3.791107863 podStartE2EDuration="5.042107174s" totalImagesPullingTime="1.183738612s" totalInitContainerRuntime="67.260699ms" isStatefulPod=true podCreationTimestamp="2026-07-17 17:57:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 17:57:47.04072998 +0000 UTC m=+94.265959287" watchObservedRunningTime="2026-07-17 17:57:47.042107174 +0000 UTC m=+94.267336485"
Jul 17 17:57:47.514598 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:47.514567    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:47.600268 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:47.600222    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:47.734988 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:47.734953    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:48.077369 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:48.077335    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:49.029648 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:49.029616    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:49.774422 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:49.774387    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-sz5w2"
Jul 17 17:57:50.464206 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:50.464173    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:50.516093 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:50.516062    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:52.120498 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:52.120462    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:52.221228 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:52.221193    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:52.543180 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:52.543148    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:52.603629 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:52.603595    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:53.294866 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:53.294827    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:53.394385 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:53.394353    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:53.760221 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:53.760182    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:53.860244 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:53.860212    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:53.919504 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:53.919460    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:54.564283 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:54.564243    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-655959c9dc-dc87g"]
Jul 17 17:57:54.647897 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:54.647859    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:54.699435 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:54.699404    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:54.793881 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:54.793848    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:54.859276 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:54.859196    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:59.135821 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:59.135780    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:57:59.237485 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:57:59.237450    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:58:00.081693 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:00.081657    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:58:00.182288 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:00.182253    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:58:02.088314 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:02.088281    2572 generic.go:356] "Generic (PLEG): container finished" podID="af512024-2ccd-4dfd-8a9d-c5b12ab13655" containerID="dd7061b8307cb0dfb7bc8217952e2bc91b2eacf35abc0118f2f146a7e7dd5791" exitCode=0
Jul 17 17:58:02.088818 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:02.088329    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-vdxt4" event={"ID":"af512024-2ccd-4dfd-8a9d-c5b12ab13655","Type":"ContainerDied","Data":"dd7061b8307cb0dfb7bc8217952e2bc91b2eacf35abc0118f2f146a7e7dd5791"}
Jul 17 17:58:02.088818 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:02.088783    2572 scope.go:117] "RemoveContainer" containerID="dd7061b8307cb0dfb7bc8217952e2bc91b2eacf35abc0118f2f146a7e7dd5791"
Jul 17 17:58:02.138592 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:02.138558    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:58:02.238615 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:02.238534    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:58:02.301478 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:02.301442    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:58:02.370523 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:02.370484    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:58:02.446436 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:02.446403    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:58:03.094296 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:03.094254    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-555d9d7885-vdxt4" event={"ID":"af512024-2ccd-4dfd-8a9d-c5b12ab13655","Type":"ContainerStarted","Data":"d98b21bc854c24a3ea15d35d3e57f1363ea579e33d963d4841e6ed55732e9f36"}
Jul 17 17:58:06.316306 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:06.316267    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:58:06.417945 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:06.417910    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:58:07.510704 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:07.510651    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:58:07.611172 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:07.611136    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:58:09.612229 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:09.612196    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:58:09.669339 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:09.669309    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:58:10.652511 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:10.652472    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:58:10.754149 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:10.754118    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:58:11.546363 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:11.546320    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:58:16.150184 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:16.150138    2572 generic.go:356] "Generic (PLEG): container finished" podID="eb991050-0ab3-4599-823c-f9dd86d13174" containerID="1cd369fd0c3ffe96cd2546debb62aa805054b98438701430e1cdcaa75956b463" exitCode=0
Jul 17 17:58:16.150622 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:16.150207    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6wzn9" event={"ID":"eb991050-0ab3-4599-823c-f9dd86d13174","Type":"ContainerDied","Data":"1cd369fd0c3ffe96cd2546debb62aa805054b98438701430e1cdcaa75956b463"}
Jul 17 17:58:16.150693 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:16.150646    2572 scope.go:117] "RemoveContainer" containerID="1cd369fd0c3ffe96cd2546debb62aa805054b98438701430e1cdcaa75956b463"
Jul 17 17:58:17.156754 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:17.156721    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7658d9b749-6wzn9" event={"ID":"eb991050-0ab3-4599-823c-f9dd86d13174","Type":"ContainerStarted","Data":"6947d613a630904ddceeb94973e14b94d5303ccc2d42c6d6603d7c73e9125542"}
Jul 17 17:58:19.585587 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:19.585515    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-655959c9dc-dc87g" podUID="61298aa5-416d-4864-a479-762a86580bc9" containerName="registry" containerID="cri-o://c7cc9ebbf8a1ecf77d232911573e5dccad0686009ff5817d82927d3b112f515e" gracePeriod=30
Jul 17 17:58:19.845242 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:19.845179    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:58:19.875462 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:19.875431    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlpzq\" (UniqueName: \"kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-kube-api-access-nlpzq\") pod \"61298aa5-416d-4864-a479-762a86580bc9\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") "
Jul 17 17:58:19.875642 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:19.875472    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/61298aa5-416d-4864-a479-762a86580bc9-installation-pull-secrets\") pod \"61298aa5-416d-4864-a479-762a86580bc9\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") "
Jul 17 17:58:19.875642 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:19.875516    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/61298aa5-416d-4864-a479-762a86580bc9-registry-certificates\") pod \"61298aa5-416d-4864-a479-762a86580bc9\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") "
Jul 17 17:58:19.875736 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:19.875690    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-bound-sa-token\") pod \"61298aa5-416d-4864-a479-762a86580bc9\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") "
Jul 17 17:58:19.875781 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:19.875748    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/61298aa5-416d-4864-a479-762a86580bc9-ca-trust-extracted\") pod \"61298aa5-416d-4864-a479-762a86580bc9\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") "
Jul 17 17:58:19.875831 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:19.875782    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/61298aa5-416d-4864-a479-762a86580bc9-image-registry-private-configuration\") pod \"61298aa5-416d-4864-a479-762a86580bc9\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") "
Jul 17 17:58:19.875934 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:19.875906    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61298aa5-416d-4864-a479-762a86580bc9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "61298aa5-416d-4864-a479-762a86580bc9" (UID: "61298aa5-416d-4864-a479-762a86580bc9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:58:19.876242 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:19.876222    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-registry-tls\") pod \"61298aa5-416d-4864-a479-762a86580bc9\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") "
Jul 17 17:58:19.876445 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:19.876429    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61298aa5-416d-4864-a479-762a86580bc9-trusted-ca\") pod \"61298aa5-416d-4864-a479-762a86580bc9\" (UID: \"61298aa5-416d-4864-a479-762a86580bc9\") "
Jul 17 17:58:19.877139 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:19.876951    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61298aa5-416d-4864-a479-762a86580bc9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "61298aa5-416d-4864-a479-762a86580bc9" (UID: "61298aa5-416d-4864-a479-762a86580bc9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 17:58:19.877480 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:19.877462    2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61298aa5-416d-4864-a479-762a86580bc9-trusted-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 17:58:19.877601 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:19.877584    2572 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/61298aa5-416d-4864-a479-762a86580bc9-registry-certificates\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 17:58:19.878723 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:19.878659    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61298aa5-416d-4864-a479-762a86580bc9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "61298aa5-416d-4864-a479-762a86580bc9" (UID: "61298aa5-416d-4864-a479-762a86580bc9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 17:58:19.878723 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:19.878670    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-kube-api-access-nlpzq" (OuterVolumeSpecName: "kube-api-access-nlpzq") pod "61298aa5-416d-4864-a479-762a86580bc9" (UID: "61298aa5-416d-4864-a479-762a86580bc9"). InnerVolumeSpecName "kube-api-access-nlpzq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:58:19.878880 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:19.878738    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "61298aa5-416d-4864-a479-762a86580bc9" (UID: "61298aa5-416d-4864-a479-762a86580bc9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:58:19.878880 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:19.878794    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "61298aa5-416d-4864-a479-762a86580bc9" (UID: "61298aa5-416d-4864-a479-762a86580bc9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 17:58:19.878880 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:19.878852    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61298aa5-416d-4864-a479-762a86580bc9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "61298aa5-416d-4864-a479-762a86580bc9" (UID: "61298aa5-416d-4864-a479-762a86580bc9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 17:58:19.884336 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:19.884307    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61298aa5-416d-4864-a479-762a86580bc9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "61298aa5-416d-4864-a479-762a86580bc9" (UID: "61298aa5-416d-4864-a479-762a86580bc9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 17:58:19.978936 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:19.978896    2572 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-registry-tls\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 17:58:19.978936 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:19.978929    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlpzq\" (UniqueName: \"kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-kube-api-access-nlpzq\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 17:58:19.978936 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:19.978940    2572 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/61298aa5-416d-4864-a479-762a86580bc9-installation-pull-secrets\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 17:58:19.978936 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:19.978949    2572 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/61298aa5-416d-4864-a479-762a86580bc9-bound-sa-token\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 17:58:19.979305 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:19.978958    2572 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/61298aa5-416d-4864-a479-762a86580bc9-ca-trust-extracted\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 17:58:19.979305 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:19.978968    2572 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/61298aa5-416d-4864-a479-762a86580bc9-image-registry-private-configuration\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 17:58:20.171584 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:20.171493    2572 generic.go:356] "Generic (PLEG): container finished" podID="61298aa5-416d-4864-a479-762a86580bc9" containerID="c7cc9ebbf8a1ecf77d232911573e5dccad0686009ff5817d82927d3b112f515e" exitCode=0
Jul 17 17:58:20.171584 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:20.171538    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-655959c9dc-dc87g"
Jul 17 17:58:20.171822 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:20.171582    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-655959c9dc-dc87g" event={"ID":"61298aa5-416d-4864-a479-762a86580bc9","Type":"ContainerDied","Data":"c7cc9ebbf8a1ecf77d232911573e5dccad0686009ff5817d82927d3b112f515e"}
Jul 17 17:58:20.171822 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:20.171648    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-655959c9dc-dc87g" event={"ID":"61298aa5-416d-4864-a479-762a86580bc9","Type":"ContainerDied","Data":"8aef6ea6b121fa9cfe36c21f2c9ece9e3bfdbfef134a8867fe0b5a5f11a6f251"}
Jul 17 17:58:20.171822 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:20.171676    2572 scope.go:117] "RemoveContainer" containerID="c7cc9ebbf8a1ecf77d232911573e5dccad0686009ff5817d82927d3b112f515e"
Jul 17 17:58:20.180676 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:20.180655    2572 scope.go:117] "RemoveContainer" containerID="c7cc9ebbf8a1ecf77d232911573e5dccad0686009ff5817d82927d3b112f515e"
Jul 17 17:58:20.180946 ip-10-0-132-226 kubenswrapper[2572]: E0717 17:58:20.180928    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7cc9ebbf8a1ecf77d232911573e5dccad0686009ff5817d82927d3b112f515e\": container with ID starting with c7cc9ebbf8a1ecf77d232911573e5dccad0686009ff5817d82927d3b112f515e not found: ID does not exist" containerID="c7cc9ebbf8a1ecf77d232911573e5dccad0686009ff5817d82927d3b112f515e"
Jul 17 17:58:20.181024 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:20.180954    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7cc9ebbf8a1ecf77d232911573e5dccad0686009ff5817d82927d3b112f515e"} err="failed to get container status \"c7cc9ebbf8a1ecf77d232911573e5dccad0686009ff5817d82927d3b112f515e\": rpc error: code = NotFound desc = could not find container \"c7cc9ebbf8a1ecf77d232911573e5dccad0686009ff5817d82927d3b112f515e\": container with ID starting with c7cc9ebbf8a1ecf77d232911573e5dccad0686009ff5817d82927d3b112f515e not found: ID does not exist"
Jul 17 17:58:20.192379 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:20.192348    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-655959c9dc-dc87g"]
Jul 17 17:58:20.195410 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:20.195386    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-655959c9dc-dc87g"]
Jul 17 17:58:21.177669 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:21.177587    2572 generic.go:356] "Generic (PLEG): container finished" podID="75141c58-8adf-4427-80f5-3ea8a2d8081f" containerID="9d672e67cc2c95185ef23a18664f7c4bffbbbe2ac5651506542d5f97c571a71c" exitCode=0
Jul 17 17:58:21.178139 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:21.177675    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9wgzc" event={"ID":"75141c58-8adf-4427-80f5-3ea8a2d8081f","Type":"ContainerDied","Data":"9d672e67cc2c95185ef23a18664f7c4bffbbbe2ac5651506542d5f97c571a71c"}
Jul 17 17:58:21.178208 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:21.178164    2572 scope.go:117] "RemoveContainer" containerID="9d672e67cc2c95185ef23a18664f7c4bffbbbe2ac5651506542d5f97c571a71c"
Jul 17 17:58:21.470339 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:21.470298    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61298aa5-416d-4864-a479-762a86580bc9" path="/var/lib/kubelet/pods/61298aa5-416d-4864-a479-762a86580bc9/volumes"
Jul 17 17:58:22.185747 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:22.185702    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5bcbc94c78-9wgzc" event={"ID":"75141c58-8adf-4427-80f5-3ea8a2d8081f","Type":"ContainerStarted","Data":"75a9ca7728de8f403a5c4c4914611f56cc4a9a220c4194868b7ca8f05b0238f7"}
Jul 17 17:58:24.622457 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:24.622419    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:58:24.675971 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:24.675936    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:58:34.639466 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:34.639423    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:58:58.882974 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:58.882933    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:58:58.940296 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:58:58.940254    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:59:07.052084 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:59:07.051988    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:59:07.153548 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:59:07.153507    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:59:10.728242 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:59:10.728210    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:59:10.780469 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:59:10.780431    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:59:17.947984 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:59:17.947943    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:59:18.050091 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:59:18.050047    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:59:18.197573 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:59:18.197537    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:59:24.621977 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:59:24.621937    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:59:24.722473 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:59:24.722440    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:59:24.779542 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:59:24.779510    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:59:32.806693 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:59:32.806649    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:59:32.859232 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:59:32.859194    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 17:59:44.436837 ip-10-0-132-226 kubenswrapper[2572]: I0717 17:59:44.436796    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:00:01.471206 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:00:01.471172    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:00:05.533087 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:00:05.533045    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:00:05.631385 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:00:05.631346    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:00:32.280796 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:00:32.280731    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:00:33.177070 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:00:33.177029    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:00:35.905948 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:00:35.905863    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:00:36.008058 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:00:36.008023    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:00:38.001863 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:00:38.001818    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:00:38.108467 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:00:38.108419    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:00:38.664669 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:00:38.664631    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:00:38.775319 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:00:38.775281    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:00:40.027262 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:00:40.027224    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:00:40.396687 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:00:40.396590    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:00:41.475831 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:00:41.475792    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:00:43.067065 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:00:43.067026    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:00:43.119881 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:00:43.119842    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:00:46.585379 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:00:46.585334    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:00:46.703323 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:00:46.703280    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:00:49.241636 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:00:49.241582    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:00:50.399722 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:00:50.399687    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:00:50.991552 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:00:50.991514    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:00:51.095751 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:00:51.095716    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:00:57.366142 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:00:57.366106    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:00:57.499930 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:00:57.499889    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:00:59.273676 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:00:59.273637    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:10.932180 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:10.932134    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:11.035319 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:11.035278    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:11.567352 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:11.567313    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:11.934047 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:11.933934    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:12.033769 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.033731    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:12.050235 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.050189    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d8bdcf84-2h9jr"]
Jul 17 18:01:12.050534 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.050520    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61298aa5-416d-4864-a479-762a86580bc9" containerName="registry"
Jul 17 18:01:12.050597 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.050536    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="61298aa5-416d-4864-a479-762a86580bc9" containerName="registry"
Jul 17 18:01:12.050597 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.050594    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="61298aa5-416d-4864-a479-762a86580bc9" containerName="registry"
Jul 17 18:01:12.053532 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.053515    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d8bdcf84-2h9jr"
Jul 17 18:01:12.056337 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.056311    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 17 18:01:12.056469 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.056346    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 17 18:01:12.056469 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.056346    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-p5jsc\""
Jul 17 18:01:12.056469 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.056346    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 17 18:01:12.056469 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.056436    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 17 18:01:12.072184 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.072142    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d8bdcf84-2h9jr"]
Jul 17 18:01:12.088894 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.088858    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2rcg\" (UniqueName: \"kubernetes.io/projected/9c4f73f4-d262-4108-8364-8ef043ef62b2-kube-api-access-n2rcg\") pod \"opendatahub-operator-controller-manager-5d8bdcf84-2h9jr\" (UID: \"9c4f73f4-d262-4108-8364-8ef043ef62b2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8bdcf84-2h9jr"
Jul 17 18:01:12.089068 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.088908    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c4f73f4-d262-4108-8364-8ef043ef62b2-tmp\") pod \"opendatahub-operator-controller-manager-5d8bdcf84-2h9jr\" (UID: \"9c4f73f4-d262-4108-8364-8ef043ef62b2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8bdcf84-2h9jr"
Jul 17 18:01:12.089068 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.088930    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c4f73f4-d262-4108-8364-8ef043ef62b2-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d8bdcf84-2h9jr\" (UID: \"9c4f73f4-d262-4108-8364-8ef043ef62b2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8bdcf84-2h9jr"
Jul 17 18:01:12.089152 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.089070    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9c4f73f4-d262-4108-8364-8ef043ef62b2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d8bdcf84-2h9jr\" (UID: \"9c4f73f4-d262-4108-8364-8ef043ef62b2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8bdcf84-2h9jr"
Jul 17 18:01:12.089152 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.089118    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9c4f73f4-d262-4108-8364-8ef043ef62b2-manifests\") pod \"opendatahub-operator-controller-manager-5d8bdcf84-2h9jr\" (UID: \"9c4f73f4-d262-4108-8364-8ef043ef62b2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8bdcf84-2h9jr"
Jul 17 18:01:12.185819 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.185705    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:12.189773 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.189751    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9c4f73f4-d262-4108-8364-8ef043ef62b2-manifests\") pod \"opendatahub-operator-controller-manager-5d8bdcf84-2h9jr\" (UID: \"9c4f73f4-d262-4108-8364-8ef043ef62b2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8bdcf84-2h9jr"
Jul 17 18:01:12.189850 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.189789    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2rcg\" (UniqueName: \"kubernetes.io/projected/9c4f73f4-d262-4108-8364-8ef043ef62b2-kube-api-access-n2rcg\") pod \"opendatahub-operator-controller-manager-5d8bdcf84-2h9jr\" (UID: \"9c4f73f4-d262-4108-8364-8ef043ef62b2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8bdcf84-2h9jr"
Jul 17 18:01:12.189850 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.189824    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c4f73f4-d262-4108-8364-8ef043ef62b2-tmp\") pod \"opendatahub-operator-controller-manager-5d8bdcf84-2h9jr\" (UID: \"9c4f73f4-d262-4108-8364-8ef043ef62b2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8bdcf84-2h9jr"
Jul 17 18:01:12.189850 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.189842    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c4f73f4-d262-4108-8364-8ef043ef62b2-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d8bdcf84-2h9jr\" (UID: \"9c4f73f4-d262-4108-8364-8ef043ef62b2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8bdcf84-2h9jr"
Jul 17 18:01:12.189960 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.189891    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9c4f73f4-d262-4108-8364-8ef043ef62b2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d8bdcf84-2h9jr\" (UID: \"9c4f73f4-d262-4108-8364-8ef043ef62b2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8bdcf84-2h9jr"
Jul 17 18:01:12.190241 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.190219    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9c4f73f4-d262-4108-8364-8ef043ef62b2-manifests\") pod \"opendatahub-operator-controller-manager-5d8bdcf84-2h9jr\" (UID: \"9c4f73f4-d262-4108-8364-8ef043ef62b2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8bdcf84-2h9jr"
Jul 17 18:01:12.192269 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.192248    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c4f73f4-d262-4108-8364-8ef043ef62b2-tmp\") pod \"opendatahub-operator-controller-manager-5d8bdcf84-2h9jr\" (UID: \"9c4f73f4-d262-4108-8364-8ef043ef62b2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8bdcf84-2h9jr"
Jul 17 18:01:12.192480 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.192463    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c4f73f4-d262-4108-8364-8ef043ef62b2-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d8bdcf84-2h9jr\" (UID: \"9c4f73f4-d262-4108-8364-8ef043ef62b2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8bdcf84-2h9jr"
Jul 17 18:01:12.192624 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.192602    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9c4f73f4-d262-4108-8364-8ef043ef62b2-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d8bdcf84-2h9jr\" (UID: \"9c4f73f4-d262-4108-8364-8ef043ef62b2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8bdcf84-2h9jr"
Jul 17 18:01:12.199586 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.199557    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2rcg\" (UniqueName: \"kubernetes.io/projected/9c4f73f4-d262-4108-8364-8ef043ef62b2-kube-api-access-n2rcg\") pod \"opendatahub-operator-controller-manager-5d8bdcf84-2h9jr\" (UID: \"9c4f73f4-d262-4108-8364-8ef043ef62b2\") " pod="opendatahub/opendatahub-operator-controller-manager-5d8bdcf84-2h9jr"
Jul 17 18:01:12.288240 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.288201    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:12.364304 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.364267    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d8bdcf84-2h9jr"
Jul 17 18:01:12.382992 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.382963    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:12.476621 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.476574    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:12.507853 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.507829    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d8bdcf84-2h9jr"]
Jul 17 18:01:12.510722 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:01:12.510683    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c4f73f4_d262_4108_8364_8ef043ef62b2.slice/crio-67cf34078db837958e788ea976b5091af781e0d3a93c934e127c5e906230192d WatchSource:0}: Error finding container 67cf34078db837958e788ea976b5091af781e0d3a93c934e127c5e906230192d: Status 404 returned error can't find the container with id 67cf34078db837958e788ea976b5091af781e0d3a93c934e127c5e906230192d
Jul 17 18:01:12.562507 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.562464    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:12.851565 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:12.851477    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d8bdcf84-2h9jr" event={"ID":"9c4f73f4-d262-4108-8364-8ef043ef62b2","Type":"ContainerStarted","Data":"67cf34078db837958e788ea976b5091af781e0d3a93c934e127c5e906230192d"}
Jul 17 18:01:13.361684 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:13.361015    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tp9qm_6c101a17-a051-4e9d-a9dd-f72c67ba2a8a/console-operator/2.log"
Jul 17 18:01:13.372778 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:13.372748    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tp9qm_6c101a17-a051-4e9d-a9dd-f72c67ba2a8a/console-operator/2.log"
Jul 17 18:01:13.382459 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:13.382430    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5mdx_2e3bd369-576e-4df1-8a76-aebd537cde58/ovn-acl-logging/0.log"
Jul 17 18:01:13.386979 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:13.386948    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5mdx_2e3bd369-576e-4df1-8a76-aebd537cde58/ovn-acl-logging/0.log"
Jul 17 18:01:13.388779 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:13.388762    2572 kubelet.go:1648] "Image garbage collection succeeded"
Jul 17 18:01:15.868647 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:15.868560    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d8bdcf84-2h9jr" event={"ID":"9c4f73f4-d262-4108-8364-8ef043ef62b2","Type":"ContainerStarted","Data":"4e0001401c5ca3fa672561d4f7aaeca60809645b9610d9525b4be0597bd6fbd9"}
Jul 17 18:01:16.873823 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:16.873782    2572 generic.go:356] "Generic (PLEG): container finished" podID="9c4f73f4-d262-4108-8364-8ef043ef62b2" containerID="4e0001401c5ca3fa672561d4f7aaeca60809645b9610d9525b4be0597bd6fbd9" exitCode=0
Jul 17 18:01:16.874361 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:16.873826    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d8bdcf84-2h9jr" event={"ID":"9c4f73f4-d262-4108-8364-8ef043ef62b2","Type":"ContainerDied","Data":"4e0001401c5ca3fa672561d4f7aaeca60809645b9610d9525b4be0597bd6fbd9"}
Jul 17 18:01:16.874528 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:16.874508    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 18:01:17.881015 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:17.880960    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d8bdcf84-2h9jr" event={"ID":"9c4f73f4-d262-4108-8364-8ef043ef62b2","Type":"ContainerStarted","Data":"da9ccd6ab764575d339a2227d693f71e1624779495814d7c6cfbe8c8a539876c"}
Jul 17 18:01:17.908247 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:17.908193    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d8bdcf84-2h9jr" podStartSLOduration=1.351097948 podStartE2EDuration="5.908176693s" totalImagesPullingTime="3.459581774s" totalInitContainerRuntime="1.097496971s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:01:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:01:17.905548017 +0000 UTC m=+305.130777326" watchObservedRunningTime="2026-07-17 18:01:17.908176693 +0000 UTC m=+305.133406002"
Jul 17 18:01:18.884989 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:18.884957    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d8bdcf84-2h9jr"
Jul 17 18:01:20.677602 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:20.677570    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:23.051874 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:23.051837    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:29.892227 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:29.892193    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d8bdcf84-2h9jr"
Jul 17 18:01:31.897962 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:31.897912    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:32.025165 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:32.025126    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:32.306064 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:32.306030    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:32.728556 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:32.728521    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:32.820370 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:32.820332    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:32.932319 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:32.932276    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:33.039331 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:33.039234    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:33.172519 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:33.172470    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:33.679167 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:33.679116    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:33.856102 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:33.856062    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:33.962255 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:33.962218    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:34.098249 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:34.098205    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:35.221304 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:35.221270    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:40.314250 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:40.314211    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:40.426943 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:40.426904    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:40.608263 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:40.608174    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:40.703565 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:40.703522    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:41.162299 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.162268    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"]
Jul 17 18:01:41.165730 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.165708    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"
Jul 17 18:01:41.168870 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.168846    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 17 18:01:41.169016 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.168898    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-7qwx6\""
Jul 17 18:01:41.180859 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.180833    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"]
Jul 17 18:01:41.193874 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.193843    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:41.241631 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.241593    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gcx8b\" (UID: \"fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"
Jul 17 18:01:41.241631 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.241636    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gcx8b\" (UID: \"fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"
Jul 17 18:01:41.241890 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.241747    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gcx8b\" (UID: \"fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"
Jul 17 18:01:41.241890 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.241805    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gcx8b\" (UID: \"fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"
Jul 17 18:01:41.241890 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.241844    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gcx8b\" (UID: \"fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"
Jul 17 18:01:41.241890 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.241876    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gcx8b\" (UID: \"fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"
Jul 17 18:01:41.242165 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.241913    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gcx8b\" (UID: \"fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"
Jul 17 18:01:41.242165 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.242029    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gcx8b\" (UID: \"fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"
Jul 17 18:01:41.242165 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.242068    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr6kz\" (UniqueName: \"kubernetes.io/projected/fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f-kube-api-access-wr6kz\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gcx8b\" (UID: \"fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"
Jul 17 18:01:41.342806 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.342772    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gcx8b\" (UID: \"fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"
Jul 17 18:01:41.343288 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.342825    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gcx8b\" (UID: \"fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"
Jul 17 18:01:41.343288 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.342940    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gcx8b\" (UID: \"fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"
Jul 17 18:01:41.343288 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.342973    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gcx8b\" (UID: \"fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"
Jul 17 18:01:41.343288 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.343203    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gcx8b\" (UID: \"fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"
Jul 17 18:01:41.343288 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.343246    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gcx8b\" (UID: \"fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"
Jul 17 18:01:41.343288 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.343262    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gcx8b\" (UID: \"fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"
Jul 17 18:01:41.343288 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.343289    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr6kz\" (UniqueName: \"kubernetes.io/projected/fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f-kube-api-access-wr6kz\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gcx8b\" (UID: \"fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"
Jul 17 18:01:41.343674 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.343323    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gcx8b\" (UID: \"fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"
Jul 17 18:01:41.343674 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.343359    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gcx8b\" (UID: \"fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"
Jul 17 18:01:41.343674 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.343370    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gcx8b\" (UID: \"fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"
Jul 17 18:01:41.343674 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.343550    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gcx8b\" (UID: \"fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"
Jul 17 18:01:41.343674 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.343655    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gcx8b\" (UID: \"fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"
Jul 17 18:01:41.343882 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.343738    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gcx8b\" (UID: \"fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"
Jul 17 18:01:41.345455 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.345432    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gcx8b\" (UID: \"fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"
Jul 17 18:01:41.345554 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.345530    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gcx8b\" (UID: \"fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"
Jul 17 18:01:41.353493 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.353472    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gcx8b\" (UID: \"fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"
Jul 17 18:01:41.353687 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.353665    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr6kz\" (UniqueName: \"kubernetes.io/projected/fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f-kube-api-access-wr6kz\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678gcx8b\" (UID: \"fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"
Jul 17 18:01:41.383250 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.383220    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:41.477921 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.477894    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"
Jul 17 18:01:41.491206 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.491176    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:41.637418 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.637369    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"]
Jul 17 18:01:41.640336 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:01:41.640311    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdb91a0f_bb1f_44e9_9f02_87f8d60ccd8f.slice/crio-d6a3fb532390a2da60a82dee9c757986727e55161af6f8c09ef8e5c4e54da5fc WatchSource:0}: Error finding container d6a3fb532390a2da60a82dee9c757986727e55161af6f8c09ef8e5c4e54da5fc: Status 404 returned error can't find the container with id d6a3fb532390a2da60a82dee9c757986727e55161af6f8c09ef8e5c4e54da5fc
Jul 17 18:01:41.985334 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:41.985299    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b" event={"ID":"fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f","Type":"ContainerStarted","Data":"d6a3fb532390a2da60a82dee9c757986727e55161af6f8c09ef8e5c4e54da5fc"}
Jul 17 18:01:42.604275 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:42.604241    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:42.730724 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:42.730647    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:43.114801 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:43.114764    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-f76c48b9d-mdnxp"]
Jul 17 18:01:43.121512 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:43.121478    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f76c48b9d-mdnxp"
Jul 17 18:01:43.127143 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:43.127115    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 17 18:01:43.127748 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:43.127727    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 17 18:01:43.128280 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:43.128231    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 17 18:01:43.129123 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:43.128983    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 17 18:01:43.133563 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:43.133542    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 17 18:01:43.133881 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:43.133858    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-28vnl\""
Jul 17 18:01:43.138655 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:43.138251    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f76c48b9d-mdnxp"]
Jul 17 18:01:43.259720 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:43.259670    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bbaccd60-ce7a-43a9-8a8d-f41b85544908-metrics-cert\") pod \"lws-controller-manager-f76c48b9d-mdnxp\" (UID: \"bbaccd60-ce7a-43a9-8a8d-f41b85544908\") " pod="openshift-lws-operator/lws-controller-manager-f76c48b9d-mdnxp"
Jul 17 18:01:43.259912 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:43.259787    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bbaccd60-ce7a-43a9-8a8d-f41b85544908-manager-config\") pod \"lws-controller-manager-f76c48b9d-mdnxp\" (UID: \"bbaccd60-ce7a-43a9-8a8d-f41b85544908\") " pod="openshift-lws-operator/lws-controller-manager-f76c48b9d-mdnxp"
Jul 17 18:01:43.259978 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:43.259915    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bbaccd60-ce7a-43a9-8a8d-f41b85544908-cert\") pod \"lws-controller-manager-f76c48b9d-mdnxp\" (UID: \"bbaccd60-ce7a-43a9-8a8d-f41b85544908\") " pod="openshift-lws-operator/lws-controller-manager-f76c48b9d-mdnxp"
Jul 17 18:01:43.259978 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:43.259938    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d9wc\" (UniqueName: \"kubernetes.io/projected/bbaccd60-ce7a-43a9-8a8d-f41b85544908-kube-api-access-6d9wc\") pod \"lws-controller-manager-f76c48b9d-mdnxp\" (UID: \"bbaccd60-ce7a-43a9-8a8d-f41b85544908\") " pod="openshift-lws-operator/lws-controller-manager-f76c48b9d-mdnxp"
Jul 17 18:01:43.360479 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:43.360441    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bbaccd60-ce7a-43a9-8a8d-f41b85544908-cert\") pod \"lws-controller-manager-f76c48b9d-mdnxp\" (UID: \"bbaccd60-ce7a-43a9-8a8d-f41b85544908\") " pod="openshift-lws-operator/lws-controller-manager-f76c48b9d-mdnxp"
Jul 17 18:01:43.360666 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:43.360491    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d9wc\" (UniqueName: \"kubernetes.io/projected/bbaccd60-ce7a-43a9-8a8d-f41b85544908-kube-api-access-6d9wc\") pod \"lws-controller-manager-f76c48b9d-mdnxp\" (UID: \"bbaccd60-ce7a-43a9-8a8d-f41b85544908\") " pod="openshift-lws-operator/lws-controller-manager-f76c48b9d-mdnxp"
Jul 17 18:01:43.360666 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:43.360537    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bbaccd60-ce7a-43a9-8a8d-f41b85544908-metrics-cert\") pod \"lws-controller-manager-f76c48b9d-mdnxp\" (UID: \"bbaccd60-ce7a-43a9-8a8d-f41b85544908\") " pod="openshift-lws-operator/lws-controller-manager-f76c48b9d-mdnxp"
Jul 17 18:01:43.360666 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:43.360584    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bbaccd60-ce7a-43a9-8a8d-f41b85544908-manager-config\") pod \"lws-controller-manager-f76c48b9d-mdnxp\" (UID: \"bbaccd60-ce7a-43a9-8a8d-f41b85544908\") " pod="openshift-lws-operator/lws-controller-manager-f76c48b9d-mdnxp"
Jul 17 18:01:43.361430 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:43.361401    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/bbaccd60-ce7a-43a9-8a8d-f41b85544908-manager-config\") pod \"lws-controller-manager-f76c48b9d-mdnxp\" (UID: \"bbaccd60-ce7a-43a9-8a8d-f41b85544908\") " pod="openshift-lws-operator/lws-controller-manager-f76c48b9d-mdnxp"
Jul 17 18:01:43.363373 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:43.363353    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/bbaccd60-ce7a-43a9-8a8d-f41b85544908-metrics-cert\") pod \"lws-controller-manager-f76c48b9d-mdnxp\" (UID: \"bbaccd60-ce7a-43a9-8a8d-f41b85544908\") " pod="openshift-lws-operator/lws-controller-manager-f76c48b9d-mdnxp"
Jul 17 18:01:43.363496 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:43.363475    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bbaccd60-ce7a-43a9-8a8d-f41b85544908-cert\") pod \"lws-controller-manager-f76c48b9d-mdnxp\" (UID: \"bbaccd60-ce7a-43a9-8a8d-f41b85544908\") " pod="openshift-lws-operator/lws-controller-manager-f76c48b9d-mdnxp"
Jul 17 18:01:43.377842 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:43.377779    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d9wc\" (UniqueName: \"kubernetes.io/projected/bbaccd60-ce7a-43a9-8a8d-f41b85544908-kube-api-access-6d9wc\") pod \"lws-controller-manager-f76c48b9d-mdnxp\" (UID: \"bbaccd60-ce7a-43a9-8a8d-f41b85544908\") " pod="openshift-lws-operator/lws-controller-manager-f76c48b9d-mdnxp"
Jul 17 18:01:43.434453 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:43.434407    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-f76c48b9d-mdnxp"
Jul 17 18:01:43.513250 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:43.513109    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:43.611359 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:43.611288    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:43.637449 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:43.637361    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-f76c48b9d-mdnxp"]
Jul 17 18:01:43.640228 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:01:43.640193    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbaccd60_ce7a_43a9_8a8d_f41b85544908.slice/crio-ae332a2d6745caf1806ff887fe377ed21d458c4a0621975e87e20f1575c64541 WatchSource:0}: Error finding container ae332a2d6745caf1806ff887fe377ed21d458c4a0621975e87e20f1575c64541: Status 404 returned error can't find the container with id ae332a2d6745caf1806ff887fe377ed21d458c4a0621975e87e20f1575c64541
Jul 17 18:01:43.997099 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:43.997048    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f76c48b9d-mdnxp" event={"ID":"bbaccd60-ce7a-43a9-8a8d-f41b85544908","Type":"ContainerStarted","Data":"ae332a2d6745caf1806ff887fe377ed21d458c4a0621975e87e20f1575c64541"}
Jul 17 18:01:44.177269 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:44.177228    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:44.801895 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:44.801828    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:44.928522 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:44.928483    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:45.013655 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:45.013622    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:01:45.090039 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:45.089987    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:01:45.090159 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:45.090087    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:01:45.090159 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:45.090132    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:01:46.009487 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:46.009450    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b" event={"ID":"fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f","Type":"ContainerStarted","Data":"db053bda0625a14cda3b37d777a320789717819117a7e32407938b9e0254133d"}
Jul 17 18:01:46.034411 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:46.034361    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b" podStartSLOduration=1.587124696 podStartE2EDuration="5.034343938s" totalImagesPullingTime="3.447219242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:01:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:01:46.034176231 +0000 UTC m=+333.259405540" watchObservedRunningTime="2026-07-17 18:01:46.034343938 +0000 UTC m=+333.259573247"
Jul 17 18:01:46.478339 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:46.478304    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"
Jul 17 18:01:46.484725 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:46.484690    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"
Jul 17 18:01:47.014799 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:47.014750    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"
Jul 17 18:01:47.016208 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:47.016184    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678gcx8b"
Jul 17 18:01:48.020905 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:48.020865    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-f76c48b9d-mdnxp" event={"ID":"bbaccd60-ce7a-43a9-8a8d-f41b85544908","Type":"ContainerStarted","Data":"248e51d06549d1781dd90521eb190b31eb62538c25fdb7df64bbee9391b6cbf2"}
Jul 17 18:01:48.021367 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:48.021149    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-f76c48b9d-mdnxp"
Jul 17 18:01:48.040580 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:48.040529    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-f76c48b9d-mdnxp" podStartSLOduration=0.846296649 podStartE2EDuration="5.040511916s" totalImagesPullingTime="4.194215267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:01:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:01:48.039429638 +0000 UTC m=+335.264658947" watchObservedRunningTime="2026-07-17 18:01:48.040511916 +0000 UTC m=+335.265741222"
Jul 17 18:01:59.027527 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:01:59.027493    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-f76c48b9d-mdnxp"
Jul 17 18:02:33.438409 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:02:33.438366    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:02:33.539924 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:02:33.539875    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:02:33.633116 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:02:33.633072    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:02:34.345479 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:02:34.345436    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:02:34.560284 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:02:34.560236    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:02:35.204216 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:02:35.204180    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:02:35.261843 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:02:35.261806    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:01.765589 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:01.765528    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:02.359114 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:02.359072    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:06.769572 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:06.769527    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:07.527397 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:07.527341    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:07.618428 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:07.618385    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:09.058466 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:09.058419    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:11.638416 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:11.638374    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:11.987502 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:11.987465    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:14.371290 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:14.371240    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:15.020658 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:15.020614    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:17.407979 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:17.407936    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:18.147758 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:18.147725    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:18.249198 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:18.249162    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:18.321551 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:18.321510    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:18.566696 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:18.566665    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:18.667209 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:18.667156    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:20.389450 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:20.389416    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:20.494286 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:20.494247    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:22.175185 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:22.175140    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:22.287343 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:22.287288    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:29.435393 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:29.435356    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:29.590810 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:29.590757    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:30.051874 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:30.051833    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qkbcb"]
Jul 17 18:03:30.056578 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:30.056546    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qkbcb"
Jul 17 18:03:30.059081 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:30.059057    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 17 18:03:30.059081 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:30.059071    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nbkwq\""
Jul 17 18:03:30.059244 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:30.059057    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 17 18:03:30.070324 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:30.070292    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qkbcb"]
Jul 17 18:03:30.166185 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:30.166149    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qkbcb"]
Jul 17 18:03:30.166458 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:03:30.166436    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-cqlww], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qkbcb" podUID="1823c89c-8443-4e6e-82a5-3a4617c397b8"
Jul 17 18:03:30.171490 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:30.171458    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1823c89c-8443-4e6e-82a5-3a4617c397b8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qkbcb\" (UID: \"1823c89c-8443-4e6e-82a5-3a4617c397b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qkbcb"
Jul 17 18:03:30.171648 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:30.171531    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqlww\" (UniqueName: \"kubernetes.io/projected/1823c89c-8443-4e6e-82a5-3a4617c397b8-kube-api-access-cqlww\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qkbcb\" (UID: \"1823c89c-8443-4e6e-82a5-3a4617c397b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qkbcb"
Jul 17 18:03:30.272977 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:30.272931    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqlww\" (UniqueName: \"kubernetes.io/projected/1823c89c-8443-4e6e-82a5-3a4617c397b8-kube-api-access-cqlww\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qkbcb\" (UID: \"1823c89c-8443-4e6e-82a5-3a4617c397b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qkbcb"
Jul 17 18:03:30.273174 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:30.273069    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1823c89c-8443-4e6e-82a5-3a4617c397b8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qkbcb\" (UID: \"1823c89c-8443-4e6e-82a5-3a4617c397b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qkbcb"
Jul 17 18:03:30.273410 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:30.273393    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1823c89c-8443-4e6e-82a5-3a4617c397b8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qkbcb\" (UID: \"1823c89c-8443-4e6e-82a5-3a4617c397b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qkbcb"
Jul 17 18:03:30.283539 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:30.283504    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqlww\" (UniqueName: \"kubernetes.io/projected/1823c89c-8443-4e6e-82a5-3a4617c397b8-kube-api-access-cqlww\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-qkbcb\" (UID: \"1823c89c-8443-4e6e-82a5-3a4617c397b8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qkbcb"
Jul 17 18:03:30.468350 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:30.468324    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qkbcb"
Jul 17 18:03:30.475410 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:30.475388    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qkbcb"
Jul 17 18:03:30.575643 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:30.575596    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1823c89c-8443-4e6e-82a5-3a4617c397b8-extensions-socket-volume\") pod \"1823c89c-8443-4e6e-82a5-3a4617c397b8\" (UID: \"1823c89c-8443-4e6e-82a5-3a4617c397b8\") "
Jul 17 18:03:30.575643 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:30.575650    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cqlww\" (UniqueName: \"kubernetes.io/projected/1823c89c-8443-4e6e-82a5-3a4617c397b8-kube-api-access-cqlww\") pod \"1823c89c-8443-4e6e-82a5-3a4617c397b8\" (UID: \"1823c89c-8443-4e6e-82a5-3a4617c397b8\") "
Jul 17 18:03:30.575902 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:30.575874    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1823c89c-8443-4e6e-82a5-3a4617c397b8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1823c89c-8443-4e6e-82a5-3a4617c397b8" (UID: "1823c89c-8443-4e6e-82a5-3a4617c397b8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:03:30.577748 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:30.577722    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1823c89c-8443-4e6e-82a5-3a4617c397b8-kube-api-access-cqlww" (OuterVolumeSpecName: "kube-api-access-cqlww") pod "1823c89c-8443-4e6e-82a5-3a4617c397b8" (UID: "1823c89c-8443-4e6e-82a5-3a4617c397b8"). InnerVolumeSpecName "kube-api-access-cqlww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:03:30.666837 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:30.666800    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qkbcb"]
Jul 17 18:03:30.676452 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:30.676418    2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1823c89c-8443-4e6e-82a5-3a4617c397b8-extensions-socket-volume\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:03:30.676452 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:30.676445    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqlww\" (UniqueName: \"kubernetes.io/projected/1823c89c-8443-4e6e-82a5-3a4617c397b8-kube-api-access-cqlww\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:03:30.681731 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:30.681703    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qkbcb"]
Jul 17 18:03:30.728139 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:30.727922    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5p8t4"]
Jul 17 18:03:30.736344 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:30.736314    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5p8t4"
Jul 17 18:03:30.748494 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:30.748469    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5p8t4"]
Jul 17 18:03:30.878597 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:30.878557    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4074745-d3c9-4b72-9844-a72cd8e9c0be-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5p8t4\" (UID: \"c4074745-d3c9-4b72-9844-a72cd8e9c0be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5p8t4"
Jul 17 18:03:30.878803 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:30.878612    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g29p9\" (UniqueName: \"kubernetes.io/projected/c4074745-d3c9-4b72-9844-a72cd8e9c0be-kube-api-access-g29p9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5p8t4\" (UID: \"c4074745-d3c9-4b72-9844-a72cd8e9c0be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5p8t4"
Jul 17 18:03:30.979971 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:30.979862    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g29p9\" (UniqueName: \"kubernetes.io/projected/c4074745-d3c9-4b72-9844-a72cd8e9c0be-kube-api-access-g29p9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5p8t4\" (UID: \"c4074745-d3c9-4b72-9844-a72cd8e9c0be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5p8t4"
Jul 17 18:03:30.980176 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:30.979982    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4074745-d3c9-4b72-9844-a72cd8e9c0be-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5p8t4\" (UID: \"c4074745-d3c9-4b72-9844-a72cd8e9c0be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5p8t4"
Jul 17 18:03:30.980375 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:30.980355    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4074745-d3c9-4b72-9844-a72cd8e9c0be-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5p8t4\" (UID: \"c4074745-d3c9-4b72-9844-a72cd8e9c0be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5p8t4"
Jul 17 18:03:30.989038 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:30.988991    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g29p9\" (UniqueName: \"kubernetes.io/projected/c4074745-d3c9-4b72-9844-a72cd8e9c0be-kube-api-access-g29p9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5p8t4\" (UID: \"c4074745-d3c9-4b72-9844-a72cd8e9c0be\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5p8t4"
Jul 17 18:03:31.048745 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:31.048702    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5p8t4"
Jul 17 18:03:31.184181 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:31.184156    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5p8t4"]
Jul 17 18:03:31.186785 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:03:31.186755    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4074745_d3c9_4b72_9844_a72cd8e9c0be.slice/crio-94d7e7fbbeeafcc5417e016b506b81b16fddbe5a15cfb69cd6d458cf4cb6ff93 WatchSource:0}: Error finding container 94d7e7fbbeeafcc5417e016b506b81b16fddbe5a15cfb69cd6d458cf4cb6ff93: Status 404 returned error can't find the container with id 94d7e7fbbeeafcc5417e016b506b81b16fddbe5a15cfb69cd6d458cf4cb6ff93
Jul 17 18:03:31.471750 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:31.471720    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1823c89c-8443-4e6e-82a5-3a4617c397b8" path="/var/lib/kubelet/pods/1823c89c-8443-4e6e-82a5-3a4617c397b8/volumes"
Jul 17 18:03:31.474364 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:31.474327    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5p8t4" event={"ID":"c4074745-d3c9-4b72-9844-a72cd8e9c0be","Type":"ContainerStarted","Data":"94d7e7fbbeeafcc5417e016b506b81b16fddbe5a15cfb69cd6d458cf4cb6ff93"}
Jul 17 18:03:31.474364 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:31.474353    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-qkbcb"
Jul 17 18:03:33.593353 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:33.593315    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:33.789732 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:33.789673    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:36.498096 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:36.498062    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5p8t4" event={"ID":"c4074745-d3c9-4b72-9844-a72cd8e9c0be","Type":"ContainerStarted","Data":"b398c9b4b410cf40a15aec2516e14e165ce440cc1de0da439a89c1b7b093d31a"}
Jul 17 18:03:36.498498 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:36.498133    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5p8t4"
Jul 17 18:03:36.519204 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:36.519150    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5p8t4" podStartSLOduration=2.22949345 podStartE2EDuration="6.519129678s" totalImagesPullingTime="4.289636228s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:03:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:03:36.517847061 +0000 UTC m=+443.743076369" watchObservedRunningTime="2026-07-17 18:03:36.519129678 +0000 UTC m=+443.744358989"
Jul 17 18:03:37.382494 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:37.382455    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:37.437367 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:37.437336    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:37.588786 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:37.588750    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:37.646024 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:37.645906    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:40.110454 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:40.110418    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:40.209678 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:40.209638    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:44.400296 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:44.400251    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:44.532355 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:44.532313    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:46.578564 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:46.578529    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:46.679477 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:46.679429    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:47.505877 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:47.505840    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5p8t4"
Jul 17 18:03:51.354017 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:51.353959    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:51.455319 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:51.455271    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:55.139541 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:55.139474    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:55.207884 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:55.207849    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:55.228720 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:55.228689    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5p8t4"]
Jul 17 18:03:55.228993 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:55.228966    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5p8t4" podUID="c4074745-d3c9-4b72-9844-a72cd8e9c0be" containerName="manager" containerID="cri-o://b398c9b4b410cf40a15aec2516e14e165ce440cc1de0da439a89c1b7b093d31a" gracePeriod=10
Jul 17 18:03:55.487511 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:55.487484    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5p8t4"
Jul 17 18:03:55.581783 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:55.581747    2572 generic.go:356] "Generic (PLEG): container finished" podID="c4074745-d3c9-4b72-9844-a72cd8e9c0be" containerID="b398c9b4b410cf40a15aec2516e14e165ce440cc1de0da439a89c1b7b093d31a" exitCode=0
Jul 17 18:03:55.581783 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:55.581786    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5p8t4" event={"ID":"c4074745-d3c9-4b72-9844-a72cd8e9c0be","Type":"ContainerDied","Data":"b398c9b4b410cf40a15aec2516e14e165ce440cc1de0da439a89c1b7b093d31a"}
Jul 17 18:03:55.582023 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:55.581790    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5p8t4"
Jul 17 18:03:55.582023 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:55.581825    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5p8t4" event={"ID":"c4074745-d3c9-4b72-9844-a72cd8e9c0be","Type":"ContainerDied","Data":"94d7e7fbbeeafcc5417e016b506b81b16fddbe5a15cfb69cd6d458cf4cb6ff93"}
Jul 17 18:03:55.582023 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:55.581846    2572 scope.go:117] "RemoveContainer" containerID="b398c9b4b410cf40a15aec2516e14e165ce440cc1de0da439a89c1b7b093d31a"
Jul 17 18:03:55.587885 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:55.587860    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g29p9\" (UniqueName: \"kubernetes.io/projected/c4074745-d3c9-4b72-9844-a72cd8e9c0be-kube-api-access-g29p9\") pod \"c4074745-d3c9-4b72-9844-a72cd8e9c0be\" (UID: \"c4074745-d3c9-4b72-9844-a72cd8e9c0be\") "
Jul 17 18:03:55.588035 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:55.587953    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4074745-d3c9-4b72-9844-a72cd8e9c0be-extensions-socket-volume\") pod \"c4074745-d3c9-4b72-9844-a72cd8e9c0be\" (UID: \"c4074745-d3c9-4b72-9844-a72cd8e9c0be\") "
Jul 17 18:03:55.588433 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:55.588411    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4074745-d3c9-4b72-9844-a72cd8e9c0be-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c4074745-d3c9-4b72-9844-a72cd8e9c0be" (UID: "c4074745-d3c9-4b72-9844-a72cd8e9c0be"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:03:55.590598 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:55.590566    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4074745-d3c9-4b72-9844-a72cd8e9c0be-kube-api-access-g29p9" (OuterVolumeSpecName: "kube-api-access-g29p9") pod "c4074745-d3c9-4b72-9844-a72cd8e9c0be" (UID: "c4074745-d3c9-4b72-9844-a72cd8e9c0be"). InnerVolumeSpecName "kube-api-access-g29p9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:03:55.591109 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:55.591088    2572 scope.go:117] "RemoveContainer" containerID="b398c9b4b410cf40a15aec2516e14e165ce440cc1de0da439a89c1b7b093d31a"
Jul 17 18:03:55.591421 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:03:55.591396    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b398c9b4b410cf40a15aec2516e14e165ce440cc1de0da439a89c1b7b093d31a\": container with ID starting with b398c9b4b410cf40a15aec2516e14e165ce440cc1de0da439a89c1b7b093d31a not found: ID does not exist" containerID="b398c9b4b410cf40a15aec2516e14e165ce440cc1de0da439a89c1b7b093d31a"
Jul 17 18:03:55.591524 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:55.591427    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b398c9b4b410cf40a15aec2516e14e165ce440cc1de0da439a89c1b7b093d31a"} err="failed to get container status \"b398c9b4b410cf40a15aec2516e14e165ce440cc1de0da439a89c1b7b093d31a\": rpc error: code = NotFound desc = could not find container \"b398c9b4b410cf40a15aec2516e14e165ce440cc1de0da439a89c1b7b093d31a\": container with ID starting with b398c9b4b410cf40a15aec2516e14e165ce440cc1de0da439a89c1b7b093d31a not found: ID does not exist"
Jul 17 18:03:55.689515 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:55.689485    2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4074745-d3c9-4b72-9844-a72cd8e9c0be-extensions-socket-volume\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:03:55.689515 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:55.689516    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g29p9\" (UniqueName: \"kubernetes.io/projected/c4074745-d3c9-4b72-9844-a72cd8e9c0be-kube-api-access-g29p9\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:03:55.795134 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:55.795100    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:55.895189 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:55.895154    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:55.911375 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:55.911341    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5p8t4"]
Jul 17 18:03:55.916953 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:55.916928    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5p8t4"]
Jul 17 18:03:57.471432 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:57.471391    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4074745-d3c9-4b72-9844-a72cd8e9c0be" path="/var/lib/kubelet/pods/c4074745-d3c9-4b72-9844-a72cd8e9c0be/volumes"
Jul 17 18:03:59.545123 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:59.545090    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:03:59.598574 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:03:59.598482    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:04:05.591017 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:05.590955    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:04:05.651423 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:05.651369    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:04:10.348507 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:10.348469    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:04:10.450429 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:10.450397    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:04:11.528724 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.528694    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"]
Jul 17 18:04:11.529118 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.529044    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4074745-d3c9-4b72-9844-a72cd8e9c0be" containerName="manager"
Jul 17 18:04:11.529118 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.529056    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4074745-d3c9-4b72-9844-a72cd8e9c0be" containerName="manager"
Jul 17 18:04:11.529193 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.529125    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4074745-d3c9-4b72-9844-a72cd8e9c0be" containerName="manager"
Jul 17 18:04:11.532991 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.532969    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:04:11.535905 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.535882    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-gl5vb\""
Jul 17 18:04:11.548715 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.548693    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"]
Jul 17 18:04:11.571159 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.571117    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:04:11.633553 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.633513    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14cc383a-23f0-4842-8d03-2fb3f65d95dc-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-782cg\" (UID: \"14cc383a-23f0-4842-8d03-2fb3f65d95dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:04:11.633726 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.633560    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14cc383a-23f0-4842-8d03-2fb3f65d95dc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-782cg\" (UID: \"14cc383a-23f0-4842-8d03-2fb3f65d95dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:04:11.633726 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.633625    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14cc383a-23f0-4842-8d03-2fb3f65d95dc-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-782cg\" (UID: \"14cc383a-23f0-4842-8d03-2fb3f65d95dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:04:11.633726 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.633660    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdz99\" (UniqueName: \"kubernetes.io/projected/14cc383a-23f0-4842-8d03-2fb3f65d95dc-kube-api-access-mdz99\") pod \"maas-default-gateway-openshift-default-5896d4dd49-782cg\" (UID: \"14cc383a-23f0-4842-8d03-2fb3f65d95dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:04:11.633726 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.633683    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14cc383a-23f0-4842-8d03-2fb3f65d95dc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-782cg\" (UID: \"14cc383a-23f0-4842-8d03-2fb3f65d95dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:04:11.633726 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.633707    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14cc383a-23f0-4842-8d03-2fb3f65d95dc-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-782cg\" (UID: \"14cc383a-23f0-4842-8d03-2fb3f65d95dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:04:11.633899 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.633781    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14cc383a-23f0-4842-8d03-2fb3f65d95dc-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-782cg\" (UID: \"14cc383a-23f0-4842-8d03-2fb3f65d95dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:04:11.633899 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.633798    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14cc383a-23f0-4842-8d03-2fb3f65d95dc-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-782cg\" (UID: \"14cc383a-23f0-4842-8d03-2fb3f65d95dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:04:11.633899 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.633862    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14cc383a-23f0-4842-8d03-2fb3f65d95dc-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-782cg\" (UID: \"14cc383a-23f0-4842-8d03-2fb3f65d95dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:04:11.669920 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.669887    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:04:11.735303 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.735270    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14cc383a-23f0-4842-8d03-2fb3f65d95dc-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-782cg\" (UID: \"14cc383a-23f0-4842-8d03-2fb3f65d95dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:04:11.735505 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.735327    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14cc383a-23f0-4842-8d03-2fb3f65d95dc-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-782cg\" (UID: \"14cc383a-23f0-4842-8d03-2fb3f65d95dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:04:11.735505 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.735449    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14cc383a-23f0-4842-8d03-2fb3f65d95dc-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-782cg\" (UID: \"14cc383a-23f0-4842-8d03-2fb3f65d95dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:04:11.735629 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.735515    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14cc383a-23f0-4842-8d03-2fb3f65d95dc-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-782cg\" (UID: \"14cc383a-23f0-4842-8d03-2fb3f65d95dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:04:11.735629 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.735549    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14cc383a-23f0-4842-8d03-2fb3f65d95dc-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-782cg\" (UID: \"14cc383a-23f0-4842-8d03-2fb3f65d95dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:04:11.735629 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.735593    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14cc383a-23f0-4842-8d03-2fb3f65d95dc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-782cg\" (UID: \"14cc383a-23f0-4842-8d03-2fb3f65d95dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:04:11.735784 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.735644    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14cc383a-23f0-4842-8d03-2fb3f65d95dc-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-782cg\" (UID: \"14cc383a-23f0-4842-8d03-2fb3f65d95dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:04:11.735784 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.735670    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdz99\" (UniqueName: \"kubernetes.io/projected/14cc383a-23f0-4842-8d03-2fb3f65d95dc-kube-api-access-mdz99\") pod \"maas-default-gateway-openshift-default-5896d4dd49-782cg\" (UID: \"14cc383a-23f0-4842-8d03-2fb3f65d95dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:04:11.735784 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.735699    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14cc383a-23f0-4842-8d03-2fb3f65d95dc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-782cg\" (UID: \"14cc383a-23f0-4842-8d03-2fb3f65d95dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:04:11.735784 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.735702    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/14cc383a-23f0-4842-8d03-2fb3f65d95dc-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-782cg\" (UID: \"14cc383a-23f0-4842-8d03-2fb3f65d95dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:04:11.735784 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.735763    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/14cc383a-23f0-4842-8d03-2fb3f65d95dc-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-782cg\" (UID: \"14cc383a-23f0-4842-8d03-2fb3f65d95dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:04:11.735975 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.735930    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/14cc383a-23f0-4842-8d03-2fb3f65d95dc-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-782cg\" (UID: \"14cc383a-23f0-4842-8d03-2fb3f65d95dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:04:11.736048 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.736014    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/14cc383a-23f0-4842-8d03-2fb3f65d95dc-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-782cg\" (UID: \"14cc383a-23f0-4842-8d03-2fb3f65d95dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:04:11.736435 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.736412    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/14cc383a-23f0-4842-8d03-2fb3f65d95dc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-782cg\" (UID: \"14cc383a-23f0-4842-8d03-2fb3f65d95dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:04:11.737955 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.737929    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/14cc383a-23f0-4842-8d03-2fb3f65d95dc-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-782cg\" (UID: \"14cc383a-23f0-4842-8d03-2fb3f65d95dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:04:11.738186 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.738169    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/14cc383a-23f0-4842-8d03-2fb3f65d95dc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-782cg\" (UID: \"14cc383a-23f0-4842-8d03-2fb3f65d95dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:04:11.743716 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.743677    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/14cc383a-23f0-4842-8d03-2fb3f65d95dc-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-782cg\" (UID: \"14cc383a-23f0-4842-8d03-2fb3f65d95dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:04:11.743847 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.743763    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdz99\" (UniqueName: \"kubernetes.io/projected/14cc383a-23f0-4842-8d03-2fb3f65d95dc-kube-api-access-mdz99\") pod \"maas-default-gateway-openshift-default-5896d4dd49-782cg\" (UID: \"14cc383a-23f0-4842-8d03-2fb3f65d95dc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:04:11.843283 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.843189    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:04:11.982801 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.982777    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"]
Jul 17 18:04:11.984682 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:04:11.984652    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14cc383a_23f0_4842_8d03_2fb3f65d95dc.slice/crio-0eac555418f5ec1a0bea9e97f807b34c63c8b79747faf10b05ed45aa6226ce1b WatchSource:0}: Error finding container 0eac555418f5ec1a0bea9e97f807b34c63c8b79747faf10b05ed45aa6226ce1b: Status 404 returned error can't find the container with id 0eac555418f5ec1a0bea9e97f807b34c63c8b79747faf10b05ed45aa6226ce1b
Jul 17 18:04:11.986835 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.986806    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:04:11.986924 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.986891    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:04:11.986984 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:11.986934    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:04:12.662477 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:12.662445    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg" event={"ID":"14cc383a-23f0-4842-8d03-2fb3f65d95dc","Type":"ContainerStarted","Data":"2bda10ea26988c3bd2bbe46bb6bd06e2d30b65e45c17d1a07a9de62cc6171d89"}
Jul 17 18:04:12.662866 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:12.662498    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg" event={"ID":"14cc383a-23f0-4842-8d03-2fb3f65d95dc","Type":"ContainerStarted","Data":"0eac555418f5ec1a0bea9e97f807b34c63c8b79747faf10b05ed45aa6226ce1b"}
Jul 17 18:04:12.686307 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:12.686250    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg" podStartSLOduration=1.686232644 podStartE2EDuration="1.686232644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:04:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:04:12.685449194 +0000 UTC m=+479.910678526" watchObservedRunningTime="2026-07-17 18:04:12.686232644 +0000 UTC m=+479.911461951"
Jul 17 18:04:12.844030 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:12.843978    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:04:13.849545 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:13.849514    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:04:14.353023 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:14.352969    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:04:14.359347 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:14.359320    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qtqk5"]
Jul 17 18:04:14.363810 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:14.363785    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtqk5"
Jul 17 18:04:14.366248 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:14.366226    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 17 18:04:14.367184 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:14.367164    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 17 18:04:14.367304 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:14.367226    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-96dnt\""
Jul 17 18:04:14.367304 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:14.367229    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 17 18:04:14.370377 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:14.370353    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qtqk5"]
Jul 17 18:04:14.459606 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:14.459568    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qtqk5"]
Jul 17 18:04:14.462578 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:14.462542    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmqvg\" (UniqueName: \"kubernetes.io/projected/4d715c3c-a7d3-4e98-9e89-41e5b1037743-kube-api-access-qmqvg\") pod \"limitador-limitador-64c94fd64f-qtqk5\" (UID: \"4d715c3c-a7d3-4e98-9e89-41e5b1037743\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qtqk5"
Jul 17 18:04:14.462704 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:14.462642    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4d715c3c-a7d3-4e98-9e89-41e5b1037743-config-file\") pod \"limitador-limitador-64c94fd64f-qtqk5\" (UID: \"4d715c3c-a7d3-4e98-9e89-41e5b1037743\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qtqk5"
Jul 17 18:04:14.464116 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:14.464091    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:04:14.523736 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:14.523704    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:04:14.563458 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:14.563424    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmqvg\" (UniqueName: \"kubernetes.io/projected/4d715c3c-a7d3-4e98-9e89-41e5b1037743-kube-api-access-qmqvg\") pod \"limitador-limitador-64c94fd64f-qtqk5\" (UID: \"4d715c3c-a7d3-4e98-9e89-41e5b1037743\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qtqk5"
Jul 17 18:04:14.563679 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:14.563468    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4d715c3c-a7d3-4e98-9e89-41e5b1037743-config-file\") pod \"limitador-limitador-64c94fd64f-qtqk5\" (UID: \"4d715c3c-a7d3-4e98-9e89-41e5b1037743\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qtqk5"
Jul 17 18:04:14.564259 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:14.564234    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4d715c3c-a7d3-4e98-9e89-41e5b1037743-config-file\") pod \"limitador-limitador-64c94fd64f-qtqk5\" (UID: \"4d715c3c-a7d3-4e98-9e89-41e5b1037743\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qtqk5"
Jul 17 18:04:14.572682 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:14.572656    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmqvg\" (UniqueName: \"kubernetes.io/projected/4d715c3c-a7d3-4e98-9e89-41e5b1037743-kube-api-access-qmqvg\") pod \"limitador-limitador-64c94fd64f-qtqk5\" (UID: \"4d715c3c-a7d3-4e98-9e89-41e5b1037743\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qtqk5"
Jul 17 18:04:14.672056 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:14.671952    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:04:14.673111 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:14.673085    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:04:14.675959 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:14.675941    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtqk5"
Jul 17 18:04:14.818144 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:14.818118    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qtqk5"]
Jul 17 18:04:14.820572 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:04:14.820541    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d715c3c_a7d3_4e98_9e89_41e5b1037743.slice/crio-e6a77b2682c47eaf651c3f4b71bb53f52f31bf0b8852af1e52c04162bc16cc13 WatchSource:0}: Error finding container e6a77b2682c47eaf651c3f4b71bb53f52f31bf0b8852af1e52c04162bc16cc13: Status 404 returned error can't find the container with id e6a77b2682c47eaf651c3f4b71bb53f52f31bf0b8852af1e52c04162bc16cc13
Jul 17 18:04:15.197722 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:15.197684    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:04:15.291863 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:15.291831    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:04:15.376669 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:15.376637    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-cbf4m"]
Jul 17 18:04:15.380943 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:15.380923    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cbf4m"
Jul 17 18:04:15.383482 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:15.383453    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-zxtj5\""
Jul 17 18:04:15.384927 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:15.384898    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cbf4m"]
Jul 17 18:04:15.471149 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:15.471071    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm7g6\" (UniqueName: \"kubernetes.io/projected/b9b18c21-c64d-4c33-915d-db35d54bf4a4-kube-api-access-vm7g6\") pod \"authorino-75d556bd77-cbf4m\" (UID: \"b9b18c21-c64d-4c33-915d-db35d54bf4a4\") " pod="kuadrant-system/authorino-75d556bd77-cbf4m"
Jul 17 18:04:15.572401 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:15.572355    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm7g6\" (UniqueName: \"kubernetes.io/projected/b9b18c21-c64d-4c33-915d-db35d54bf4a4-kube-api-access-vm7g6\") pod \"authorino-75d556bd77-cbf4m\" (UID: \"b9b18c21-c64d-4c33-915d-db35d54bf4a4\") " pod="kuadrant-system/authorino-75d556bd77-cbf4m"
Jul 17 18:04:15.580870 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:15.580826    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm7g6\" (UniqueName: \"kubernetes.io/projected/b9b18c21-c64d-4c33-915d-db35d54bf4a4-kube-api-access-vm7g6\") pod \"authorino-75d556bd77-cbf4m\" (UID: \"b9b18c21-c64d-4c33-915d-db35d54bf4a4\") " pod="kuadrant-system/authorino-75d556bd77-cbf4m"
Jul 17 18:04:15.684984 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:15.684948    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtqk5" event={"ID":"4d715c3c-a7d3-4e98-9e89-41e5b1037743","Type":"ContainerStarted","Data":"e6a77b2682c47eaf651c3f4b71bb53f52f31bf0b8852af1e52c04162bc16cc13"}
Jul 17 18:04:15.692306 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:15.692274    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cbf4m"
Jul 17 18:04:15.895793 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:15.895733    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cbf4m"]
Jul 17 18:04:16.694256 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:16.694219    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cbf4m" event={"ID":"b9b18c21-c64d-4c33-915d-db35d54bf4a4","Type":"ContainerStarted","Data":"70045bfdde755cc02ae3cbed35fa110bb4fff517cee21198568d2274e8b88082"}
Jul 17 18:04:19.710605 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:19.710557    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cbf4m" event={"ID":"b9b18c21-c64d-4c33-915d-db35d54bf4a4","Type":"ContainerStarted","Data":"0841f35ec144bb8fd003d400cc666c4ff157c697df1e8802be9577563c7372f4"}
Jul 17 18:04:19.712076 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:19.712044    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtqk5" event={"ID":"4d715c3c-a7d3-4e98-9e89-41e5b1037743","Type":"ContainerStarted","Data":"1bc9794a6e0d1857daae0158c916b587f09db4356bb238cd905978dccdc121d8"}
Jul 17 18:04:19.712210 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:19.712190    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtqk5"
Jul 17 18:04:19.725291 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:19.725230    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-cbf4m" podStartSLOduration=1.066651576 podStartE2EDuration="4.725212767s" totalImagesPullingTime="3.658561191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:04:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:04:19.724305038 +0000 UTC m=+486.949534347" watchObservedRunningTime="2026-07-17 18:04:19.725212767 +0000 UTC m=+486.950442078"
Jul 17 18:04:19.748955 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:19.748856    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtqk5" podStartSLOduration=1.018362124 podStartE2EDuration="5.748833903s" totalImagesPullingTime="4.730471779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:04:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:04:19.748064288 +0000 UTC m=+486.973293612" watchObservedRunningTime="2026-07-17 18:04:19.748833903 +0000 UTC m=+486.974063212"
Jul 17 18:04:30.717683 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:30.717653    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtqk5"
Jul 17 18:04:31.447516 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:31.447481    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qtqk5"]
Jul 17 18:04:31.447719 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:31.447691    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtqk5" podUID="4d715c3c-a7d3-4e98-9e89-41e5b1037743" containerName="limitador" containerID="cri-o://1bc9794a6e0d1857daae0158c916b587f09db4356bb238cd905978dccdc121d8" gracePeriod=30
Jul 17 18:04:32.000823 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:32.000796    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtqk5"
Jul 17 18:04:32.014342 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:32.014271    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4d715c3c-a7d3-4e98-9e89-41e5b1037743-config-file\") pod \"4d715c3c-a7d3-4e98-9e89-41e5b1037743\" (UID: \"4d715c3c-a7d3-4e98-9e89-41e5b1037743\") "
Jul 17 18:04:32.014342 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:32.014313    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmqvg\" (UniqueName: \"kubernetes.io/projected/4d715c3c-a7d3-4e98-9e89-41e5b1037743-kube-api-access-qmqvg\") pod \"4d715c3c-a7d3-4e98-9e89-41e5b1037743\" (UID: \"4d715c3c-a7d3-4e98-9e89-41e5b1037743\") "
Jul 17 18:04:32.014687 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:32.014655    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d715c3c-a7d3-4e98-9e89-41e5b1037743-config-file" (OuterVolumeSpecName: "config-file") pod "4d715c3c-a7d3-4e98-9e89-41e5b1037743" (UID: "4d715c3c-a7d3-4e98-9e89-41e5b1037743"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:04:32.016638 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:32.016590    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d715c3c-a7d3-4e98-9e89-41e5b1037743-kube-api-access-qmqvg" (OuterVolumeSpecName: "kube-api-access-qmqvg") pod "4d715c3c-a7d3-4e98-9e89-41e5b1037743" (UID: "4d715c3c-a7d3-4e98-9e89-41e5b1037743"). InnerVolumeSpecName "kube-api-access-qmqvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:04:32.115489 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:32.115445    2572 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4d715c3c-a7d3-4e98-9e89-41e5b1037743-config-file\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:04:32.115489 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:32.115483    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmqvg\" (UniqueName: \"kubernetes.io/projected/4d715c3c-a7d3-4e98-9e89-41e5b1037743-kube-api-access-qmqvg\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:04:32.769973 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:32.769937    2572 generic.go:356] "Generic (PLEG): container finished" podID="4d715c3c-a7d3-4e98-9e89-41e5b1037743" containerID="1bc9794a6e0d1857daae0158c916b587f09db4356bb238cd905978dccdc121d8" exitCode=0
Jul 17 18:04:32.770163 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:32.769984    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtqk5"
Jul 17 18:04:32.770163 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:32.770026    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtqk5" event={"ID":"4d715c3c-a7d3-4e98-9e89-41e5b1037743","Type":"ContainerDied","Data":"1bc9794a6e0d1857daae0158c916b587f09db4356bb238cd905978dccdc121d8"}
Jul 17 18:04:32.770163 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:32.770088    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qtqk5" event={"ID":"4d715c3c-a7d3-4e98-9e89-41e5b1037743","Type":"ContainerDied","Data":"e6a77b2682c47eaf651c3f4b71bb53f52f31bf0b8852af1e52c04162bc16cc13"}
Jul 17 18:04:32.770163 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:32.770118    2572 scope.go:117] "RemoveContainer" containerID="1bc9794a6e0d1857daae0158c916b587f09db4356bb238cd905978dccdc121d8"
Jul 17 18:04:32.779235 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:32.779217    2572 scope.go:117] "RemoveContainer" containerID="1bc9794a6e0d1857daae0158c916b587f09db4356bb238cd905978dccdc121d8"
Jul 17 18:04:32.779483 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:04:32.779463    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1bc9794a6e0d1857daae0158c916b587f09db4356bb238cd905978dccdc121d8\": container with ID starting with 1bc9794a6e0d1857daae0158c916b587f09db4356bb238cd905978dccdc121d8 not found: ID does not exist" containerID="1bc9794a6e0d1857daae0158c916b587f09db4356bb238cd905978dccdc121d8"
Jul 17 18:04:32.779543 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:32.779489    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1bc9794a6e0d1857daae0158c916b587f09db4356bb238cd905978dccdc121d8"} err="failed to get container status \"1bc9794a6e0d1857daae0158c916b587f09db4356bb238cd905978dccdc121d8\": rpc error: code = NotFound desc = could not find container \"1bc9794a6e0d1857daae0158c916b587f09db4356bb238cd905978dccdc121d8\": container with ID starting with 1bc9794a6e0d1857daae0158c916b587f09db4356bb238cd905978dccdc121d8 not found: ID does not exist"
Jul 17 18:04:32.790323 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:32.790284    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qtqk5"]
Jul 17 18:04:32.794191 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:32.794167    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qtqk5"]
Jul 17 18:04:33.471508 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:33.471472    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d715c3c-a7d3-4e98-9e89-41e5b1037743" path="/var/lib/kubelet/pods/4d715c3c-a7d3-4e98-9e89-41e5b1037743/volumes"
Jul 17 18:04:34.450623 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:34.450590    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:04:34.959768 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:34.959731    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:04:35.056264 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:35.056226    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:04:35.418325 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:35.418243    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-g4wgb"]
Jul 17 18:04:35.418635 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:35.418622    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d715c3c-a7d3-4e98-9e89-41e5b1037743" containerName="limitador"
Jul 17 18:04:35.418677 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:35.418637    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d715c3c-a7d3-4e98-9e89-41e5b1037743" containerName="limitador"
Jul 17 18:04:35.418712 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:35.418700    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d715c3c-a7d3-4e98-9e89-41e5b1037743" containerName="limitador"
Jul 17 18:04:35.422930 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:35.422902    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g4wgb"
Jul 17 18:04:35.425529 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:35.425501    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-74zjx\""
Jul 17 18:04:35.425758 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:35.425735    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 17 18:04:35.426600 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:35.426581    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 17 18:04:35.426707 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:35.426584    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 17 18:04:35.429969 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:35.429944    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-g4wgb"]
Jul 17 18:04:35.441371 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:35.441340    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwlhv\" (UniqueName: \"kubernetes.io/projected/7120cfdb-5cf3-4c51-8777-4d241b4d01f3-kube-api-access-jwlhv\") pod \"postgres-69fb4594cf-g4wgb\" (UID: \"7120cfdb-5cf3-4c51-8777-4d241b4d01f3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g4wgb"
Jul 17 18:04:35.441533 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:35.441407    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7120cfdb-5cf3-4c51-8777-4d241b4d01f3-data\") pod \"postgres-69fb4594cf-g4wgb\" (UID: \"7120cfdb-5cf3-4c51-8777-4d241b4d01f3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g4wgb"
Jul 17 18:04:35.453905 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:35.453867    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:04:35.542234 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:35.542195    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwlhv\" (UniqueName: \"kubernetes.io/projected/7120cfdb-5cf3-4c51-8777-4d241b4d01f3-kube-api-access-jwlhv\") pod \"postgres-69fb4594cf-g4wgb\" (UID: \"7120cfdb-5cf3-4c51-8777-4d241b4d01f3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g4wgb"
Jul 17 18:04:35.542407 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:35.542255    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7120cfdb-5cf3-4c51-8777-4d241b4d01f3-data\") pod \"postgres-69fb4594cf-g4wgb\" (UID: \"7120cfdb-5cf3-4c51-8777-4d241b4d01f3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g4wgb"
Jul 17 18:04:35.542584 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:35.542568    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7120cfdb-5cf3-4c51-8777-4d241b4d01f3-data\") pod \"postgres-69fb4594cf-g4wgb\" (UID: \"7120cfdb-5cf3-4c51-8777-4d241b4d01f3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g4wgb"
Jul 17 18:04:35.550493 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:35.550463    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwlhv\" (UniqueName: \"kubernetes.io/projected/7120cfdb-5cf3-4c51-8777-4d241b4d01f3-kube-api-access-jwlhv\") pod \"postgres-69fb4594cf-g4wgb\" (UID: \"7120cfdb-5cf3-4c51-8777-4d241b4d01f3\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g4wgb"
Jul 17 18:04:35.735134 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:35.735098    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g4wgb"
Jul 17 18:04:35.872891 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:35.872855    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-g4wgb"]
Jul 17 18:04:35.875508 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:04:35.875477    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7120cfdb_5cf3_4c51_8777_4d241b4d01f3.slice/crio-9482c046bd0834bd5a6ebf461c72b4e7c77567cbced1af7f35932db01c6105d5 WatchSource:0}: Error finding container 9482c046bd0834bd5a6ebf461c72b4e7c77567cbced1af7f35932db01c6105d5: Status 404 returned error can't find the container with id 9482c046bd0834bd5a6ebf461c72b4e7c77567cbced1af7f35932db01c6105d5
Jul 17 18:04:36.790057 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:36.790023    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g4wgb" event={"ID":"7120cfdb-5cf3-4c51-8777-4d241b4d01f3","Type":"ContainerStarted","Data":"9482c046bd0834bd5a6ebf461c72b4e7c77567cbced1af7f35932db01c6105d5"}
Jul 17 18:04:41.816052 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:41.816012    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g4wgb" event={"ID":"7120cfdb-5cf3-4c51-8777-4d241b4d01f3","Type":"ContainerStarted","Data":"79ddaec856488bd643c18dfc19b6394fd96752762d860e682cdbf6062cae2e77"}
Jul 17 18:04:41.816525 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:41.816113    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g4wgb"
Jul 17 18:04:41.830747 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:41.830696    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g4wgb" podStartSLOduration=1.75280978 podStartE2EDuration="6.830678061s" totalImagesPullingTime="5.077868281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:04:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:04:41.830201806 +0000 UTC m=+509.055431106" watchObservedRunningTime="2026-07-17 18:04:41.830678061 +0000 UTC m=+509.055907369"
Jul 17 18:04:47.852050 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:47.852014    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g4wgb"
Jul 17 18:04:48.160458 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:48.160367    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:04:48.380808 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:48.380776    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sn4wd"]
Jul 17 18:04:48.398783 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:48.398698    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sn4wd"]
Jul 17 18:04:48.398975 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:48.398816    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-sn4wd"
Jul 17 18:04:48.460109 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:48.460077    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7zd8\" (UniqueName: \"kubernetes.io/projected/2f291c27-9e16-44d4-880e-bf9f2c8c7a44-kube-api-access-s7zd8\") pod \"authorino-5d4b67c446-sn4wd\" (UID: \"2f291c27-9e16-44d4-880e-bf9f2c8c7a44\") " pod="kuadrant-system/authorino-5d4b67c446-sn4wd"
Jul 17 18:04:48.561068 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:48.561034    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7zd8\" (UniqueName: \"kubernetes.io/projected/2f291c27-9e16-44d4-880e-bf9f2c8c7a44-kube-api-access-s7zd8\") pod \"authorino-5d4b67c446-sn4wd\" (UID: \"2f291c27-9e16-44d4-880e-bf9f2c8c7a44\") " pod="kuadrant-system/authorino-5d4b67c446-sn4wd"
Jul 17 18:04:48.569203 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:48.569175    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7zd8\" (UniqueName: \"kubernetes.io/projected/2f291c27-9e16-44d4-880e-bf9f2c8c7a44-kube-api-access-s7zd8\") pod \"authorino-5d4b67c446-sn4wd\" (UID: \"2f291c27-9e16-44d4-880e-bf9f2c8c7a44\") " pod="kuadrant-system/authorino-5d4b67c446-sn4wd"
Jul 17 18:04:48.596867 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:48.596819    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:04:48.608485 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:48.608452    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sn4wd"]
Jul 17 18:04:48.608718 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:48.608706    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-sn4wd"
Jul 17 18:04:48.634045 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:48.634012    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bfb4f458f-pkv72"]
Jul 17 18:04:48.638622 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:48.638599    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bfb4f458f-pkv72"
Jul 17 18:04:48.645227 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:48.645196    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bfb4f458f-pkv72"]
Jul 17 18:04:48.743243 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:48.743177    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sn4wd"]
Jul 17 18:04:48.746118 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:04:48.746089    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f291c27_9e16_44d4_880e_bf9f2c8c7a44.slice/crio-cd0a0b18b959b3bc4f788dd35284c875ce0b1b4d1eced7944f7ef13baef15a06 WatchSource:0}: Error finding container cd0a0b18b959b3bc4f788dd35284c875ce0b1b4d1eced7944f7ef13baef15a06: Status 404 returned error can't find the container with id cd0a0b18b959b3bc4f788dd35284c875ce0b1b4d1eced7944f7ef13baef15a06
Jul 17 18:04:48.763578 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:48.763549    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmx7c\" (UniqueName: \"kubernetes.io/projected/f7e59488-a1ee-40af-8c37-7908af8b491d-kube-api-access-xmx7c\") pod \"authorino-7bfb4f458f-pkv72\" (UID: \"f7e59488-a1ee-40af-8c37-7908af8b491d\") " pod="kuadrant-system/authorino-7bfb4f458f-pkv72"
Jul 17 18:04:48.854150 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:48.854111    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-sn4wd" event={"ID":"2f291c27-9e16-44d4-880e-bf9f2c8c7a44","Type":"ContainerStarted","Data":"cd0a0b18b959b3bc4f788dd35284c875ce0b1b4d1eced7944f7ef13baef15a06"}
Jul 17 18:04:48.857620 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:48.857585    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bfb4f458f-pkv72"]
Jul 17 18:04:48.857859 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:04:48.857840    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-xmx7c], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-7bfb4f458f-pkv72" podUID="f7e59488-a1ee-40af-8c37-7908af8b491d"
Jul 17 18:04:48.864180 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:48.864151    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmx7c\" (UniqueName: \"kubernetes.io/projected/f7e59488-a1ee-40af-8c37-7908af8b491d-kube-api-access-xmx7c\") pod \"authorino-7bfb4f458f-pkv72\" (UID: \"f7e59488-a1ee-40af-8c37-7908af8b491d\") " pod="kuadrant-system/authorino-7bfb4f458f-pkv72"
Jul 17 18:04:48.894048 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:48.893531    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bbb8c7645-9hfsq"]
Jul 17 18:04:48.897743 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:48.897713    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bbb8c7645-9hfsq"
Jul 17 18:04:48.897930 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:48.897901    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bbb8c7645-9hfsq"]
Jul 17 18:04:48.898660 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:48.898631    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmx7c\" (UniqueName: \"kubernetes.io/projected/f7e59488-a1ee-40af-8c37-7908af8b491d-kube-api-access-xmx7c\") pod \"authorino-7bfb4f458f-pkv72\" (UID: \"f7e59488-a1ee-40af-8c37-7908af8b491d\") " pod="kuadrant-system/authorino-7bfb4f458f-pkv72"
Jul 17 18:04:48.900221 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:48.900198    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 17 18:04:48.965212 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:48.965172    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-948ss\" (UniqueName: \"kubernetes.io/projected/107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3-kube-api-access-948ss\") pod \"authorino-7bbb8c7645-9hfsq\" (UID: \"107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3\") " pod="kuadrant-system/authorino-7bbb8c7645-9hfsq"
Jul 17 18:04:48.965377 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:48.965265    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3-tls-cert\") pod \"authorino-7bbb8c7645-9hfsq\" (UID: \"107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3\") " pod="kuadrant-system/authorino-7bbb8c7645-9hfsq"
Jul 17 18:04:49.066483 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:49.066459    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-948ss\" (UniqueName: \"kubernetes.io/projected/107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3-kube-api-access-948ss\") pod \"authorino-7bbb8c7645-9hfsq\" (UID: \"107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3\") " pod="kuadrant-system/authorino-7bbb8c7645-9hfsq"
Jul 17 18:04:49.066596 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:49.066516    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3-tls-cert\") pod \"authorino-7bbb8c7645-9hfsq\" (UID: \"107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3\") " pod="kuadrant-system/authorino-7bbb8c7645-9hfsq"
Jul 17 18:04:49.068927 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:49.068905    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3-tls-cert\") pod \"authorino-7bbb8c7645-9hfsq\" (UID: \"107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3\") " pod="kuadrant-system/authorino-7bbb8c7645-9hfsq"
Jul 17 18:04:49.077183 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:49.077158    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-948ss\" (UniqueName: \"kubernetes.io/projected/107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3-kube-api-access-948ss\") pod \"authorino-7bbb8c7645-9hfsq\" (UID: \"107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3\") " pod="kuadrant-system/authorino-7bbb8c7645-9hfsq"
Jul 17 18:04:49.215706 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:49.215668    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bbb8c7645-9hfsq"
Jul 17 18:04:49.348250 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:49.348223    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bbb8c7645-9hfsq"]
Jul 17 18:04:49.350137 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:04:49.350115    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod107dd17b_3bc3_436a_a9b2_0b4c5bd9ffa3.slice/crio-5683900cd29280b0ada7c463d9baf06106a5bf05b30239cdd072afb114ca99a1 WatchSource:0}: Error finding container 5683900cd29280b0ada7c463d9baf06106a5bf05b30239cdd072afb114ca99a1: Status 404 returned error can't find the container with id 5683900cd29280b0ada7c463d9baf06106a5bf05b30239cdd072afb114ca99a1
Jul 17 18:04:49.860737 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:49.860696    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-sn4wd" event={"ID":"2f291c27-9e16-44d4-880e-bf9f2c8c7a44","Type":"ContainerStarted","Data":"5354d4663016e3c0acb96c9346a59a5a6ca4f72f477e425ea0490a53f29bcf67"}
Jul 17 18:04:49.860737 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:49.860718    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-sn4wd" podUID="2f291c27-9e16-44d4-880e-bf9f2c8c7a44" containerName="authorino" containerID="cri-o://5354d4663016e3c0acb96c9346a59a5a6ca4f72f477e425ea0490a53f29bcf67" gracePeriod=30
Jul 17 18:04:49.862240 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:49.862213    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bfb4f458f-pkv72"
Jul 17 18:04:49.862381 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:49.862264    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bbb8c7645-9hfsq" event={"ID":"107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3","Type":"ContainerStarted","Data":"ee96e061ecf2c44ce7179bf8252bd98186b94b16f962eb4e6fee7f39d8d48ddb"}
Jul 17 18:04:49.862381 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:49.862301    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bbb8c7645-9hfsq" event={"ID":"107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3","Type":"ContainerStarted","Data":"5683900cd29280b0ada7c463d9baf06106a5bf05b30239cdd072afb114ca99a1"}
Jul 17 18:04:49.870276 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:49.870253    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bfb4f458f-pkv72"
Jul 17 18:04:49.875515 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:49.875309    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-sn4wd" podStartSLOduration=1.5685185860000002 podStartE2EDuration="1.875289744s" totalImagesPullingTime="306.771158ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:04:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:04:49.875045384 +0000 UTC m=+517.100274695" watchObservedRunningTime="2026-07-17 18:04:49.875289744 +0000 UTC m=+517.100519053"
Jul 17 18:04:49.912174 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:49.912120    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bbb8c7645-9hfsq" podStartSLOduration=1.503142193 podStartE2EDuration="1.912100713s" totalImagesPullingTime="408.95852ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:04:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:04:49.910219291 +0000 UTC m=+517.135448602" watchObservedRunningTime="2026-07-17 18:04:49.912100713 +0000 UTC m=+517.137330021"
Jul 17 18:04:49.937973 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:49.937935    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cbf4m"]
Jul 17 18:04:49.938215 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:49.938185    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-cbf4m" podUID="b9b18c21-c64d-4c33-915d-db35d54bf4a4" containerName="authorino" containerID="cri-o://0841f35ec144bb8fd003d400cc666c4ff157c697df1e8802be9577563c7372f4" gracePeriod=30
Jul 17 18:04:49.976603 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:49.976567    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmx7c\" (UniqueName: \"kubernetes.io/projected/f7e59488-a1ee-40af-8c37-7908af8b491d-kube-api-access-xmx7c\") pod \"f7e59488-a1ee-40af-8c37-7908af8b491d\" (UID: \"f7e59488-a1ee-40af-8c37-7908af8b491d\") "
Jul 17 18:04:49.978561 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:49.978532    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7e59488-a1ee-40af-8c37-7908af8b491d-kube-api-access-xmx7c" (OuterVolumeSpecName: "kube-api-access-xmx7c") pod "f7e59488-a1ee-40af-8c37-7908af8b491d" (UID: "f7e59488-a1ee-40af-8c37-7908af8b491d"). InnerVolumeSpecName "kube-api-access-xmx7c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:04:50.077993 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:50.077958    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmx7c\" (UniqueName: \"kubernetes.io/projected/f7e59488-a1ee-40af-8c37-7908af8b491d-kube-api-access-xmx7c\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:04:50.184425 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:50.184400    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-sn4wd"
Jul 17 18:04:50.196801 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:50.196780    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cbf4m"
Jul 17 18:04:50.280499 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:50.280465    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7zd8\" (UniqueName: \"kubernetes.io/projected/2f291c27-9e16-44d4-880e-bf9f2c8c7a44-kube-api-access-s7zd8\") pod \"2f291c27-9e16-44d4-880e-bf9f2c8c7a44\" (UID: \"2f291c27-9e16-44d4-880e-bf9f2c8c7a44\") "
Jul 17 18:04:50.280697 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:50.280551    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vm7g6\" (UniqueName: \"kubernetes.io/projected/b9b18c21-c64d-4c33-915d-db35d54bf4a4-kube-api-access-vm7g6\") pod \"b9b18c21-c64d-4c33-915d-db35d54bf4a4\" (UID: \"b9b18c21-c64d-4c33-915d-db35d54bf4a4\") "
Jul 17 18:04:50.282607 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:50.282578    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9b18c21-c64d-4c33-915d-db35d54bf4a4-kube-api-access-vm7g6" (OuterVolumeSpecName: "kube-api-access-vm7g6") pod "b9b18c21-c64d-4c33-915d-db35d54bf4a4" (UID: "b9b18c21-c64d-4c33-915d-db35d54bf4a4"). InnerVolumeSpecName "kube-api-access-vm7g6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:04:50.282607 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:50.282594    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f291c27-9e16-44d4-880e-bf9f2c8c7a44-kube-api-access-s7zd8" (OuterVolumeSpecName: "kube-api-access-s7zd8") pod "2f291c27-9e16-44d4-880e-bf9f2c8c7a44" (UID: "2f291c27-9e16-44d4-880e-bf9f2c8c7a44"). InnerVolumeSpecName "kube-api-access-s7zd8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:04:50.381527 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:50.381437    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7zd8\" (UniqueName: \"kubernetes.io/projected/2f291c27-9e16-44d4-880e-bf9f2c8c7a44-kube-api-access-s7zd8\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:04:50.381527 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:50.381472    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vm7g6\" (UniqueName: \"kubernetes.io/projected/b9b18c21-c64d-4c33-915d-db35d54bf4a4-kube-api-access-vm7g6\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:04:50.867934 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:50.867899    2572 generic.go:356] "Generic (PLEG): container finished" podID="2f291c27-9e16-44d4-880e-bf9f2c8c7a44" containerID="5354d4663016e3c0acb96c9346a59a5a6ca4f72f477e425ea0490a53f29bcf67" exitCode=0
Jul 17 18:04:50.868434 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:50.867950    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-sn4wd"
Jul 17 18:04:50.868434 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:50.867987    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-sn4wd" event={"ID":"2f291c27-9e16-44d4-880e-bf9f2c8c7a44","Type":"ContainerDied","Data":"5354d4663016e3c0acb96c9346a59a5a6ca4f72f477e425ea0490a53f29bcf67"}
Jul 17 18:04:50.868434 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:50.868046    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-sn4wd" event={"ID":"2f291c27-9e16-44d4-880e-bf9f2c8c7a44","Type":"ContainerDied","Data":"cd0a0b18b959b3bc4f788dd35284c875ce0b1b4d1eced7944f7ef13baef15a06"}
Jul 17 18:04:50.868434 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:50.868070    2572 scope.go:117] "RemoveContainer" containerID="5354d4663016e3c0acb96c9346a59a5a6ca4f72f477e425ea0490a53f29bcf67"
Jul 17 18:04:50.869422 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:50.869246    2572 generic.go:356] "Generic (PLEG): container finished" podID="b9b18c21-c64d-4c33-915d-db35d54bf4a4" containerID="0841f35ec144bb8fd003d400cc666c4ff157c697df1e8802be9577563c7372f4" exitCode=0
Jul 17 18:04:50.869422 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:50.869308    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-cbf4m"
Jul 17 18:04:50.869422 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:50.869322    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bfb4f458f-pkv72"
Jul 17 18:04:50.869422 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:50.869342    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cbf4m" event={"ID":"b9b18c21-c64d-4c33-915d-db35d54bf4a4","Type":"ContainerDied","Data":"0841f35ec144bb8fd003d400cc666c4ff157c697df1e8802be9577563c7372f4"}
Jul 17 18:04:50.869422 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:50.869384    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-cbf4m" event={"ID":"b9b18c21-c64d-4c33-915d-db35d54bf4a4","Type":"ContainerDied","Data":"70045bfdde755cc02ae3cbed35fa110bb4fff517cee21198568d2274e8b88082"}
Jul 17 18:04:50.876536 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:50.876515    2572 scope.go:117] "RemoveContainer" containerID="5354d4663016e3c0acb96c9346a59a5a6ca4f72f477e425ea0490a53f29bcf67"
Jul 17 18:04:50.876822 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:04:50.876799    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5354d4663016e3c0acb96c9346a59a5a6ca4f72f477e425ea0490a53f29bcf67\": container with ID starting with 5354d4663016e3c0acb96c9346a59a5a6ca4f72f477e425ea0490a53f29bcf67 not found: ID does not exist" containerID="5354d4663016e3c0acb96c9346a59a5a6ca4f72f477e425ea0490a53f29bcf67"
Jul 17 18:04:50.876912 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:50.876832    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5354d4663016e3c0acb96c9346a59a5a6ca4f72f477e425ea0490a53f29bcf67"} err="failed to get container status \"5354d4663016e3c0acb96c9346a59a5a6ca4f72f477e425ea0490a53f29bcf67\": rpc error: code = NotFound desc = could not find container \"5354d4663016e3c0acb96c9346a59a5a6ca4f72f477e425ea0490a53f29bcf67\": container with ID starting with 5354d4663016e3c0acb96c9346a59a5a6ca4f72f477e425ea0490a53f29bcf67 not found: ID does not exist"
Jul 17 18:04:50.876912 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:50.876863    2572 scope.go:117] "RemoveContainer" containerID="0841f35ec144bb8fd003d400cc666c4ff157c697df1e8802be9577563c7372f4"
Jul 17 18:04:50.885634 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:50.885615    2572 scope.go:117] "RemoveContainer" containerID="0841f35ec144bb8fd003d400cc666c4ff157c697df1e8802be9577563c7372f4"
Jul 17 18:04:50.885904 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:04:50.885884    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0841f35ec144bb8fd003d400cc666c4ff157c697df1e8802be9577563c7372f4\": container with ID starting with 0841f35ec144bb8fd003d400cc666c4ff157c697df1e8802be9577563c7372f4 not found: ID does not exist" containerID="0841f35ec144bb8fd003d400cc666c4ff157c697df1e8802be9577563c7372f4"
Jul 17 18:04:50.885959 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:50.885915    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0841f35ec144bb8fd003d400cc666c4ff157c697df1e8802be9577563c7372f4"} err="failed to get container status \"0841f35ec144bb8fd003d400cc666c4ff157c697df1e8802be9577563c7372f4\": rpc error: code = NotFound desc = could not find container \"0841f35ec144bb8fd003d400cc666c4ff157c697df1e8802be9577563c7372f4\": container with ID starting with 0841f35ec144bb8fd003d400cc666c4ff157c697df1e8802be9577563c7372f4 not found: ID does not exist"
Jul 17 18:04:50.894528 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:50.894506    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cbf4m"]
Jul 17 18:04:50.896062 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:50.896036    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-cbf4m"]
Jul 17 18:04:50.906227 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:50.906200    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sn4wd"]
Jul 17 18:04:50.910409 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:50.910386    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sn4wd"]
Jul 17 18:04:50.934862 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:50.934825    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bfb4f458f-pkv72"]
Jul 17 18:04:50.940314 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:50.940283    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bfb4f458f-pkv72"]
Jul 17 18:04:51.470809 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:51.470775    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f291c27-9e16-44d4-880e-bf9f2c8c7a44" path="/var/lib/kubelet/pods/2f291c27-9e16-44d4-880e-bf9f2c8c7a44/volumes"
Jul 17 18:04:51.471138 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:51.471124    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9b18c21-c64d-4c33-915d-db35d54bf4a4" path="/var/lib/kubelet/pods/b9b18c21-c64d-4c33-915d-db35d54bf4a4/volumes"
Jul 17 18:04:51.471408 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:51.471397    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7e59488-a1ee-40af-8c37-7908af8b491d" path="/var/lib/kubelet/pods/f7e59488-a1ee-40af-8c37-7908af8b491d/volumes"
Jul 17 18:04:54.490434 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:54.490397    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:04:54.591983 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:54.591942    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:04:54.677892 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:54.677850    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:04:54.678731 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:54.678711    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bd9bf478b-m29pl"]
Jul 17 18:04:54.679100 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:54.679085    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f291c27-9e16-44d4-880e-bf9f2c8c7a44" containerName="authorino"
Jul 17 18:04:54.679151 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:54.679101    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f291c27-9e16-44d4-880e-bf9f2c8c7a44" containerName="authorino"
Jul 17 18:04:54.679151 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:54.679124    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9b18c21-c64d-4c33-915d-db35d54bf4a4" containerName="authorino"
Jul 17 18:04:54.679151 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:54.679130    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9b18c21-c64d-4c33-915d-db35d54bf4a4" containerName="authorino"
Jul 17 18:04:54.679241 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:54.679191    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f291c27-9e16-44d4-880e-bf9f2c8c7a44" containerName="authorino"
Jul 17 18:04:54.679241 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:54.679203    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9b18c21-c64d-4c33-915d-db35d54bf4a4" containerName="authorino"
Jul 17 18:04:54.683443 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:54.683423    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bd9bf478b-m29pl"
Jul 17 18:04:54.685930 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:54.685906    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 17 18:04:54.686274 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:54.686259    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 17 18:04:54.686361 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:54.686295    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9dmbt\""
Jul 17 18:04:54.693647 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:54.693623    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bd9bf478b-m29pl"]
Jul 17 18:04:54.821273 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:54.821170    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/11b86039-8fcd-488a-b020-516cd09766ee-webhook-cert\") pod \"maas-controller-7bd9bf478b-m29pl\" (UID: \"11b86039-8fcd-488a-b020-516cd09766ee\") " pod="opendatahub/maas-controller-7bd9bf478b-m29pl"
Jul 17 18:04:54.821436 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:54.821309    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqr2n\" (UniqueName: \"kubernetes.io/projected/11b86039-8fcd-488a-b020-516cd09766ee-kube-api-access-mqr2n\") pod \"maas-controller-7bd9bf478b-m29pl\" (UID: \"11b86039-8fcd-488a-b020-516cd09766ee\") " pod="opendatahub/maas-controller-7bd9bf478b-m29pl"
Jul 17 18:04:54.921964 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:54.921924    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqr2n\" (UniqueName: \"kubernetes.io/projected/11b86039-8fcd-488a-b020-516cd09766ee-kube-api-access-mqr2n\") pod \"maas-controller-7bd9bf478b-m29pl\" (UID: \"11b86039-8fcd-488a-b020-516cd09766ee\") " pod="opendatahub/maas-controller-7bd9bf478b-m29pl"
Jul 17 18:04:54.922176 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:54.922044    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/11b86039-8fcd-488a-b020-516cd09766ee-webhook-cert\") pod \"maas-controller-7bd9bf478b-m29pl\" (UID: \"11b86039-8fcd-488a-b020-516cd09766ee\") " pod="opendatahub/maas-controller-7bd9bf478b-m29pl"
Jul 17 18:04:54.922227 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:04:54.922182    2572 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 17 18:04:54.922272 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:04:54.922249    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11b86039-8fcd-488a-b020-516cd09766ee-webhook-cert podName:11b86039-8fcd-488a-b020-516cd09766ee nodeName:}" failed. No retries permitted until 2026-07-17 18:04:55.422231991 +0000 UTC m=+522.647461278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/11b86039-8fcd-488a-b020-516cd09766ee-webhook-cert") pod "maas-controller-7bd9bf478b-m29pl" (UID: "11b86039-8fcd-488a-b020-516cd09766ee") : secret "maas-controller-webhook-cert" not found
Jul 17 18:04:54.930423 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:54.930397    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqr2n\" (UniqueName: \"kubernetes.io/projected/11b86039-8fcd-488a-b020-516cd09766ee-kube-api-access-mqr2n\") pod \"maas-controller-7bd9bf478b-m29pl\" (UID: \"11b86039-8fcd-488a-b020-516cd09766ee\") " pod="opendatahub/maas-controller-7bd9bf478b-m29pl"
Jul 17 18:04:55.326837 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:55.326796    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:04:55.427048 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:55.427016    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/11b86039-8fcd-488a-b020-516cd09766ee-webhook-cert\") pod \"maas-controller-7bd9bf478b-m29pl\" (UID: \"11b86039-8fcd-488a-b020-516cd09766ee\") " pod="opendatahub/maas-controller-7bd9bf478b-m29pl"
Jul 17 18:04:55.429366 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:55.429345    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/11b86039-8fcd-488a-b020-516cd09766ee-webhook-cert\") pod \"maas-controller-7bd9bf478b-m29pl\" (UID: \"11b86039-8fcd-488a-b020-516cd09766ee\") " pod="opendatahub/maas-controller-7bd9bf478b-m29pl"
Jul 17 18:04:55.595391 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:55.595294    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bd9bf478b-m29pl"
Jul 17 18:04:55.941853 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:55.941819    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bd9bf478b-m29pl"]
Jul 17 18:04:55.944937 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:04:55.944909    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11b86039_8fcd_488a_b020_516cd09766ee.slice/crio-42a4cd5860a257561712f627241303aba34f1c0fd741993977bda3ae54524de9 WatchSource:0}: Error finding container 42a4cd5860a257561712f627241303aba34f1c0fd741993977bda3ae54524de9: Status 404 returned error can't find the container with id 42a4cd5860a257561712f627241303aba34f1c0fd741993977bda3ae54524de9
Jul 17 18:04:56.907516 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:56.907474    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bd9bf478b-m29pl" event={"ID":"11b86039-8fcd-488a-b020-516cd09766ee","Type":"ContainerStarted","Data":"42a4cd5860a257561712f627241303aba34f1c0fd741993977bda3ae54524de9"}
Jul 17 18:04:58.670808 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:58.670777    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:04:58.777358 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:58.777268    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:04:58.919616 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:58.919580    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bd9bf478b-m29pl" event={"ID":"11b86039-8fcd-488a-b020-516cd09766ee","Type":"ContainerStarted","Data":"edfc8be7bd987d42f98118d33285e369dc08e1e1e831065b3388d5d33d7a7a4a"}
Jul 17 18:04:58.919765 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:58.919716    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bd9bf478b-m29pl"
Jul 17 18:04:58.955810 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:04:58.955760    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7bd9bf478b-m29pl" podStartSLOduration=2.462435219 podStartE2EDuration="4.955742225s" totalImagesPullingTime="2.493307006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:04:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:04:58.953975815 +0000 UTC m=+526.179205124" watchObservedRunningTime="2026-07-17 18:04:58.955742225 +0000 UTC m=+526.180971533"
Jul 17 18:05:09.926968 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:09.926933    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bd9bf478b-m29pl"
Jul 17 18:05:19.784477 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:19.784437    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:05:19.850261 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:19.850222    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:05:30.374179 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:30.374141    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:05:30.466428 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:30.466391    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:05:31.037392 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:31.037350    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:05:31.103801 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:31.103769    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-54f756bdb9-lhfj7"]
Jul 17 18:05:31.138016 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:31.137970    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:05:31.148925 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:31.148900    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-54f756bdb9-lhfj7"]
Jul 17 18:05:31.149089 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:31.149017    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-54f756bdb9-lhfj7"
Jul 17 18:05:31.151884 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:31.151863    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-xcjrp\""
Jul 17 18:05:31.152924 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:31.152908    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 17 18:05:31.230431 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:31.230387    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a3a01ba-9893-4f8a-8504-08d3f49624fc-maas-api-tls\") pod \"maas-api-54f756bdb9-lhfj7\" (UID: \"7a3a01ba-9893-4f8a-8504-08d3f49624fc\") " pod="odh-ai-gateway-infra/maas-api-54f756bdb9-lhfj7"
Jul 17 18:05:31.230431 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:31.230437    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a3a01ba-9893-4f8a-8504-08d3f49624fc-openshift-service-ca\") pod \"maas-api-54f756bdb9-lhfj7\" (UID: \"7a3a01ba-9893-4f8a-8504-08d3f49624fc\") " pod="odh-ai-gateway-infra/maas-api-54f756bdb9-lhfj7"
Jul 17 18:05:31.230651 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:31.230522    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k8z4b\" (UniqueName: \"kubernetes.io/projected/7a3a01ba-9893-4f8a-8504-08d3f49624fc-kube-api-access-k8z4b\") pod \"maas-api-54f756bdb9-lhfj7\" (UID: \"7a3a01ba-9893-4f8a-8504-08d3f49624fc\") " pod="odh-ai-gateway-infra/maas-api-54f756bdb9-lhfj7"
Jul 17 18:05:31.331581 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:31.331489    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k8z4b\" (UniqueName: \"kubernetes.io/projected/7a3a01ba-9893-4f8a-8504-08d3f49624fc-kube-api-access-k8z4b\") pod \"maas-api-54f756bdb9-lhfj7\" (UID: \"7a3a01ba-9893-4f8a-8504-08d3f49624fc\") " pod="odh-ai-gateway-infra/maas-api-54f756bdb9-lhfj7"
Jul 17 18:05:31.331764 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:31.331584    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a3a01ba-9893-4f8a-8504-08d3f49624fc-maas-api-tls\") pod \"maas-api-54f756bdb9-lhfj7\" (UID: \"7a3a01ba-9893-4f8a-8504-08d3f49624fc\") " pod="odh-ai-gateway-infra/maas-api-54f756bdb9-lhfj7"
Jul 17 18:05:31.331764 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:31.331612    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a3a01ba-9893-4f8a-8504-08d3f49624fc-openshift-service-ca\") pod \"maas-api-54f756bdb9-lhfj7\" (UID: \"7a3a01ba-9893-4f8a-8504-08d3f49624fc\") " pod="odh-ai-gateway-infra/maas-api-54f756bdb9-lhfj7"
Jul 17 18:05:31.332425 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:31.332396    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a3a01ba-9893-4f8a-8504-08d3f49624fc-openshift-service-ca\") pod \"maas-api-54f756bdb9-lhfj7\" (UID: \"7a3a01ba-9893-4f8a-8504-08d3f49624fc\") " pod="odh-ai-gateway-infra/maas-api-54f756bdb9-lhfj7"
Jul 17 18:05:31.334340 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:31.334316    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a3a01ba-9893-4f8a-8504-08d3f49624fc-maas-api-tls\") pod \"maas-api-54f756bdb9-lhfj7\" (UID: \"7a3a01ba-9893-4f8a-8504-08d3f49624fc\") " pod="odh-ai-gateway-infra/maas-api-54f756bdb9-lhfj7"
Jul 17 18:05:31.343232 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:31.343203    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k8z4b\" (UniqueName: \"kubernetes.io/projected/7a3a01ba-9893-4f8a-8504-08d3f49624fc-kube-api-access-k8z4b\") pod \"maas-api-54f756bdb9-lhfj7\" (UID: \"7a3a01ba-9893-4f8a-8504-08d3f49624fc\") " pod="odh-ai-gateway-infra/maas-api-54f756bdb9-lhfj7"
Jul 17 18:05:31.460148 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:31.460109    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-54f756bdb9-lhfj7"
Jul 17 18:05:31.532731 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:31.532697    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:05:31.609928 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:31.609833    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-54f756bdb9-lhfj7"]
Jul 17 18:05:31.612991 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:05:31.612960    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a3a01ba_9893_4f8a_8504_08d3f49624fc.slice/crio-78595d0874f48499d81ff5a63727d54f5c8706cb6d2100552f55195c567d9527 WatchSource:0}: Error finding container 78595d0874f48499d81ff5a63727d54f5c8706cb6d2100552f55195c567d9527: Status 404 returned error can't find the container with id 78595d0874f48499d81ff5a63727d54f5c8706cb6d2100552f55195c567d9527
Jul 17 18:05:31.663341 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:31.663306    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-5f4bx"]
Jul 17 18:05:31.664988 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:31.664963    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:05:31.667655 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:31.667639    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-5f4bx"
Jul 17 18:05:31.670587 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:31.670560    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 17 18:05:31.670697 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:31.670612    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-8d28r\""
Jul 17 18:05:31.675849 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:31.675813    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-5f4bx"]
Jul 17 18:05:31.734562 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:31.734520    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqh56\" (UniqueName: \"kubernetes.io/projected/7e0015f8-1c3d-49e1-92f8-647fd7b44ac8-kube-api-access-kqh56\") pod \"payload-processing-5bf47cd988-5f4bx\" (UID: \"7e0015f8-1c3d-49e1-92f8-647fd7b44ac8\") " pod="openshift-ingress/payload-processing-5bf47cd988-5f4bx"
Jul 17 18:05:31.734771 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:31.734601    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e0015f8-1c3d-49e1-92f8-647fd7b44ac8-plugins-config-volume\") pod \"payload-processing-5bf47cd988-5f4bx\" (UID: \"7e0015f8-1c3d-49e1-92f8-647fd7b44ac8\") " pod="openshift-ingress/payload-processing-5bf47cd988-5f4bx"
Jul 17 18:05:31.835819 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:31.835776    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e0015f8-1c3d-49e1-92f8-647fd7b44ac8-plugins-config-volume\") pod \"payload-processing-5bf47cd988-5f4bx\" (UID: \"7e0015f8-1c3d-49e1-92f8-647fd7b44ac8\") " pod="openshift-ingress/payload-processing-5bf47cd988-5f4bx"
Jul 17 18:05:31.836039 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:31.835902    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqh56\" (UniqueName: \"kubernetes.io/projected/7e0015f8-1c3d-49e1-92f8-647fd7b44ac8-kube-api-access-kqh56\") pod \"payload-processing-5bf47cd988-5f4bx\" (UID: \"7e0015f8-1c3d-49e1-92f8-647fd7b44ac8\") " pod="openshift-ingress/payload-processing-5bf47cd988-5f4bx"
Jul 17 18:05:31.836605 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:31.836580    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7e0015f8-1c3d-49e1-92f8-647fd7b44ac8-plugins-config-volume\") pod \"payload-processing-5bf47cd988-5f4bx\" (UID: \"7e0015f8-1c3d-49e1-92f8-647fd7b44ac8\") " pod="openshift-ingress/payload-processing-5bf47cd988-5f4bx"
Jul 17 18:05:31.843469 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:31.843446    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqh56\" (UniqueName: \"kubernetes.io/projected/7e0015f8-1c3d-49e1-92f8-647fd7b44ac8-kube-api-access-kqh56\") pod \"payload-processing-5bf47cd988-5f4bx\" (UID: \"7e0015f8-1c3d-49e1-92f8-647fd7b44ac8\") " pod="openshift-ingress/payload-processing-5bf47cd988-5f4bx"
Jul 17 18:05:31.980551 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:31.980516    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-5f4bx"
Jul 17 18:05:32.085247 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:32.085205    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-54f756bdb9-lhfj7" event={"ID":"7a3a01ba-9893-4f8a-8504-08d3f49624fc","Type":"ContainerStarted","Data":"78595d0874f48499d81ff5a63727d54f5c8706cb6d2100552f55195c567d9527"}
Jul 17 18:05:32.121276 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:32.121244    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-5f4bx"]
Jul 17 18:05:32.123648 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:05:32.123609    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e0015f8_1c3d_49e1_92f8_647fd7b44ac8.slice/crio-77c4f28dd2276f081e6ab27f47a8b06e05e157444294e363b6de0bcafcc32344 WatchSource:0}: Error finding container 77c4f28dd2276f081e6ab27f47a8b06e05e157444294e363b6de0bcafcc32344: Status 404 returned error can't find the container with id 77c4f28dd2276f081e6ab27f47a8b06e05e157444294e363b6de0bcafcc32344
Jul 17 18:05:33.099674 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:33.099631    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-5f4bx" event={"ID":"7e0015f8-1c3d-49e1-92f8-647fd7b44ac8","Type":"ContainerStarted","Data":"77c4f28dd2276f081e6ab27f47a8b06e05e157444294e363b6de0bcafcc32344"}
Jul 17 18:05:34.107870 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:34.107825    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-54f756bdb9-lhfj7" event={"ID":"7a3a01ba-9893-4f8a-8504-08d3f49624fc","Type":"ContainerStarted","Data":"c61698dfab4d8017616bccc783c2d26a0f9dffe86f4e5e73cf47876c5c0f3d6c"}
Jul 17 18:05:34.108408 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:34.107965    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-54f756bdb9-lhfj7"
Jul 17 18:05:34.129695 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:34.129630    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-54f756bdb9-lhfj7" podStartSLOduration=1.211841499 podStartE2EDuration="3.129608144s" totalImagesPullingTime="1.917766645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:05:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:05:34.126961082 +0000 UTC m=+561.352190391" watchObservedRunningTime="2026-07-17 18:05:34.129608144 +0000 UTC m=+561.354837453"
Jul 17 18:05:36.118969 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:36.118934    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-5f4bx" event={"ID":"7e0015f8-1c3d-49e1-92f8-647fd7b44ac8","Type":"ContainerStarted","Data":"9118c9eb6655fa380f24b1b38f4edb5adf70c38426cabe293357347cb846a0ad"}
Jul 17 18:05:36.119477 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:36.119148    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-5f4bx"
Jul 17 18:05:36.136703 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:36.136654    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-5f4bx" podStartSLOduration=1.870217898 podStartE2EDuration="5.13663708s" totalImagesPullingTime="3.266419182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:05:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:05:36.135325755 +0000 UTC m=+563.360555076" watchObservedRunningTime="2026-07-17 18:05:36.13663708 +0000 UTC m=+563.361866387"
Jul 17 18:05:40.119123 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:40.119089    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-54f756bdb9-lhfj7"
Jul 17 18:05:40.140384 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:40.140348    2572 generic.go:356] "Generic (PLEG): container finished" podID="14cc383a-23f0-4842-8d03-2fb3f65d95dc" containerID="2bda10ea26988c3bd2bbe46bb6bd06e2d30b65e45c17d1a07a9de62cc6171d89" exitCode=0
Jul 17 18:05:40.140549 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:40.140423    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg" event={"ID":"14cc383a-23f0-4842-8d03-2fb3f65d95dc","Type":"ContainerDied","Data":"2bda10ea26988c3bd2bbe46bb6bd06e2d30b65e45c17d1a07a9de62cc6171d89"}
Jul 17 18:05:40.140840 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:40.140825    2572 scope.go:117] "RemoveContainer" containerID="2bda10ea26988c3bd2bbe46bb6bd06e2d30b65e45c17d1a07a9de62cc6171d89"
Jul 17 18:05:40.141963 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:40.141932    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:05:40.142067 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:40.142015    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:05:40.142067 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:40.142061    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:05:41.146843 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:41.146809    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg" event={"ID":"14cc383a-23f0-4842-8d03-2fb3f65d95dc","Type":"ContainerStarted","Data":"32ad306788caa5006a9ee2ff0bbfd77ac9d9066f08cce645cac5039dbde05d64"}
Jul 17 18:05:41.706345 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:41.706297    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:05:41.803613 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:41.803570    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:05:41.843594 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:41.843551    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:05:41.844712 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:41.844686    2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-782cg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body=
Jul 17 18:05:41.844828 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:41.844734    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg" podUID="14cc383a-23f0-4842-8d03-2fb3f65d95dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused"
Jul 17 18:05:42.844342 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:42.844310    2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-782cg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body=
Jul 17 18:05:42.844726 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:42.844377    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg" podUID="14cc383a-23f0-4842-8d03-2fb3f65d95dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused"
Jul 17 18:05:43.844607 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:43.844563    2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-782cg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body=
Jul 17 18:05:43.845115 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:43.844650    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg" podUID="14cc383a-23f0-4842-8d03-2fb3f65d95dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused"
Jul 17 18:05:44.672657 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:44.672617    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:05:44.844076 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:44.844036    2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-782cg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused" start-of-body=
Jul 17 18:05:44.844253 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:44.844093    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg" podUID="14cc383a-23f0-4842-8d03-2fb3f65d95dc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.31:15021/healthz/ready\": dial tcp 10.132.0.31:15021: connect: connection refused"
Jul 17 18:05:45.848656 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:45.848623    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:05:45.849619 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:45.849598    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-782cg"
Jul 17 18:05:47.126452 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:47.126425    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-5f4bx"
Jul 17 18:05:57.378818 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:57.378780    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh"]
Jul 17 18:05:57.383679 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:57.383655    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh"
Jul 17 18:05:57.387513 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:57.387489    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 17 18:05:57.387664 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:57.387554    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gsgfc\""
Jul 17 18:05:57.387664 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:57.387489    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 17 18:05:57.387847 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:57.387490    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 17 18:05:57.389914 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:57.389889    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh"]
Jul 17 18:05:57.404255 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:57.404223    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:05:57.508743 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:57.508711    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45cabb45-79ad-486b-9df7-a45df257d999-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh\" (UID: \"45cabb45-79ad-486b-9df7-a45df257d999\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh"
Jul 17 18:05:57.508930 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:57.508753    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcfkg\" (UniqueName: \"kubernetes.io/projected/45cabb45-79ad-486b-9df7-a45df257d999-kube-api-access-gcfkg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh\" (UID: \"45cabb45-79ad-486b-9df7-a45df257d999\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh"
Jul 17 18:05:57.508930 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:57.508786    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45cabb45-79ad-486b-9df7-a45df257d999-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh\" (UID: \"45cabb45-79ad-486b-9df7-a45df257d999\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh"
Jul 17 18:05:57.508930 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:57.508810    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45cabb45-79ad-486b-9df7-a45df257d999-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh\" (UID: \"45cabb45-79ad-486b-9df7-a45df257d999\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh"
Jul 17 18:05:57.508930 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:57.508840    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45cabb45-79ad-486b-9df7-a45df257d999-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh\" (UID: \"45cabb45-79ad-486b-9df7-a45df257d999\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh"
Jul 17 18:05:57.508930 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:57.508877    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45cabb45-79ad-486b-9df7-a45df257d999-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh\" (UID: \"45cabb45-79ad-486b-9df7-a45df257d999\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh"
Jul 17 18:05:57.609570 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:57.609531    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45cabb45-79ad-486b-9df7-a45df257d999-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh\" (UID: \"45cabb45-79ad-486b-9df7-a45df257d999\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh"
Jul 17 18:05:57.609570 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:57.609569    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcfkg\" (UniqueName: \"kubernetes.io/projected/45cabb45-79ad-486b-9df7-a45df257d999-kube-api-access-gcfkg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh\" (UID: \"45cabb45-79ad-486b-9df7-a45df257d999\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh"
Jul 17 18:05:57.609809 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:57.609602    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45cabb45-79ad-486b-9df7-a45df257d999-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh\" (UID: \"45cabb45-79ad-486b-9df7-a45df257d999\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh"
Jul 17 18:05:57.609809 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:57.609625    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45cabb45-79ad-486b-9df7-a45df257d999-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh\" (UID: \"45cabb45-79ad-486b-9df7-a45df257d999\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh"
Jul 17 18:05:57.609809 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:57.609661    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45cabb45-79ad-486b-9df7-a45df257d999-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh\" (UID: \"45cabb45-79ad-486b-9df7-a45df257d999\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh"
Jul 17 18:05:57.609809 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:57.609697    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45cabb45-79ad-486b-9df7-a45df257d999-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh\" (UID: \"45cabb45-79ad-486b-9df7-a45df257d999\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh"
Jul 17 18:05:57.610097 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:57.610074    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45cabb45-79ad-486b-9df7-a45df257d999-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh\" (UID: \"45cabb45-79ad-486b-9df7-a45df257d999\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh"
Jul 17 18:05:57.610164 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:57.610100    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45cabb45-79ad-486b-9df7-a45df257d999-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh\" (UID: \"45cabb45-79ad-486b-9df7-a45df257d999\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh"
Jul 17 18:05:57.610252 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:57.610235    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45cabb45-79ad-486b-9df7-a45df257d999-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh\" (UID: \"45cabb45-79ad-486b-9df7-a45df257d999\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh"
Jul 17 18:05:57.611918 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:57.611896    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45cabb45-79ad-486b-9df7-a45df257d999-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh\" (UID: \"45cabb45-79ad-486b-9df7-a45df257d999\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh"
Jul 17 18:05:57.612130 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:57.612113    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45cabb45-79ad-486b-9df7-a45df257d999-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh\" (UID: \"45cabb45-79ad-486b-9df7-a45df257d999\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh"
Jul 17 18:05:57.617080 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:57.617059    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcfkg\" (UniqueName: \"kubernetes.io/projected/45cabb45-79ad-486b-9df7-a45df257d999-kube-api-access-gcfkg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh\" (UID: \"45cabb45-79ad-486b-9df7-a45df257d999\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh"
Jul 17 18:05:57.695251 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:57.695219    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh"
Jul 17 18:05:57.832983 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:57.832953    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh"]
Jul 17 18:05:57.835092 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:05:57.835059    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45cabb45_79ad_486b_9df7_a45df257d999.slice/crio-9431875d93df8ace3fdf065d897bfefebd940317f14948e3e5fd9ad697625384 WatchSource:0}: Error finding container 9431875d93df8ace3fdf065d897bfefebd940317f14948e3e5fd9ad697625384: Status 404 returned error can't find the container with id 9431875d93df8ace3fdf065d897bfefebd940317f14948e3e5fd9ad697625384
Jul 17 18:05:58.242813 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:05:58.242767    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh" event={"ID":"45cabb45-79ad-486b-9df7-a45df257d999","Type":"ContainerStarted","Data":"9431875d93df8ace3fdf065d897bfefebd940317f14948e3e5fd9ad697625384"}
Jul 17 18:06:00.252963 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:00.252920    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh" event={"ID":"45cabb45-79ad-486b-9df7-a45df257d999","Type":"ContainerStarted","Data":"c24d758949042c1d28ac0276b6291466dbe00f189c25db03ef03b40fec5513a2"}
Jul 17 18:06:00.270596 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:00.270540    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh" podStartSLOduration=1.910980365 podStartE2EDuration="3.270524648s" totalImagesPullingTime="1.359544283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:05:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:06:00.269512927 +0000 UTC m=+587.494742248" watchObservedRunningTime="2026-07-17 18:06:00.270524648 +0000 UTC m=+587.495753956"
Jul 17 18:06:07.695505 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:07.695469    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh"
Jul 17 18:06:07.696083 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:07.695558    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh"
Jul 17 18:06:07.707969 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:07.707939    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh"
Jul 17 18:06:07.722827 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:07.722795    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:06:08.303080 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:08.303050    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh"
Jul 17 18:06:13.411094 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:13.411062    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tp9qm_6c101a17-a051-4e9d-a9dd-f72c67ba2a8a/console-operator/2.log"
Jul 17 18:06:13.411669 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:13.411332    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tp9qm_6c101a17-a051-4e9d-a9dd-f72c67ba2a8a/console-operator/2.log"
Jul 17 18:06:13.417873 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:13.417848    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5mdx_2e3bd369-576e-4df1-8a76-aebd537cde58/ovn-acl-logging/0.log"
Jul 17 18:06:13.418172 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:13.418154    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5mdx_2e3bd369-576e-4df1-8a76-aebd537cde58/ovn-acl-logging/0.log"
Jul 17 18:06:14.129038 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:14.128983    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:06:28.885857 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:28.885822    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6"]
Jul 17 18:06:28.889564 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:28.889541    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6"
Jul 17 18:06:28.892146 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:28.892112    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 17 18:06:28.898486 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:28.898460    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6"]
Jul 17 18:06:28.918868 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:28.918832    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:06:28.973880 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:28.973844    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7f848a7-2315-4b0a-be4c-71eb4a4960a9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6\" (UID: \"a7f848a7-2315-4b0a-be4c-71eb4a4960a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6"
Jul 17 18:06:28.974081 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:28.973903    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r85m9\" (UniqueName: \"kubernetes.io/projected/a7f848a7-2315-4b0a-be4c-71eb4a4960a9-kube-api-access-r85m9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6\" (UID: \"a7f848a7-2315-4b0a-be4c-71eb4a4960a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6"
Jul 17 18:06:28.974081 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:28.973961    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7f848a7-2315-4b0a-be4c-71eb4a4960a9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6\" (UID: \"a7f848a7-2315-4b0a-be4c-71eb4a4960a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6"
Jul 17 18:06:28.974167 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:28.974096    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7f848a7-2315-4b0a-be4c-71eb4a4960a9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6\" (UID: \"a7f848a7-2315-4b0a-be4c-71eb4a4960a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6"
Jul 17 18:06:28.974167 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:28.974124    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7f848a7-2315-4b0a-be4c-71eb4a4960a9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6\" (UID: \"a7f848a7-2315-4b0a-be4c-71eb4a4960a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6"
Jul 17 18:06:28.974241 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:28.974185    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7f848a7-2315-4b0a-be4c-71eb4a4960a9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6\" (UID: \"a7f848a7-2315-4b0a-be4c-71eb4a4960a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6"
Jul 17 18:06:29.075102 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:29.075057    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7f848a7-2315-4b0a-be4c-71eb4a4960a9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6\" (UID: \"a7f848a7-2315-4b0a-be4c-71eb4a4960a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6"
Jul 17 18:06:29.075302 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:29.075110    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7f848a7-2315-4b0a-be4c-71eb4a4960a9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6\" (UID: \"a7f848a7-2315-4b0a-be4c-71eb4a4960a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6"
Jul 17 18:06:29.075302 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:29.075173    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7f848a7-2315-4b0a-be4c-71eb4a4960a9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6\" (UID: \"a7f848a7-2315-4b0a-be4c-71eb4a4960a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6"
Jul 17 18:06:29.075302 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:29.075221    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7f848a7-2315-4b0a-be4c-71eb4a4960a9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6\" (UID: \"a7f848a7-2315-4b0a-be4c-71eb4a4960a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6"
Jul 17 18:06:29.075302 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:29.075255    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r85m9\" (UniqueName: \"kubernetes.io/projected/a7f848a7-2315-4b0a-be4c-71eb4a4960a9-kube-api-access-r85m9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6\" (UID: \"a7f848a7-2315-4b0a-be4c-71eb4a4960a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6"
Jul 17 18:06:29.075302 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:29.075300    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7f848a7-2315-4b0a-be4c-71eb4a4960a9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6\" (UID: \"a7f848a7-2315-4b0a-be4c-71eb4a4960a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6"
Jul 17 18:06:29.075612 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:29.075531    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a7f848a7-2315-4b0a-be4c-71eb4a4960a9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6\" (UID: \"a7f848a7-2315-4b0a-be4c-71eb4a4960a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6"
Jul 17 18:06:29.075753 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:29.075727    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a7f848a7-2315-4b0a-be4c-71eb4a4960a9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6\" (UID: \"a7f848a7-2315-4b0a-be4c-71eb4a4960a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6"
Jul 17 18:06:29.076326 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:29.076294    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7f848a7-2315-4b0a-be4c-71eb4a4960a9-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6\" (UID: \"a7f848a7-2315-4b0a-be4c-71eb4a4960a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6"
Jul 17 18:06:29.078171 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:29.078141    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a7f848a7-2315-4b0a-be4c-71eb4a4960a9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6\" (UID: \"a7f848a7-2315-4b0a-be4c-71eb4a4960a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6"
Jul 17 18:06:29.078666 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:29.078646    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a7f848a7-2315-4b0a-be4c-71eb4a4960a9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6\" (UID: \"a7f848a7-2315-4b0a-be4c-71eb4a4960a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6"
Jul 17 18:06:29.083686 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:29.083664    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r85m9\" (UniqueName: \"kubernetes.io/projected/a7f848a7-2315-4b0a-be4c-71eb4a4960a9-kube-api-access-r85m9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6\" (UID: \"a7f848a7-2315-4b0a-be4c-71eb4a4960a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6"
Jul 17 18:06:29.200976 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:29.200947    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6"
Jul 17 18:06:29.338041 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:29.338015    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6"]
Jul 17 18:06:29.340597 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:06:29.340563    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7f848a7_2315_4b0a_be4c_71eb4a4960a9.slice/crio-ed7b69e84259413db25c2c8783f6500aebc4327acfc8e8b094243698094486df WatchSource:0}: Error finding container ed7b69e84259413db25c2c8783f6500aebc4327acfc8e8b094243698094486df: Status 404 returned error can't find the container with id ed7b69e84259413db25c2c8783f6500aebc4327acfc8e8b094243698094486df
Jul 17 18:06:29.341968 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:29.341952    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 18:06:29.389745 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:29.389711    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6" event={"ID":"a7f848a7-2315-4b0a-be4c-71eb4a4960a9","Type":"ContainerStarted","Data":"ed7b69e84259413db25c2c8783f6500aebc4327acfc8e8b094243698094486df"}
Jul 17 18:06:30.396386 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:30.396347    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6" event={"ID":"a7f848a7-2315-4b0a-be4c-71eb4a4960a9","Type":"ContainerStarted","Data":"69bcabbe4a2c56048a16dd2164c00979a11c24b3e6a9976f20822b4b6ab02cdb"}
Jul 17 18:06:30.413932 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:30.413872    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6" podStartSLOduration=1.871571407 podStartE2EDuration="2.413854075s" totalImagesPullingTime="542.282668ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:06:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:06:30.412141014 +0000 UTC m=+617.637370323" watchObservedRunningTime="2026-07-17 18:06:30.413854075 +0000 UTC m=+617.639083437"
Jul 17 18:06:38.675594 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:38.675494    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:06:39.201346 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:39.201311    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6"
Jul 17 18:06:39.201543 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:39.201400    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6"
Jul 17 18:06:39.213835 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:39.213803    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6"
Jul 17 18:06:39.450637 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:39.450605    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6"
Jul 17 18:06:40.684949 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:40.684910    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:06:49.618341 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:06:49.618294    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:07:12.369756 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:07:12.369714    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:07:20.423078 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:07:20.423041    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:07:20.479356 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:07:20.479319    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:07:45.564065 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:07:45.564028    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:07:45.659505 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:07:45.659467    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:07:46.721570 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:07:46.721531    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bbb8c7645-9hfsq"]
Jul 17 18:07:46.722024 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:07:46.721725    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bbb8c7645-9hfsq" podUID="107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3" containerName="authorino" containerID="cri-o://ee96e061ecf2c44ce7179bf8252bd98186b94b16f962eb4e6fee7f39d8d48ddb" gracePeriod=30
Jul 17 18:07:46.819392 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:07:46.819354    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:07:46.922361 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:07:46.922313    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:07:46.979356 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:07:46.979292    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bbb8c7645-9hfsq"
Jul 17 18:07:47.078779 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:07:47.078724    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-948ss\" (UniqueName: \"kubernetes.io/projected/107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3-kube-api-access-948ss\") pod \"107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3\" (UID: \"107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3\") "
Jul 17 18:07:47.079030 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:07:47.078803    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3-tls-cert\") pod \"107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3\" (UID: \"107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3\") "
Jul 17 18:07:47.080924 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:07:47.080894    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3-kube-api-access-948ss" (OuterVolumeSpecName: "kube-api-access-948ss") pod "107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3" (UID: "107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3"). InnerVolumeSpecName "kube-api-access-948ss". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:07:47.089539 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:07:47.089510    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3" (UID: "107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 18:07:47.180386 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:07:47.180336    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-948ss\" (UniqueName: \"kubernetes.io/projected/107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3-kube-api-access-948ss\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:07:47.180386 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:07:47.180381    2572 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3-tls-cert\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:07:47.765206 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:07:47.765114    2572 generic.go:356] "Generic (PLEG): container finished" podID="107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3" containerID="ee96e061ecf2c44ce7179bf8252bd98186b94b16f962eb4e6fee7f39d8d48ddb" exitCode=0
Jul 17 18:07:47.765206 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:07:47.765154    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bbb8c7645-9hfsq"
Jul 17 18:07:47.765696 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:07:47.765197    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bbb8c7645-9hfsq" event={"ID":"107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3","Type":"ContainerDied","Data":"ee96e061ecf2c44ce7179bf8252bd98186b94b16f962eb4e6fee7f39d8d48ddb"}
Jul 17 18:07:47.765696 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:07:47.765242    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bbb8c7645-9hfsq" event={"ID":"107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3","Type":"ContainerDied","Data":"5683900cd29280b0ada7c463d9baf06106a5bf05b30239cdd072afb114ca99a1"}
Jul 17 18:07:47.765696 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:07:47.765259    2572 scope.go:117] "RemoveContainer" containerID="ee96e061ecf2c44ce7179bf8252bd98186b94b16f962eb4e6fee7f39d8d48ddb"
Jul 17 18:07:47.774480 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:07:47.774460    2572 scope.go:117] "RemoveContainer" containerID="ee96e061ecf2c44ce7179bf8252bd98186b94b16f962eb4e6fee7f39d8d48ddb"
Jul 17 18:07:47.774776 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:07:47.774760    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee96e061ecf2c44ce7179bf8252bd98186b94b16f962eb4e6fee7f39d8d48ddb\": container with ID starting with ee96e061ecf2c44ce7179bf8252bd98186b94b16f962eb4e6fee7f39d8d48ddb not found: ID does not exist" containerID="ee96e061ecf2c44ce7179bf8252bd98186b94b16f962eb4e6fee7f39d8d48ddb"
Jul 17 18:07:47.774837 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:07:47.774782    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee96e061ecf2c44ce7179bf8252bd98186b94b16f962eb4e6fee7f39d8d48ddb"} err="failed to get container status \"ee96e061ecf2c44ce7179bf8252bd98186b94b16f962eb4e6fee7f39d8d48ddb\": rpc error: code = NotFound desc = could not find container \"ee96e061ecf2c44ce7179bf8252bd98186b94b16f962eb4e6fee7f39d8d48ddb\": container with ID starting with ee96e061ecf2c44ce7179bf8252bd98186b94b16f962eb4e6fee7f39d8d48ddb not found: ID does not exist"
Jul 17 18:07:47.791155 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:07:47.791118    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bbb8c7645-9hfsq"]
Jul 17 18:07:47.792750 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:07:47.792730    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bbb8c7645-9hfsq"]
Jul 17 18:07:49.471160 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:07:49.471129    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3" path="/var/lib/kubelet/pods/107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3/volumes"
Jul 17 18:07:57.326267 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:07:57.326225    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:08:04.601635 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:08:04.601594    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:08:34.278600 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:08:34.278559    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bd9bf478b-m29pl"]
Jul 17 18:08:34.279156 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:08:34.278767    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7bd9bf478b-m29pl" podUID="11b86039-8fcd-488a-b020-516cd09766ee" containerName="manager" containerID="cri-o://edfc8be7bd987d42f98118d33285e369dc08e1e1e831065b3388d5d33d7a7a4a" gracePeriod=30
Jul 17 18:08:34.529528 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:08:34.529462    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bd9bf478b-m29pl"
Jul 17 18:08:34.704616 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:08:34.704574    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/11b86039-8fcd-488a-b020-516cd09766ee-webhook-cert\") pod \"11b86039-8fcd-488a-b020-516cd09766ee\" (UID: \"11b86039-8fcd-488a-b020-516cd09766ee\") "
Jul 17 18:08:34.704815 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:08:34.704667    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqr2n\" (UniqueName: \"kubernetes.io/projected/11b86039-8fcd-488a-b020-516cd09766ee-kube-api-access-mqr2n\") pod \"11b86039-8fcd-488a-b020-516cd09766ee\" (UID: \"11b86039-8fcd-488a-b020-516cd09766ee\") "
Jul 17 18:08:34.706937 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:08:34.706900    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11b86039-8fcd-488a-b020-516cd09766ee-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "11b86039-8fcd-488a-b020-516cd09766ee" (UID: "11b86039-8fcd-488a-b020-516cd09766ee"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 18:08:34.706937 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:08:34.706928    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11b86039-8fcd-488a-b020-516cd09766ee-kube-api-access-mqr2n" (OuterVolumeSpecName: "kube-api-access-mqr2n") pod "11b86039-8fcd-488a-b020-516cd09766ee" (UID: "11b86039-8fcd-488a-b020-516cd09766ee"). InnerVolumeSpecName "kube-api-access-mqr2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:08:34.805848 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:08:34.805751    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqr2n\" (UniqueName: \"kubernetes.io/projected/11b86039-8fcd-488a-b020-516cd09766ee-kube-api-access-mqr2n\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:08:34.805848 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:08:34.805787    2572 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/11b86039-8fcd-488a-b020-516cd09766ee-webhook-cert\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:08:34.991477 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:08:34.991439    2572 generic.go:356] "Generic (PLEG): container finished" podID="11b86039-8fcd-488a-b020-516cd09766ee" containerID="edfc8be7bd987d42f98118d33285e369dc08e1e1e831065b3388d5d33d7a7a4a" exitCode=0
Jul 17 18:08:34.991660 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:08:34.991485    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bd9bf478b-m29pl"
Jul 17 18:08:34.991660 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:08:34.991524    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bd9bf478b-m29pl" event={"ID":"11b86039-8fcd-488a-b020-516cd09766ee","Type":"ContainerDied","Data":"edfc8be7bd987d42f98118d33285e369dc08e1e1e831065b3388d5d33d7a7a4a"}
Jul 17 18:08:34.991660 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:08:34.991577    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bd9bf478b-m29pl" event={"ID":"11b86039-8fcd-488a-b020-516cd09766ee","Type":"ContainerDied","Data":"42a4cd5860a257561712f627241303aba34f1c0fd741993977bda3ae54524de9"}
Jul 17 18:08:34.991660 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:08:34.991600    2572 scope.go:117] "RemoveContainer" containerID="edfc8be7bd987d42f98118d33285e369dc08e1e1e831065b3388d5d33d7a7a4a"
Jul 17 18:08:35.001113 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:08:35.001093    2572 scope.go:117] "RemoveContainer" containerID="edfc8be7bd987d42f98118d33285e369dc08e1e1e831065b3388d5d33d7a7a4a"
Jul 17 18:08:35.001393 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:08:35.001378    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"edfc8be7bd987d42f98118d33285e369dc08e1e1e831065b3388d5d33d7a7a4a\": container with ID starting with edfc8be7bd987d42f98118d33285e369dc08e1e1e831065b3388d5d33d7a7a4a not found: ID does not exist" containerID="edfc8be7bd987d42f98118d33285e369dc08e1e1e831065b3388d5d33d7a7a4a"
Jul 17 18:08:35.001433 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:08:35.001403    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"edfc8be7bd987d42f98118d33285e369dc08e1e1e831065b3388d5d33d7a7a4a"} err="failed to get container status \"edfc8be7bd987d42f98118d33285e369dc08e1e1e831065b3388d5d33d7a7a4a\": rpc error: code = NotFound desc = could not find container \"edfc8be7bd987d42f98118d33285e369dc08e1e1e831065b3388d5d33d7a7a4a\": container with ID starting with edfc8be7bd987d42f98118d33285e369dc08e1e1e831065b3388d5d33d7a7a4a not found: ID does not exist"
Jul 17 18:08:35.013134 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:08:35.013106    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bd9bf478b-m29pl"]
Jul 17 18:08:35.017347 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:08:35.017322    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7bd9bf478b-m29pl"]
Jul 17 18:08:35.471874 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:08:35.471837    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11b86039-8fcd-488a-b020-516cd09766ee" path="/var/lib/kubelet/pods/11b86039-8fcd-488a-b020-516cd09766ee/volumes"
Jul 17 18:09:35.842191 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:35.842108    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bd9bf478b-j5kr7"]
Jul 17 18:09:35.842635 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:35.842464    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11b86039-8fcd-488a-b020-516cd09766ee" containerName="manager"
Jul 17 18:09:35.842635 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:35.842475    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="11b86039-8fcd-488a-b020-516cd09766ee" containerName="manager"
Jul 17 18:09:35.842635 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:35.842486    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3" containerName="authorino"
Jul 17 18:09:35.842635 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:35.842491    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3" containerName="authorino"
Jul 17 18:09:35.842635 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:35.842572    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="107dd17b-3bc3-436a-a9b2-0b4c5bd9ffa3" containerName="authorino"
Jul 17 18:09:35.842635 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:35.842580    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="11b86039-8fcd-488a-b020-516cd09766ee" containerName="manager"
Jul 17 18:09:35.846757 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:35.846739    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bd9bf478b-j5kr7"
Jul 17 18:09:35.850057 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:35.850033    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9dmbt\""
Jul 17 18:09:35.851140 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:35.851124    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 17 18:09:35.851219 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:35.851120    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 17 18:09:35.861649 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:35.861601    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bd9bf478b-j5kr7"]
Jul 17 18:09:35.962955 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:35.962912    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75abab68-8b76-4598-870a-a8d7d81a29d8-webhook-cert\") pod \"maas-controller-7bd9bf478b-j5kr7\" (UID: \"75abab68-8b76-4598-870a-a8d7d81a29d8\") " pod="opendatahub/maas-controller-7bd9bf478b-j5kr7"
Jul 17 18:09:35.963158 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:35.962968    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9d4nl\" (UniqueName: \"kubernetes.io/projected/75abab68-8b76-4598-870a-a8d7d81a29d8-kube-api-access-9d4nl\") pod \"maas-controller-7bd9bf478b-j5kr7\" (UID: \"75abab68-8b76-4598-870a-a8d7d81a29d8\") " pod="opendatahub/maas-controller-7bd9bf478b-j5kr7"
Jul 17 18:09:36.064324 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:36.064270    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75abab68-8b76-4598-870a-a8d7d81a29d8-webhook-cert\") pod \"maas-controller-7bd9bf478b-j5kr7\" (UID: \"75abab68-8b76-4598-870a-a8d7d81a29d8\") " pod="opendatahub/maas-controller-7bd9bf478b-j5kr7"
Jul 17 18:09:36.064324 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:36.064330    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9d4nl\" (UniqueName: \"kubernetes.io/projected/75abab68-8b76-4598-870a-a8d7d81a29d8-kube-api-access-9d4nl\") pod \"maas-controller-7bd9bf478b-j5kr7\" (UID: \"75abab68-8b76-4598-870a-a8d7d81a29d8\") " pod="opendatahub/maas-controller-7bd9bf478b-j5kr7"
Jul 17 18:09:36.066856 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:36.066829    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75abab68-8b76-4598-870a-a8d7d81a29d8-webhook-cert\") pod \"maas-controller-7bd9bf478b-j5kr7\" (UID: \"75abab68-8b76-4598-870a-a8d7d81a29d8\") " pod="opendatahub/maas-controller-7bd9bf478b-j5kr7"
Jul 17 18:09:36.075494 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:36.075458    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9d4nl\" (UniqueName: \"kubernetes.io/projected/75abab68-8b76-4598-870a-a8d7d81a29d8-kube-api-access-9d4nl\") pod \"maas-controller-7bd9bf478b-j5kr7\" (UID: \"75abab68-8b76-4598-870a-a8d7d81a29d8\") " pod="opendatahub/maas-controller-7bd9bf478b-j5kr7"
Jul 17 18:09:36.162734 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:36.162626    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bd9bf478b-j5kr7"
Jul 17 18:09:36.315495 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:36.315468    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bd9bf478b-j5kr7"]
Jul 17 18:09:36.317917 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:09:36.317892    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75abab68_8b76_4598_870a_a8d7d81a29d8.slice/crio-e534f4861236e823ffa76691f955fda718350890e9098bcf9c3d132dd91337e2 WatchSource:0}: Error finding container e534f4861236e823ffa76691f955fda718350890e9098bcf9c3d132dd91337e2: Status 404 returned error can't find the container with id e534f4861236e823ffa76691f955fda718350890e9098bcf9c3d132dd91337e2
Jul 17 18:09:37.292077 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:37.292033    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bd9bf478b-j5kr7" event={"ID":"75abab68-8b76-4598-870a-a8d7d81a29d8","Type":"ContainerStarted","Data":"81b014d7470a130975a11d5371ab74e90412bf467adc975f0fbd96fdd6476b65"}
Jul 17 18:09:37.292488 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:37.292102    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bd9bf478b-j5kr7" event={"ID":"75abab68-8b76-4598-870a-a8d7d81a29d8","Type":"ContainerStarted","Data":"e534f4861236e823ffa76691f955fda718350890e9098bcf9c3d132dd91337e2"}
Jul 17 18:09:37.292488 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:37.292219    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bd9bf478b-j5kr7"
Jul 17 18:09:37.311346 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:37.311276    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7bd9bf478b-j5kr7" podStartSLOduration=1.878899166 podStartE2EDuration="2.311260754s" totalImagesPullingTime="432.361588ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:09:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:09:37.30931797 +0000 UTC m=+804.534547277" watchObservedRunningTime="2026-07-17 18:09:37.311260754 +0000 UTC m=+804.536490062"
Jul 17 18:09:48.300451 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:48.300422    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bd9bf478b-j5kr7"
Jul 17 18:09:52.892073 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:52.892036    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:09:52.966692 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:52.966649    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bd9bf478b-j5kr7"]
Jul 17 18:09:52.966919 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:52.966892    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7bd9bf478b-j5kr7" podUID="75abab68-8b76-4598-870a-a8d7d81a29d8" containerName="manager" containerID="cri-o://81b014d7470a130975a11d5371ab74e90412bf467adc975f0fbd96fdd6476b65" gracePeriod=30
Jul 17 18:09:53.220265 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:53.220236    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bd9bf478b-j5kr7"
Jul 17 18:09:53.324027 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:53.323988    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75abab68-8b76-4598-870a-a8d7d81a29d8-webhook-cert\") pod \"75abab68-8b76-4598-870a-a8d7d81a29d8\" (UID: \"75abab68-8b76-4598-870a-a8d7d81a29d8\") "
Jul 17 18:09:53.324198 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:53.324055    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9d4nl\" (UniqueName: \"kubernetes.io/projected/75abab68-8b76-4598-870a-a8d7d81a29d8-kube-api-access-9d4nl\") pod \"75abab68-8b76-4598-870a-a8d7d81a29d8\" (UID: \"75abab68-8b76-4598-870a-a8d7d81a29d8\") "
Jul 17 18:09:53.326021 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:53.325961    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75abab68-8b76-4598-870a-a8d7d81a29d8-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "75abab68-8b76-4598-870a-a8d7d81a29d8" (UID: "75abab68-8b76-4598-870a-a8d7d81a29d8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 18:09:53.326021 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:53.325977    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75abab68-8b76-4598-870a-a8d7d81a29d8-kube-api-access-9d4nl" (OuterVolumeSpecName: "kube-api-access-9d4nl") pod "75abab68-8b76-4598-870a-a8d7d81a29d8" (UID: "75abab68-8b76-4598-870a-a8d7d81a29d8"). InnerVolumeSpecName "kube-api-access-9d4nl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:09:53.371596 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:53.371559    2572 generic.go:356] "Generic (PLEG): container finished" podID="75abab68-8b76-4598-870a-a8d7d81a29d8" containerID="81b014d7470a130975a11d5371ab74e90412bf467adc975f0fbd96fdd6476b65" exitCode=0
Jul 17 18:09:53.371757 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:53.371607    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bd9bf478b-j5kr7"
Jul 17 18:09:53.371757 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:53.371643    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bd9bf478b-j5kr7" event={"ID":"75abab68-8b76-4598-870a-a8d7d81a29d8","Type":"ContainerDied","Data":"81b014d7470a130975a11d5371ab74e90412bf467adc975f0fbd96fdd6476b65"}
Jul 17 18:09:53.371757 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:53.371700    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bd9bf478b-j5kr7" event={"ID":"75abab68-8b76-4598-870a-a8d7d81a29d8","Type":"ContainerDied","Data":"e534f4861236e823ffa76691f955fda718350890e9098bcf9c3d132dd91337e2"}
Jul 17 18:09:53.371757 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:53.371722    2572 scope.go:117] "RemoveContainer" containerID="81b014d7470a130975a11d5371ab74e90412bf467adc975f0fbd96fdd6476b65"
Jul 17 18:09:53.380757 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:53.380739    2572 scope.go:117] "RemoveContainer" containerID="81b014d7470a130975a11d5371ab74e90412bf467adc975f0fbd96fdd6476b65"
Jul 17 18:09:53.381044 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:09:53.381021    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81b014d7470a130975a11d5371ab74e90412bf467adc975f0fbd96fdd6476b65\": container with ID starting with 81b014d7470a130975a11d5371ab74e90412bf467adc975f0fbd96fdd6476b65 not found: ID does not exist" containerID="81b014d7470a130975a11d5371ab74e90412bf467adc975f0fbd96fdd6476b65"
Jul 17 18:09:53.381101 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:53.381052    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81b014d7470a130975a11d5371ab74e90412bf467adc975f0fbd96fdd6476b65"} err="failed to get container status \"81b014d7470a130975a11d5371ab74e90412bf467adc975f0fbd96fdd6476b65\": rpc error: code = NotFound desc = could not find container \"81b014d7470a130975a11d5371ab74e90412bf467adc975f0fbd96fdd6476b65\": container with ID starting with 81b014d7470a130975a11d5371ab74e90412bf467adc975f0fbd96fdd6476b65 not found: ID does not exist"
Jul 17 18:09:53.391836 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:53.391808    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bd9bf478b-j5kr7"]
Jul 17 18:09:53.395212 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:53.395190    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7bd9bf478b-j5kr7"]
Jul 17 18:09:53.424872 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:53.424850    2572 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/75abab68-8b76-4598-870a-a8d7d81a29d8-webhook-cert\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:09:53.424872 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:53.424874    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9d4nl\" (UniqueName: \"kubernetes.io/projected/75abab68-8b76-4598-870a-a8d7d81a29d8-kube-api-access-9d4nl\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:09:53.476201 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:53.474225    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75abab68-8b76-4598-870a-a8d7d81a29d8" path="/var/lib/kubelet/pods/75abab68-8b76-4598-870a-a8d7d81a29d8/volumes"
Jul 17 18:09:54.069757 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:54.069675    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:09:54.199947 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:54.199912    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bd9bf478b-lr6df"]
Jul 17 18:09:54.200302 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:54.200288    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75abab68-8b76-4598-870a-a8d7d81a29d8" containerName="manager"
Jul 17 18:09:54.200347 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:54.200303    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="75abab68-8b76-4598-870a-a8d7d81a29d8" containerName="manager"
Jul 17 18:09:54.200392 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:54.200383    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="75abab68-8b76-4598-870a-a8d7d81a29d8" containerName="manager"
Jul 17 18:09:54.204642 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:54.204623    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bd9bf478b-lr6df"
Jul 17 18:09:54.208031 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:54.208011    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9dmbt\""
Jul 17 18:09:54.208167 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:54.208030    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 17 18:09:54.208167 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:54.208033    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 17 18:09:54.213602 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:54.213575    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bd9bf478b-lr6df"]
Jul 17 18:09:54.332858 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:54.332765    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j27p4\" (UniqueName: \"kubernetes.io/projected/538faa02-ec5b-40f6-b1b7-d0f347c3fde6-kube-api-access-j27p4\") pod \"maas-controller-7bd9bf478b-lr6df\" (UID: \"538faa02-ec5b-40f6-b1b7-d0f347c3fde6\") " pod="opendatahub/maas-controller-7bd9bf478b-lr6df"
Jul 17 18:09:54.332858 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:54.332815    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/538faa02-ec5b-40f6-b1b7-d0f347c3fde6-webhook-cert\") pod \"maas-controller-7bd9bf478b-lr6df\" (UID: \"538faa02-ec5b-40f6-b1b7-d0f347c3fde6\") " pod="opendatahub/maas-controller-7bd9bf478b-lr6df"
Jul 17 18:09:54.433536 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:54.433496    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j27p4\" (UniqueName: \"kubernetes.io/projected/538faa02-ec5b-40f6-b1b7-d0f347c3fde6-kube-api-access-j27p4\") pod \"maas-controller-7bd9bf478b-lr6df\" (UID: \"538faa02-ec5b-40f6-b1b7-d0f347c3fde6\") " pod="opendatahub/maas-controller-7bd9bf478b-lr6df"
Jul 17 18:09:54.433714 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:54.433549    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/538faa02-ec5b-40f6-b1b7-d0f347c3fde6-webhook-cert\") pod \"maas-controller-7bd9bf478b-lr6df\" (UID: \"538faa02-ec5b-40f6-b1b7-d0f347c3fde6\") " pod="opendatahub/maas-controller-7bd9bf478b-lr6df"
Jul 17 18:09:54.436153 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:54.436129    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/538faa02-ec5b-40f6-b1b7-d0f347c3fde6-webhook-cert\") pod \"maas-controller-7bd9bf478b-lr6df\" (UID: \"538faa02-ec5b-40f6-b1b7-d0f347c3fde6\") " pod="opendatahub/maas-controller-7bd9bf478b-lr6df"
Jul 17 18:09:54.442343 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:54.442313    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j27p4\" (UniqueName: \"kubernetes.io/projected/538faa02-ec5b-40f6-b1b7-d0f347c3fde6-kube-api-access-j27p4\") pod \"maas-controller-7bd9bf478b-lr6df\" (UID: \"538faa02-ec5b-40f6-b1b7-d0f347c3fde6\") " pod="opendatahub/maas-controller-7bd9bf478b-lr6df"
Jul 17 18:09:54.515517 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:54.515472    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bd9bf478b-lr6df"
Jul 17 18:09:54.651365 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:54.651331    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bd9bf478b-lr6df"]
Jul 17 18:09:54.653370 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:09:54.653342    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod538faa02_ec5b_40f6_b1b7_d0f347c3fde6.slice/crio-3eba1062844f2b9d77e9b7406c3cdccd2e54799a2c2f4db70999d8b470abfd5b WatchSource:0}: Error finding container 3eba1062844f2b9d77e9b7406c3cdccd2e54799a2c2f4db70999d8b470abfd5b: Status 404 returned error can't find the container with id 3eba1062844f2b9d77e9b7406c3cdccd2e54799a2c2f4db70999d8b470abfd5b
Jul 17 18:09:55.383677 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:55.383576    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bd9bf478b-lr6df" event={"ID":"538faa02-ec5b-40f6-b1b7-d0f347c3fde6","Type":"ContainerStarted","Data":"6b87d22d21a9951a060c330ec235b38d0a00a31a057445abeddb71702f5fb9b4"}
Jul 17 18:09:55.383677 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:55.383636    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bd9bf478b-lr6df" event={"ID":"538faa02-ec5b-40f6-b1b7-d0f347c3fde6","Type":"ContainerStarted","Data":"3eba1062844f2b9d77e9b7406c3cdccd2e54799a2c2f4db70999d8b470abfd5b"}
Jul 17 18:09:55.383677 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:55.383667    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bd9bf478b-lr6df"
Jul 17 18:09:55.402091 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:55.402039    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7bd9bf478b-lr6df" podStartSLOduration=0.989312648 podStartE2EDuration="1.402020725s" totalImagesPullingTime="412.708077ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:09:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:09:55.399617191 +0000 UTC m=+822.624846500" watchObservedRunningTime="2026-07-17 18:09:55.402020725 +0000 UTC m=+822.627250035"
Jul 17 18:09:58.816149 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:58.816112    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:09:58.897373 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:09:58.897339    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:10:06.391232 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:10:06.391198    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bd9bf478b-lr6df"
Jul 17 18:10:34.874854 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:10:34.874821    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:10:34.971453 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:10:34.971409    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:10:35.124059 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:10:35.123993    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:10:40.845229 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:10:40.845184    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:10:40.904842 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:10:40.904807    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:10:40.989627 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:10:40.989596    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:10:41.089726 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:10:41.089691    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:10:41.246921 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:10:41.246868    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:10:46.924472 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:10:46.924440    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:10:46.988947 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:10:46.988909    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:11:13.440855 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:11:13.440821    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tp9qm_6c101a17-a051-4e9d-a9dd-f72c67ba2a8a/console-operator/2.log"
Jul 17 18:11:13.441482 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:11:13.441404    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tp9qm_6c101a17-a051-4e9d-a9dd-f72c67ba2a8a/console-operator/2.log"
Jul 17 18:11:13.447664 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:11:13.447640    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5mdx_2e3bd369-576e-4df1-8a76-aebd537cde58/ovn-acl-logging/0.log"
Jul 17 18:11:13.447944 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:11:13.447927    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5mdx_2e3bd369-576e-4df1-8a76-aebd537cde58/ovn-acl-logging/0.log"
Jul 17 18:11:41.925773 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:11:41.925734    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:13:00.702510 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:13:00.702423    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:13:26.772704 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:13:26.772668    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:13:56.875254 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:13:56.875210    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:16:13.470290 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:16:13.470253    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tp9qm_6c101a17-a051-4e9d-a9dd-f72c67ba2a8a/console-operator/2.log"
Jul 17 18:16:13.472266 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:16:13.472241    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tp9qm_6c101a17-a051-4e9d-a9dd-f72c67ba2a8a/console-operator/2.log"
Jul 17 18:16:13.477150 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:16:13.477123    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5mdx_2e3bd369-576e-4df1-8a76-aebd537cde58/ovn-acl-logging/0.log"
Jul 17 18:16:13.478809 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:16:13.478792    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5mdx_2e3bd369-576e-4df1-8a76-aebd537cde58/ovn-acl-logging/0.log"
Jul 17 18:19:28.006806 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:19:28.006753    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:20:50.526665 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:20:50.526630    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:20:50.625263 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:20:50.625231    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:21:13.503234 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:21:13.503198    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tp9qm_6c101a17-a051-4e9d-a9dd-f72c67ba2a8a/console-operator/2.log"
Jul 17 18:21:13.506781 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:21:13.506757    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tp9qm_6c101a17-a051-4e9d-a9dd-f72c67ba2a8a/console-operator/2.log"
Jul 17 18:21:13.512616 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:21:13.512583    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5mdx_2e3bd369-576e-4df1-8a76-aebd537cde58/ovn-acl-logging/0.log"
Jul 17 18:21:13.515471 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:21:13.515448    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5mdx_2e3bd369-576e-4df1-8a76-aebd537cde58/ovn-acl-logging/0.log"
Jul 17 18:21:40.141647 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:21:40.141572    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:21:46.955366 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:21:46.955330    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:21:55.214103 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:21:55.214061    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:22:00.392609 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:00.392572    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:22:03.465819 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:03.465784    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:22:03.565781 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:03.565738    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:22:03.940045 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:03.939987    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:22:09.984814 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:09.984778    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:22:10.061323 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.061285    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:22:10.192032 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.191972    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"]
Jul 17 18:22:10.195876 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.195857    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:10.198707 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.198682    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-02bfc37f-openshift-default-dockercfg-nfvqj\""
Jul 17 18:22:10.226027 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.225969    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"]
Jul 17 18:22:10.228657 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.228610    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:22:10.327982 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.327881    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:22:10.358169 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.358132    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-istio-envoy\") pod \"e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") " pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:10.358324 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.358202    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-credential-socket\") pod \"e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") " pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:10.358324 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.358251    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-istio-data\") pod \"e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") " pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:10.358324 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.358298    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-workload-certs\") pod \"e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") " pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:10.358324 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.358319    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-istiod-ca-cert\") pod \"e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") " pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:10.358470 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.358371    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-istio-token\") pod \"e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") " pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:10.358470 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.358415    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-istio-podinfo\") pod \"e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") " pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:10.358470 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.358438    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfg25\" (UniqueName: \"kubernetes.io/projected/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-kube-api-access-hfg25\") pod \"e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") " pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:10.358470 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.358460    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-workload-socket\") pod \"e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") " pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:10.459381 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.459345    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-istio-podinfo\") pod \"e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") " pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:10.459381 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.459386    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfg25\" (UniqueName: \"kubernetes.io/projected/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-kube-api-access-hfg25\") pod \"e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") " pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:10.459601 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.459408    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-workload-socket\") pod \"e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") " pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:10.459601 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.459445    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-istio-envoy\") pod \"e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") " pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:10.459601 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.459520    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-credential-socket\") pod \"e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") " pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:10.459601 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.459542    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-istio-data\") pod \"e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") " pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:10.459601 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.459591    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-workload-certs\") pod \"e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") " pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:10.459843 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.459765    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-istiod-ca-cert\") pod \"e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") " pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:10.459843 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.459825    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-istio-token\") pod \"e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") " pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:10.459942 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.459876    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-workload-socket\") pod \"e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") " pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:10.460016 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.459954    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-workload-certs\") pod \"e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") " pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:10.460239 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.460214    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-credential-socket\") pod \"e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") " pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:10.460334 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.460310    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-istio-data\") pod \"e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") " pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:10.460482 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.460464    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-istiod-ca-cert\") pod \"e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") " pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:10.461800 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.461781    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-istio-envoy\") pod \"e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") " pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:10.462071 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.462054    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-istio-podinfo\") pod \"e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") " pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:10.474377 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.474352    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-istio-token\") pod \"e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") " pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:10.475108 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.475088    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfg25\" (UniqueName: \"kubernetes.io/projected/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-kube-api-access-hfg25\") pod \"e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") " pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:10.506924 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.506893    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:10.651183 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.651156    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"]
Jul 17 18:22:10.653969 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:22:10.653936    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod835af52d_f0fa_4b6b_8954_ad24c4d2ae4f.slice/crio-a1d402df47d373d2b4189f25c7825bd5aedeffed64c49d95d7a5216b7cf9dedc WatchSource:0}: Error finding container a1d402df47d373d2b4189f25c7825bd5aedeffed64c49d95d7a5216b7cf9dedc: Status 404 returned error can't find the container with id a1d402df47d373d2b4189f25c7825bd5aedeffed64c49d95d7a5216b7cf9dedc
Jul 17 18:22:10.656051 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.656016    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:22:10.656167 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.656102    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:22:10.656167 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.656146    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:22:10.871235 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.871139    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg" event={"ID":"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f","Type":"ContainerStarted","Data":"db77c9420983cfe60b4b8fd076506b8a18951eb5587f0f550d30363beedd17c4"}
Jul 17 18:22:10.871235 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.871193    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg" event={"ID":"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f","Type":"ContainerStarted","Data":"a1d402df47d373d2b4189f25c7825bd5aedeffed64c49d95d7a5216b7cf9dedc"}
Jul 17 18:22:10.896309 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:10.896250    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg" podStartSLOduration=0.896234167 podStartE2EDuration="896.234167ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:22:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:22:10.89351612 +0000 UTC m=+1558.118745441" watchObservedRunningTime="2026-07-17 18:22:10.896234167 +0000 UTC m=+1558.121463475"
Jul 17 18:22:11.398691 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:11.398654    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:22:11.500464 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:11.500435    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:22:11.507337 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:11.507307    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:11.512344 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:11.512317    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:11.518786 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:11.518760    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8"]
Jul 17 18:22:11.522892 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:11.522864    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8"
Jul 17 18:22:11.525307 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:11.525285    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-02bfc37f-serving-cert\""
Jul 17 18:22:11.537954 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:11.537920    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8"]
Jul 17 18:22:11.586596 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:11.586569    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:22:11.670906 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:11.670812    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr9r7\" (UniqueName: \"kubernetes.io/projected/d953167f-1a80-4ec0-9973-137eec7ba53b-kube-api-access-qr9r7\") pod \"maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8\" (UID: \"d953167f-1a80-4ec0-9973-137eec7ba53b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8"
Jul 17 18:22:11.670906 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:11.670881    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d953167f-1a80-4ec0-9973-137eec7ba53b-openshift-service-ca\") pod \"maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8\" (UID: \"d953167f-1a80-4ec0-9973-137eec7ba53b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8"
Jul 17 18:22:11.671171 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:11.670915    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d953167f-1a80-4ec0-9973-137eec7ba53b-maas-api-tls\") pod \"maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8\" (UID: \"d953167f-1a80-4ec0-9973-137eec7ba53b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8"
Jul 17 18:22:11.771735 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:11.771665    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d953167f-1a80-4ec0-9973-137eec7ba53b-openshift-service-ca\") pod \"maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8\" (UID: \"d953167f-1a80-4ec0-9973-137eec7ba53b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8"
Jul 17 18:22:11.771921 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:11.771746    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d953167f-1a80-4ec0-9973-137eec7ba53b-maas-api-tls\") pod \"maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8\" (UID: \"d953167f-1a80-4ec0-9973-137eec7ba53b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8"
Jul 17 18:22:11.771921 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:11.771864    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr9r7\" (UniqueName: \"kubernetes.io/projected/d953167f-1a80-4ec0-9973-137eec7ba53b-kube-api-access-qr9r7\") pod \"maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8\" (UID: \"d953167f-1a80-4ec0-9973-137eec7ba53b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8"
Jul 17 18:22:11.772530 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:11.772509    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d953167f-1a80-4ec0-9973-137eec7ba53b-openshift-service-ca\") pod \"maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8\" (UID: \"d953167f-1a80-4ec0-9973-137eec7ba53b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8"
Jul 17 18:22:11.774300 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:11.774276    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d953167f-1a80-4ec0-9973-137eec7ba53b-maas-api-tls\") pod \"maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8\" (UID: \"d953167f-1a80-4ec0-9973-137eec7ba53b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8"
Jul 17 18:22:11.786425 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:11.786396    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr9r7\" (UniqueName: \"kubernetes.io/projected/d953167f-1a80-4ec0-9973-137eec7ba53b-kube-api-access-qr9r7\") pod \"maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8\" (UID: \"d953167f-1a80-4ec0-9973-137eec7ba53b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8"
Jul 17 18:22:11.810435 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:11.810410    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:22:11.833486 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:11.833459    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8"
Jul 17 18:22:11.875791 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:11.875754    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:11.877033 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:11.876989    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:12.196902 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:12.196871    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8"]
Jul 17 18:22:12.199388 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:22:12.199354    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd953167f_1a80_4ec0_9973_137eec7ba53b.slice/crio-bcac516d90e6385fb7ed0b50aabcc1c7cc8cfd96f50fe0301d1ef7a6b62755c5 WatchSource:0}: Error finding container bcac516d90e6385fb7ed0b50aabcc1c7cc8cfd96f50fe0301d1ef7a6b62755c5: Status 404 returned error can't find the container with id bcac516d90e6385fb7ed0b50aabcc1c7cc8cfd96f50fe0301d1ef7a6b62755c5
Jul 17 18:22:12.200868 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:12.200843    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 18:22:12.294738 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:12.294693    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:22:12.390009 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:12.389961    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:22:12.883726 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:12.883684    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" event={"ID":"d953167f-1a80-4ec0-9973-137eec7ba53b","Type":"ContainerStarted","Data":"02d89350c7ab81e74f4743a2373434db2a11d43e9d9acd203317412be1419810"}
Jul 17 18:22:12.884132 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:12.883785    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" event={"ID":"d953167f-1a80-4ec0-9973-137eec7ba53b","Type":"ContainerStarted","Data":"bcac516d90e6385fb7ed0b50aabcc1c7cc8cfd96f50fe0301d1ef7a6b62755c5"}
Jul 17 18:22:12.900734 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:12.900627    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" podStartSLOduration=1.457396655 podStartE2EDuration="1.90061046s" totalImagesPullingTime="443.213805ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:22:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:22:12.900049632 +0000 UTC m=+1560.125278956" watchObservedRunningTime="2026-07-17 18:22:12.90061046 +0000 UTC m=+1560.125839775"
Jul 17 18:22:13.890172 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:13.890134    2572 generic.go:356] "Generic (PLEG): container finished" podID="d953167f-1a80-4ec0-9973-137eec7ba53b" containerID="02d89350c7ab81e74f4743a2373434db2a11d43e9d9acd203317412be1419810" exitCode=1
Jul 17 18:22:13.890581 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:13.890216    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" event={"ID":"d953167f-1a80-4ec0-9973-137eec7ba53b","Type":"ContainerDied","Data":"02d89350c7ab81e74f4743a2373434db2a11d43e9d9acd203317412be1419810"}
Jul 17 18:22:13.890581 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:13.890486    2572 scope.go:117] "RemoveContainer" containerID="02d89350c7ab81e74f4743a2373434db2a11d43e9d9acd203317412be1419810"
Jul 17 18:22:14.209223 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:14.209192    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:22:14.897059 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:14.897021    2572 generic.go:356] "Generic (PLEG): container finished" podID="d953167f-1a80-4ec0-9973-137eec7ba53b" containerID="79a82ede40a27d897739f98f96d7ac265bbbb76e6ac3bdce5b62091c0a984bec" exitCode=1
Jul 17 18:22:14.897442 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:14.897098    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" event={"ID":"d953167f-1a80-4ec0-9973-137eec7ba53b","Type":"ContainerDied","Data":"79a82ede40a27d897739f98f96d7ac265bbbb76e6ac3bdce5b62091c0a984bec"}
Jul 17 18:22:14.897442 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:14.897167    2572 scope.go:117] "RemoveContainer" containerID="02d89350c7ab81e74f4743a2373434db2a11d43e9d9acd203317412be1419810"
Jul 17 18:22:14.897442 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:14.897373    2572 scope.go:117] "RemoveContainer" containerID="79a82ede40a27d897739f98f96d7ac265bbbb76e6ac3bdce5b62091c0a984bec"
Jul 17 18:22:14.897622 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:22:14.897603    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8_odh-ai-gateway-infra(d953167f-1a80-4ec0-9973-137eec7ba53b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b"
Jul 17 18:22:15.903345 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:15.903313    2572 scope.go:117] "RemoveContainer" containerID="79a82ede40a27d897739f98f96d7ac265bbbb76e6ac3bdce5b62091c0a984bec"
Jul 17 18:22:15.903744 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:22:15.903492    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8_odh-ai-gateway-infra(d953167f-1a80-4ec0-9973-137eec7ba53b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b"
Jul 17 18:22:16.451483 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:16.451441    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-h85pd"]
Jul 17 18:22:16.456290 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:16.456264    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-h85pd"
Jul 17 18:22:16.458853 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:16.458824    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:22:16.462597 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:16.462568    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-h85pd"]
Jul 17 18:22:16.516550 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:16.516515    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/266fdd49-e9a1-4c59-9711-11d257359cf7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-h85pd\" (UID: \"266fdd49-e9a1-4c59-9711-11d257359cf7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-h85pd"
Jul 17 18:22:16.617971 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:16.617925    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/266fdd49-e9a1-4c59-9711-11d257359cf7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-h85pd\" (UID: \"266fdd49-e9a1-4c59-9711-11d257359cf7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-h85pd"
Jul 17 18:22:16.618626 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:16.618607    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/266fdd49-e9a1-4c59-9711-11d257359cf7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-h85pd\" (UID: \"266fdd49-e9a1-4c59-9711-11d257359cf7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-h85pd"
Jul 17 18:22:16.770319 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:16.770216    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-h85pd"
Jul 17 18:22:16.940363 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:16.940331    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-h85pd"]
Jul 17 18:22:16.941354 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:22:16.941312    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod266fdd49_e9a1_4c59_9711_11d257359cf7.slice/crio-f46a6dc41216d4eef476c5c7c2fd36f5af34e0941b9386567c96ffa6d049b863 WatchSource:0}: Error finding container f46a6dc41216d4eef476c5c7c2fd36f5af34e0941b9386567c96ffa6d049b863: Status 404 returned error can't find the container with id f46a6dc41216d4eef476c5c7c2fd36f5af34e0941b9386567c96ffa6d049b863
Jul 17 18:22:17.883966 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:17.883918    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8"
Jul 17 18:22:17.884545 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:17.884518    2572 scope.go:117] "RemoveContainer" containerID="79a82ede40a27d897739f98f96d7ac265bbbb76e6ac3bdce5b62091c0a984bec"
Jul 17 18:22:17.884798 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:22:17.884765    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8_odh-ai-gateway-infra(d953167f-1a80-4ec0-9973-137eec7ba53b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b"
Jul 17 18:22:17.918577 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:17.918539    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-h85pd" event={"ID":"266fdd49-e9a1-4c59-9711-11d257359cf7","Type":"ContainerStarted","Data":"f46a6dc41216d4eef476c5c7c2fd36f5af34e0941b9386567c96ffa6d049b863"}
Jul 17 18:22:20.938239 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:20.938207    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-h85pd" event={"ID":"266fdd49-e9a1-4c59-9711-11d257359cf7","Type":"ContainerStarted","Data":"ee310b9c3ed6f3fd055403d08aa8ece9500b2999684175f6b83c9a0e120d8e69"}
Jul 17 18:22:20.955919 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:20.955852    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-h85pd" podStartSLOduration=1.518799834 podStartE2EDuration="4.955830152s" totalImagesPullingTime="3.437030318s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:22:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:22:20.952822895 +0000 UTC m=+1568.178052203" watchObservedRunningTime="2026-07-17 18:22:20.955830152 +0000 UTC m=+1568.181059461"
Jul 17 18:22:21.833748 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:21.833711    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8"
Jul 17 18:22:21.834126 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:21.834111    2572 scope.go:117] "RemoveContainer" containerID="79a82ede40a27d897739f98f96d7ac265bbbb76e6ac3bdce5b62091c0a984bec"
Jul 17 18:22:21.834318 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:22:21.834293    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8_odh-ai-gateway-infra(d953167f-1a80-4ec0-9973-137eec7ba53b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b"
Jul 17 18:22:21.944324 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:21.944292    2572 generic.go:356] "Generic (PLEG): container finished" podID="266fdd49-e9a1-4c59-9711-11d257359cf7" containerID="ee310b9c3ed6f3fd055403d08aa8ece9500b2999684175f6b83c9a0e120d8e69" exitCode=7
Jul 17 18:22:21.944712 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:21.944332    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-h85pd" event={"ID":"266fdd49-e9a1-4c59-9711-11d257359cf7","Type":"ContainerDied","Data":"ee310b9c3ed6f3fd055403d08aa8ece9500b2999684175f6b83c9a0e120d8e69"}
Jul 17 18:22:21.944712 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:21.944522    2572 scope.go:117] "RemoveContainer" containerID="ee310b9c3ed6f3fd055403d08aa8ece9500b2999684175f6b83c9a0e120d8e69"
Jul 17 18:22:22.951185 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:22.951148    2572 generic.go:356] "Generic (PLEG): container finished" podID="266fdd49-e9a1-4c59-9711-11d257359cf7" containerID="a31b6356088f54adb813b5ad27f21a1fffce1afa90e313ee0818278d8dae195f" exitCode=7
Jul 17 18:22:22.951645 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:22.951224    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-h85pd" event={"ID":"266fdd49-e9a1-4c59-9711-11d257359cf7","Type":"ContainerDied","Data":"a31b6356088f54adb813b5ad27f21a1fffce1afa90e313ee0818278d8dae195f"}
Jul 17 18:22:22.951645 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:22.951287    2572 scope.go:117] "RemoveContainer" containerID="ee310b9c3ed6f3fd055403d08aa8ece9500b2999684175f6b83c9a0e120d8e69"
Jul 17 18:22:22.951645 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:22.951528    2572 scope.go:117] "RemoveContainer" containerID="a31b6356088f54adb813b5ad27f21a1fffce1afa90e313ee0818278d8dae195f"
Jul 17 18:22:22.951796 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:22:22.951728    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-h85pd_odh-ai-gateway-infra(266fdd49-e9a1-4c59-9711-11d257359cf7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-h85pd" podUID="266fdd49-e9a1-4c59-9711-11d257359cf7"
Jul 17 18:22:23.958066 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:23.958029    2572 scope.go:117] "RemoveContainer" containerID="a31b6356088f54adb813b5ad27f21a1fffce1afa90e313ee0818278d8dae195f"
Jul 17 18:22:23.958532 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:22:23.958263    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-h85pd_odh-ai-gateway-infra(266fdd49-e9a1-4c59-9711-11d257359cf7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-h85pd" podUID="266fdd49-e9a1-4c59-9711-11d257359cf7"
Jul 17 18:22:23.959301 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:23.959280    2572 generic.go:356] "Generic (PLEG): container finished" podID="835af52d-f0fa-4b6b-8954-ad24c4d2ae4f" containerID="db77c9420983cfe60b4b8fd076506b8a18951eb5587f0f550d30363beedd17c4" exitCode=0
Jul 17 18:22:23.959404 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:23.959317    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg" event={"ID":"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f","Type":"ContainerDied","Data":"db77c9420983cfe60b4b8fd076506b8a18951eb5587f0f550d30363beedd17c4"}
Jul 17 18:22:23.959649 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:23.959637    2572 scope.go:117] "RemoveContainer" containerID="db77c9420983cfe60b4b8fd076506b8a18951eb5587f0f550d30363beedd17c4"
Jul 17 18:22:23.960552 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:23.960526    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:22:23.960599 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:23.960589    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:22:23.960633 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:23.960621    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:22:24.968660 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:24.968621    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg" event={"ID":"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f","Type":"ContainerStarted","Data":"3ffb13e35335e91cffa56ad37a3131b328c791b0f5fe52862d48a65adea06566"}
Jul 17 18:22:25.507363 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:25.507322    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:25.508537 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:25.508510    2572 patch_prober.go:28] interesting pod/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 17 18:22:25.508660 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:25.508562    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg" podUID="835af52d-f0fa-4b6b-8954-ad24c4d2ae4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 17 18:22:26.508056 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:26.508019    2572 patch_prober.go:28] interesting pod/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 17 18:22:26.508449 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:26.508080    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg" podUID="835af52d-f0fa-4b6b-8954-ad24c4d2ae4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 17 18:22:26.876141 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:26.876032    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:27.507728 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:27.507691    2572 patch_prober.go:28] interesting pod/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 17 18:22:27.507902 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:27.507745    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg" podUID="835af52d-f0fa-4b6b-8954-ad24c4d2ae4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 17 18:22:28.507900 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:28.507854    2572 patch_prober.go:28] interesting pod/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Jul 17 18:22:28.508328 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:28.507918    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg" podUID="835af52d-f0fa-4b6b-8954-ad24c4d2ae4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Jul 17 18:22:29.511888 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:29.511856    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:29.512880 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:29.512853    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:22:32.466457 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:32.466420    2572 scope.go:117] "RemoveContainer" containerID="79a82ede40a27d897739f98f96d7ac265bbbb76e6ac3bdce5b62091c0a984bec"
Jul 17 18:22:33.018030 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:33.017923    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" event={"ID":"d953167f-1a80-4ec0-9973-137eec7ba53b","Type":"ContainerStarted","Data":"a1faf38cf44459fcb286395eb64de407088f2e818a2e2f5650295873b3396303"}
Jul 17 18:22:33.018185 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:33.018168    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8"
Jul 17 18:22:34.024819 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:34.024780    2572 generic.go:356] "Generic (PLEG): container finished" podID="d953167f-1a80-4ec0-9973-137eec7ba53b" containerID="a1faf38cf44459fcb286395eb64de407088f2e818a2e2f5650295873b3396303" exitCode=1
Jul 17 18:22:34.025324 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:34.024871    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" event={"ID":"d953167f-1a80-4ec0-9973-137eec7ba53b","Type":"ContainerDied","Data":"a1faf38cf44459fcb286395eb64de407088f2e818a2e2f5650295873b3396303"}
Jul 17 18:22:34.025324 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:34.024923    2572 scope.go:117] "RemoveContainer" containerID="79a82ede40a27d897739f98f96d7ac265bbbb76e6ac3bdce5b62091c0a984bec"
Jul 17 18:22:34.025324 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:34.025133    2572 scope.go:117] "RemoveContainer" containerID="a1faf38cf44459fcb286395eb64de407088f2e818a2e2f5650295873b3396303"
Jul 17 18:22:34.025477 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:22:34.025381    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8_odh-ai-gateway-infra(d953167f-1a80-4ec0-9973-137eec7ba53b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b"
Jul 17 18:22:35.032211 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:35.032187    2572 scope.go:117] "RemoveContainer" containerID="a1faf38cf44459fcb286395eb64de407088f2e818a2e2f5650295873b3396303"
Jul 17 18:22:35.032589 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:22:35.032385    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8_odh-ai-gateway-infra(d953167f-1a80-4ec0-9973-137eec7ba53b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b"
Jul 17 18:22:38.466013 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:38.465974    2572 scope.go:117] "RemoveContainer" containerID="a31b6356088f54adb813b5ad27f21a1fffce1afa90e313ee0818278d8dae195f"
Jul 17 18:22:39.052655 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:39.052561    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-h85pd" event={"ID":"266fdd49-e9a1-4c59-9711-11d257359cf7","Type":"ContainerStarted","Data":"6206bc678dd755aa102f259878017035f7a5a39e5beb02efc48a816ec8d4830e"}
Jul 17 18:22:40.058663 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:40.058630    2572 generic.go:356] "Generic (PLEG): container finished" podID="266fdd49-e9a1-4c59-9711-11d257359cf7" containerID="6206bc678dd755aa102f259878017035f7a5a39e5beb02efc48a816ec8d4830e" exitCode=7
Jul 17 18:22:40.059105 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:40.058707    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-h85pd" event={"ID":"266fdd49-e9a1-4c59-9711-11d257359cf7","Type":"ContainerDied","Data":"6206bc678dd755aa102f259878017035f7a5a39e5beb02efc48a816ec8d4830e"}
Jul 17 18:22:40.059105 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:40.058773    2572 scope.go:117] "RemoveContainer" containerID="a31b6356088f54adb813b5ad27f21a1fffce1afa90e313ee0818278d8dae195f"
Jul 17 18:22:40.059105 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:40.059060    2572 scope.go:117] "RemoveContainer" containerID="6206bc678dd755aa102f259878017035f7a5a39e5beb02efc48a816ec8d4830e"
Jul 17 18:22:40.059291 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:22:40.059273    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-h85pd_odh-ai-gateway-infra(266fdd49-e9a1-4c59-9711-11d257359cf7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-h85pd" podUID="266fdd49-e9a1-4c59-9711-11d257359cf7"
Jul 17 18:22:40.083797 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:40.083758    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-h85pd"]
Jul 17 18:22:41.207691 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:41.207667    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-h85pd"
Jul 17 18:22:41.357135 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:41.357042    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/266fdd49-e9a1-4c59-9711-11d257359cf7-maas-api-service-ca\") pod \"266fdd49-e9a1-4c59-9711-11d257359cf7\" (UID: \"266fdd49-e9a1-4c59-9711-11d257359cf7\") "
Jul 17 18:22:41.357415 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:41.357390    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/266fdd49-e9a1-4c59-9711-11d257359cf7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "266fdd49-e9a1-4c59-9711-11d257359cf7" (UID: "266fdd49-e9a1-4c59-9711-11d257359cf7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:22:41.458316 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:41.458281    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/266fdd49-e9a1-4c59-9711-11d257359cf7-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:22:41.834142 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:41.834099    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8"
Jul 17 18:22:41.834540 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:41.834525    2572 scope.go:117] "RemoveContainer" containerID="a1faf38cf44459fcb286395eb64de407088f2e818a2e2f5650295873b3396303"
Jul 17 18:22:41.834718 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:22:41.834700    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8_odh-ai-gateway-infra(d953167f-1a80-4ec0-9973-137eec7ba53b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b"
Jul 17 18:22:42.071885 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:42.071856    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-h85pd"
Jul 17 18:22:42.072085 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:42.071850    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-h85pd" event={"ID":"266fdd49-e9a1-4c59-9711-11d257359cf7","Type":"ContainerDied","Data":"f46a6dc41216d4eef476c5c7c2fd36f5af34e0941b9386567c96ffa6d049b863"}
Jul 17 18:22:42.072085 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:42.071991    2572 scope.go:117] "RemoveContainer" containerID="6206bc678dd755aa102f259878017035f7a5a39e5beb02efc48a816ec8d4830e"
Jul 17 18:22:42.088402 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:42.088304    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-h85pd"]
Jul 17 18:22:42.090199 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:42.090170    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-h85pd"]
Jul 17 18:22:43.471765 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:43.471722    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="266fdd49-e9a1-4c59-9711-11d257359cf7" path="/var/lib/kubelet/pods/266fdd49-e9a1-4c59-9711-11d257359cf7/volumes"
Jul 17 18:22:56.465441 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:56.465405    2572 scope.go:117] "RemoveContainer" containerID="a1faf38cf44459fcb286395eb64de407088f2e818a2e2f5650295873b3396303"
Jul 17 18:22:57.143981 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:57.143885    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" event={"ID":"d953167f-1a80-4ec0-9973-137eec7ba53b","Type":"ContainerStarted","Data":"22ddcb29cf0247644e5bc972f7f8342d97c49395be7c74806c1f3aa6e0f29b50"}
Jul 17 18:22:57.144162 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:57.144145    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8"
Jul 17 18:22:58.150844 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:58.150810    2572 generic.go:356] "Generic (PLEG): container finished" podID="d953167f-1a80-4ec0-9973-137eec7ba53b" containerID="22ddcb29cf0247644e5bc972f7f8342d97c49395be7c74806c1f3aa6e0f29b50" exitCode=1
Jul 17 18:22:58.151356 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:58.150869    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" event={"ID":"d953167f-1a80-4ec0-9973-137eec7ba53b","Type":"ContainerDied","Data":"22ddcb29cf0247644e5bc972f7f8342d97c49395be7c74806c1f3aa6e0f29b50"}
Jul 17 18:22:58.151356 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:58.150915    2572 scope.go:117] "RemoveContainer" containerID="a1faf38cf44459fcb286395eb64de407088f2e818a2e2f5650295873b3396303"
Jul 17 18:22:58.151356 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:58.151233    2572 scope.go:117] "RemoveContainer" containerID="22ddcb29cf0247644e5bc972f7f8342d97c49395be7c74806c1f3aa6e0f29b50"
Jul 17 18:22:58.151528 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:22:58.151484    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8_odh-ai-gateway-infra(d953167f-1a80-4ec0-9973-137eec7ba53b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b"
Jul 17 18:22:59.157480 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:59.157453    2572 scope.go:117] "RemoveContainer" containerID="22ddcb29cf0247644e5bc972f7f8342d97c49395be7c74806c1f3aa6e0f29b50"
Jul 17 18:22:59.157860 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:22:59.157630    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8_odh-ai-gateway-infra(d953167f-1a80-4ec0-9973-137eec7ba53b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b"
Jul 17 18:22:59.258483 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:22:59.258418    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:23:01.833749 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:01.833705    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8"
Jul 17 18:23:01.834283 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:01.834140    2572 scope.go:117] "RemoveContainer" containerID="22ddcb29cf0247644e5bc972f7f8342d97c49395be7c74806c1f3aa6e0f29b50"
Jul 17 18:23:01.834344 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:23:01.834324    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8_odh-ai-gateway-infra(d953167f-1a80-4ec0-9973-137eec7ba53b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b"
Jul 17 18:23:16.466357 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:16.466324    2572 scope.go:117] "RemoveContainer" containerID="22ddcb29cf0247644e5bc972f7f8342d97c49395be7c74806c1f3aa6e0f29b50"
Jul 17 18:23:16.466833 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:23:16.466536    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8_odh-ai-gateway-infra(d953167f-1a80-4ec0-9973-137eec7ba53b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b"
Jul 17 18:23:16.507849 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:16.507811    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-5p8l2"]
Jul 17 18:23:16.508245 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:16.508229    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="266fdd49-e9a1-4c59-9711-11d257359cf7" containerName="revoke-keys"
Jul 17 18:23:16.508298 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:16.508246    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="266fdd49-e9a1-4c59-9711-11d257359cf7" containerName="revoke-keys"
Jul 17 18:23:16.508298 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:16.508258    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="266fdd49-e9a1-4c59-9711-11d257359cf7" containerName="revoke-keys"
Jul 17 18:23:16.508298 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:16.508264    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="266fdd49-e9a1-4c59-9711-11d257359cf7" containerName="revoke-keys"
Jul 17 18:23:16.508298 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:16.508286    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="266fdd49-e9a1-4c59-9711-11d257359cf7" containerName="revoke-keys"
Jul 17 18:23:16.508298 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:16.508292    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="266fdd49-e9a1-4c59-9711-11d257359cf7" containerName="revoke-keys"
Jul 17 18:23:16.508452 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:16.508348    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="266fdd49-e9a1-4c59-9711-11d257359cf7" containerName="revoke-keys"
Jul 17 18:23:16.508452 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:16.508357    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="266fdd49-e9a1-4c59-9711-11d257359cf7" containerName="revoke-keys"
Jul 17 18:23:16.511393 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:16.511376    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-5p8l2"
Jul 17 18:23:16.513864 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:16.513841    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:23:16.520066 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:16.520038    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-5p8l2"]
Jul 17 18:23:16.583710 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:16.583672    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a97f4ca6-9abf-4b06-9a97-022f2e80cb41-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-5p8l2\" (UID: \"a97f4ca6-9abf-4b06-9a97-022f2e80cb41\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-5p8l2"
Jul 17 18:23:16.684645 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:16.684607    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a97f4ca6-9abf-4b06-9a97-022f2e80cb41-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-5p8l2\" (UID: \"a97f4ca6-9abf-4b06-9a97-022f2e80cb41\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-5p8l2"
Jul 17 18:23:16.685385 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:16.685358    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a97f4ca6-9abf-4b06-9a97-022f2e80cb41-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-5p8l2\" (UID: \"a97f4ca6-9abf-4b06-9a97-022f2e80cb41\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-5p8l2"
Jul 17 18:23:16.823785 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:16.823694    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-5p8l2"
Jul 17 18:23:16.958445 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:16.958415    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-5p8l2"]
Jul 17 18:23:16.960466 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:23:16.960439    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda97f4ca6_9abf_4b06_9a97_022f2e80cb41.slice/crio-9e0791eb817275894cfcb1fb845ed2fbd54741fd6ec2c84000f083f84976269d WatchSource:0}: Error finding container 9e0791eb817275894cfcb1fb845ed2fbd54741fd6ec2c84000f083f84976269d: Status 404 returned error can't find the container with id 9e0791eb817275894cfcb1fb845ed2fbd54741fd6ec2c84000f083f84976269d
Jul 17 18:23:17.247243 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:17.247209    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-5p8l2" event={"ID":"a97f4ca6-9abf-4b06-9a97-022f2e80cb41","Type":"ContainerStarted","Data":"e9b48ff10ec4119a24221d3721544096cd32228d4ba7b3f5a36e18345f264af6"}
Jul 17 18:23:17.247413 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:17.247263    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-5p8l2" event={"ID":"a97f4ca6-9abf-4b06-9a97-022f2e80cb41","Type":"ContainerStarted","Data":"9e0791eb817275894cfcb1fb845ed2fbd54741fd6ec2c84000f083f84976269d"}
Jul 17 18:23:17.264379 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:17.264326    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-5p8l2" podStartSLOduration=1.264310901 podStartE2EDuration="1.264310901s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:23:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:23:17.263173446 +0000 UTC m=+1624.488402756" watchObservedRunningTime="2026-07-17 18:23:17.264310901 +0000 UTC m=+1624.489540209"
Jul 17 18:23:18.253585 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:18.253547    2572 generic.go:356] "Generic (PLEG): container finished" podID="a97f4ca6-9abf-4b06-9a97-022f2e80cb41" containerID="e9b48ff10ec4119a24221d3721544096cd32228d4ba7b3f5a36e18345f264af6" exitCode=7
Jul 17 18:23:18.253968 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:18.253624    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-5p8l2" event={"ID":"a97f4ca6-9abf-4b06-9a97-022f2e80cb41","Type":"ContainerDied","Data":"e9b48ff10ec4119a24221d3721544096cd32228d4ba7b3f5a36e18345f264af6"}
Jul 17 18:23:18.253968 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:18.253793    2572 scope.go:117] "RemoveContainer" containerID="e9b48ff10ec4119a24221d3721544096cd32228d4ba7b3f5a36e18345f264af6"
Jul 17 18:23:19.260250 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:19.260212    2572 generic.go:356] "Generic (PLEG): container finished" podID="a97f4ca6-9abf-4b06-9a97-022f2e80cb41" containerID="89a2a88f2857a9a0d6bc85e1ba65fb5966928ea7bdf251a60d24c41278cefd68" exitCode=7
Jul 17 18:23:19.260763 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:19.260291    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-5p8l2" event={"ID":"a97f4ca6-9abf-4b06-9a97-022f2e80cb41","Type":"ContainerDied","Data":"89a2a88f2857a9a0d6bc85e1ba65fb5966928ea7bdf251a60d24c41278cefd68"}
Jul 17 18:23:19.260763 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:19.260380    2572 scope.go:117] "RemoveContainer" containerID="e9b48ff10ec4119a24221d3721544096cd32228d4ba7b3f5a36e18345f264af6"
Jul 17 18:23:19.260763 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:19.260615    2572 scope.go:117] "RemoveContainer" containerID="89a2a88f2857a9a0d6bc85e1ba65fb5966928ea7bdf251a60d24c41278cefd68"
Jul 17 18:23:19.260895 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:23:19.260853    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-5p8l2_odh-ai-gateway-infra(a97f4ca6-9abf-4b06-9a97-022f2e80cb41)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-5p8l2" podUID="a97f4ca6-9abf-4b06-9a97-022f2e80cb41"
Jul 17 18:23:20.266538 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:20.266509    2572 scope.go:117] "RemoveContainer" containerID="89a2a88f2857a9a0d6bc85e1ba65fb5966928ea7bdf251a60d24c41278cefd68"
Jul 17 18:23:20.266921 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:23:20.266713    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-5p8l2_odh-ai-gateway-infra(a97f4ca6-9abf-4b06-9a97-022f2e80cb41)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-5p8l2" podUID="a97f4ca6-9abf-4b06-9a97-022f2e80cb41"
Jul 17 18:23:22.102276 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:22.102222    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:23:29.466679 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:29.466640    2572 scope.go:117] "RemoveContainer" containerID="22ddcb29cf0247644e5bc972f7f8342d97c49395be7c74806c1f3aa6e0f29b50"
Jul 17 18:23:29.467090 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:23:29.466811    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8_odh-ai-gateway-infra(d953167f-1a80-4ec0-9973-137eec7ba53b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b"
Jul 17 18:23:32.465419 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:32.465388    2572 scope.go:117] "RemoveContainer" containerID="89a2a88f2857a9a0d6bc85e1ba65fb5966928ea7bdf251a60d24c41278cefd68"
Jul 17 18:23:33.330776 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:33.330685    2572 generic.go:356] "Generic (PLEG): container finished" podID="a97f4ca6-9abf-4b06-9a97-022f2e80cb41" containerID="65c99f1807d617c029981e60e63d40a8fca645c404d8765c82bb2b45fe98814b" exitCode=7
Jul 17 18:23:33.330776 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:33.330757    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-5p8l2" event={"ID":"a97f4ca6-9abf-4b06-9a97-022f2e80cb41","Type":"ContainerDied","Data":"65c99f1807d617c029981e60e63d40a8fca645c404d8765c82bb2b45fe98814b"}
Jul 17 18:23:33.330982 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:33.330821    2572 scope.go:117] "RemoveContainer" containerID="89a2a88f2857a9a0d6bc85e1ba65fb5966928ea7bdf251a60d24c41278cefd68"
Jul 17 18:23:33.331130 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:33.331111    2572 scope.go:117] "RemoveContainer" containerID="65c99f1807d617c029981e60e63d40a8fca645c404d8765c82bb2b45fe98814b"
Jul 17 18:23:33.331358 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:23:33.331340    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-5p8l2_odh-ai-gateway-infra(a97f4ca6-9abf-4b06-9a97-022f2e80cb41)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-5p8l2" podUID="a97f4ca6-9abf-4b06-9a97-022f2e80cb41"
Jul 17 18:23:34.360473 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:34.360436    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-5p8l2"]
Jul 17 18:23:34.500467 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:34.500443    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-5p8l2"
Jul 17 18:23:34.649507 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:34.649406    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a97f4ca6-9abf-4b06-9a97-022f2e80cb41-maas-api-service-ca\") pod \"a97f4ca6-9abf-4b06-9a97-022f2e80cb41\" (UID: \"a97f4ca6-9abf-4b06-9a97-022f2e80cb41\") "
Jul 17 18:23:34.649829 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:34.649803    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a97f4ca6-9abf-4b06-9a97-022f2e80cb41-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a97f4ca6-9abf-4b06-9a97-022f2e80cb41" (UID: "a97f4ca6-9abf-4b06-9a97-022f2e80cb41"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:23:34.751014 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:34.750973    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a97f4ca6-9abf-4b06-9a97-022f2e80cb41-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:23:35.343928 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:35.343893    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-5p8l2" event={"ID":"a97f4ca6-9abf-4b06-9a97-022f2e80cb41","Type":"ContainerDied","Data":"9e0791eb817275894cfcb1fb845ed2fbd54741fd6ec2c84000f083f84976269d"}
Jul 17 18:23:35.344124 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:35.343952    2572 scope.go:117] "RemoveContainer" containerID="65c99f1807d617c029981e60e63d40a8fca645c404d8765c82bb2b45fe98814b"
Jul 17 18:23:35.344124 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:35.343903    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-5p8l2"
Jul 17 18:23:35.365914 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:35.365883    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-5p8l2"]
Jul 17 18:23:35.370227 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:35.370197    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-5p8l2"]
Jul 17 18:23:35.471664 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:35.471618    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a97f4ca6-9abf-4b06-9a97-022f2e80cb41" path="/var/lib/kubelet/pods/a97f4ca6-9abf-4b06-9a97-022f2e80cb41/volumes"
Jul 17 18:23:44.466469 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:44.466435    2572 scope.go:117] "RemoveContainer" containerID="22ddcb29cf0247644e5bc972f7f8342d97c49395be7c74806c1f3aa6e0f29b50"
Jul 17 18:23:45.399621 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:45.399587    2572 generic.go:356] "Generic (PLEG): container finished" podID="d953167f-1a80-4ec0-9973-137eec7ba53b" containerID="109f92f800637a74b92049cd9040773479f5abaf5cc239e0189ae6ee29463293" exitCode=1
Jul 17 18:23:45.399801 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:45.399668    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" event={"ID":"d953167f-1a80-4ec0-9973-137eec7ba53b","Type":"ContainerDied","Data":"109f92f800637a74b92049cd9040773479f5abaf5cc239e0189ae6ee29463293"}
Jul 17 18:23:45.399801 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:45.399737    2572 scope.go:117] "RemoveContainer" containerID="22ddcb29cf0247644e5bc972f7f8342d97c49395be7c74806c1f3aa6e0f29b50"
Jul 17 18:23:45.400111 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:45.400080    2572 scope.go:117] "RemoveContainer" containerID="109f92f800637a74b92049cd9040773479f5abaf5cc239e0189ae6ee29463293"
Jul 17 18:23:45.400345 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:23:45.400316    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8_odh-ai-gateway-infra(d953167f-1a80-4ec0-9973-137eec7ba53b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b"
Jul 17 18:23:47.144816 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:47.144778    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8"
Jul 17 18:23:47.145330 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:47.145243    2572 scope.go:117] "RemoveContainer" containerID="109f92f800637a74b92049cd9040773479f5abaf5cc239e0189ae6ee29463293"
Jul 17 18:23:47.145475 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:23:47.145455    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8_odh-ai-gateway-infra(d953167f-1a80-4ec0-9973-137eec7ba53b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b"
Jul 17 18:23:51.834532 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:51.834482    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8"
Jul 17 18:23:51.835052 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:23:51.834894    2572 scope.go:117] "RemoveContainer" containerID="109f92f800637a74b92049cd9040773479f5abaf5cc239e0189ae6ee29463293"
Jul 17 18:23:51.835147 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:23:51.835124    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8_odh-ai-gateway-infra(d953167f-1a80-4ec0-9973-137eec7ba53b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b"
Jul 17 18:24:04.465907 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:04.465865    2572 scope.go:117] "RemoveContainer" containerID="109f92f800637a74b92049cd9040773479f5abaf5cc239e0189ae6ee29463293"
Jul 17 18:24:04.466434 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:24:04.466168    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8_odh-ai-gateway-infra(d953167f-1a80-4ec0-9973-137eec7ba53b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b"
Jul 17 18:24:06.553018 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:06.552969    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pff7f"]
Jul 17 18:24:06.553507 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:06.553354    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a97f4ca6-9abf-4b06-9a97-022f2e80cb41" containerName="revoke-keys"
Jul 17 18:24:06.553507 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:06.553365    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a97f4ca6-9abf-4b06-9a97-022f2e80cb41" containerName="revoke-keys"
Jul 17 18:24:06.553507 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:06.553390    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a97f4ca6-9abf-4b06-9a97-022f2e80cb41" containerName="revoke-keys"
Jul 17 18:24:06.553507 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:06.553396    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a97f4ca6-9abf-4b06-9a97-022f2e80cb41" containerName="revoke-keys"
Jul 17 18:24:06.553507 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:06.553450    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a97f4ca6-9abf-4b06-9a97-022f2e80cb41" containerName="revoke-keys"
Jul 17 18:24:06.553507 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:06.553458    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a97f4ca6-9abf-4b06-9a97-022f2e80cb41" containerName="revoke-keys"
Jul 17 18:24:06.553507 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:06.553468    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="266fdd49-e9a1-4c59-9711-11d257359cf7" containerName="revoke-keys"
Jul 17 18:24:06.558016 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:06.557981    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pff7f"
Jul 17 18:24:06.560619 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:06.560556    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:24:06.563883 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:06.563858    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pff7f"]
Jul 17 18:24:06.631733 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:06.631697    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/95e513e4-a679-45fe-8d59-2ccdc0cfb2c6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-pff7f\" (UID: \"95e513e4-a679-45fe-8d59-2ccdc0cfb2c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pff7f"
Jul 17 18:24:06.732881 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:06.732828    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/95e513e4-a679-45fe-8d59-2ccdc0cfb2c6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-pff7f\" (UID: \"95e513e4-a679-45fe-8d59-2ccdc0cfb2c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pff7f"
Jul 17 18:24:06.733536 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:06.733509    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/95e513e4-a679-45fe-8d59-2ccdc0cfb2c6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-pff7f\" (UID: \"95e513e4-a679-45fe-8d59-2ccdc0cfb2c6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pff7f"
Jul 17 18:24:06.871539 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:06.871441    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pff7f"
Jul 17 18:24:07.011049 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:07.011020    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pff7f"]
Jul 17 18:24:07.013330 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:24:07.013303    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95e513e4_a679_45fe_8d59_2ccdc0cfb2c6.slice/crio-1779f095192bf65a55173e62fefd54d4992d4183ddad3c79d6081132e4857bd4 WatchSource:0}: Error finding container 1779f095192bf65a55173e62fefd54d4992d4183ddad3c79d6081132e4857bd4: Status 404 returned error can't find the container with id 1779f095192bf65a55173e62fefd54d4992d4183ddad3c79d6081132e4857bd4
Jul 17 18:24:07.526422 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:07.526382    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pff7f" event={"ID":"95e513e4-a679-45fe-8d59-2ccdc0cfb2c6","Type":"ContainerStarted","Data":"f12b26fb309dac4a7ec8762fbde38c64f0bcae791e2b4af1d8425088b25d5e24"}
Jul 17 18:24:07.526606 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:07.526482    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pff7f" event={"ID":"95e513e4-a679-45fe-8d59-2ccdc0cfb2c6","Type":"ContainerStarted","Data":"1779f095192bf65a55173e62fefd54d4992d4183ddad3c79d6081132e4857bd4"}
Jul 17 18:24:07.542716 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:07.542657    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pff7f" podStartSLOduration=1.5426406780000002 podStartE2EDuration="1.542640678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:24:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:24:07.541145109 +0000 UTC m=+1674.766374420" watchObservedRunningTime="2026-07-17 18:24:07.542640678 +0000 UTC m=+1674.767869986"
Jul 17 18:24:08.532919 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:08.532882    2572 generic.go:356] "Generic (PLEG): container finished" podID="95e513e4-a679-45fe-8d59-2ccdc0cfb2c6" containerID="f12b26fb309dac4a7ec8762fbde38c64f0bcae791e2b4af1d8425088b25d5e24" exitCode=7
Jul 17 18:24:08.533328 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:08.532949    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pff7f" event={"ID":"95e513e4-a679-45fe-8d59-2ccdc0cfb2c6","Type":"ContainerDied","Data":"f12b26fb309dac4a7ec8762fbde38c64f0bcae791e2b4af1d8425088b25d5e24"}
Jul 17 18:24:08.533328 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:08.533159    2572 scope.go:117] "RemoveContainer" containerID="f12b26fb309dac4a7ec8762fbde38c64f0bcae791e2b4af1d8425088b25d5e24"
Jul 17 18:24:09.539522 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:09.539483    2572 generic.go:356] "Generic (PLEG): container finished" podID="95e513e4-a679-45fe-8d59-2ccdc0cfb2c6" containerID="11622231c3cd9540d84e0a0aba4a09a9739bacb7b669bdfd89ed767a20b55f83" exitCode=7
Jul 17 18:24:09.539990 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:09.539557    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pff7f" event={"ID":"95e513e4-a679-45fe-8d59-2ccdc0cfb2c6","Type":"ContainerDied","Data":"11622231c3cd9540d84e0a0aba4a09a9739bacb7b669bdfd89ed767a20b55f83"}
Jul 17 18:24:09.539990 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:09.539614    2572 scope.go:117] "RemoveContainer" containerID="f12b26fb309dac4a7ec8762fbde38c64f0bcae791e2b4af1d8425088b25d5e24"
Jul 17 18:24:09.539990 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:09.539881    2572 scope.go:117] "RemoveContainer" containerID="11622231c3cd9540d84e0a0aba4a09a9739bacb7b669bdfd89ed767a20b55f83"
Jul 17 18:24:09.540156 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:24:09.540132    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-pff7f_odh-ai-gateway-infra(95e513e4-a679-45fe-8d59-2ccdc0cfb2c6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pff7f" podUID="95e513e4-a679-45fe-8d59-2ccdc0cfb2c6"
Jul 17 18:24:10.546120 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:10.546093    2572 scope.go:117] "RemoveContainer" containerID="11622231c3cd9540d84e0a0aba4a09a9739bacb7b669bdfd89ed767a20b55f83"
Jul 17 18:24:10.546520 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:24:10.546288    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-pff7f_odh-ai-gateway-infra(95e513e4-a679-45fe-8d59-2ccdc0cfb2c6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pff7f" podUID="95e513e4-a679-45fe-8d59-2ccdc0cfb2c6"
Jul 17 18:24:19.466057 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:19.466024    2572 scope.go:117] "RemoveContainer" containerID="109f92f800637a74b92049cd9040773479f5abaf5cc239e0189ae6ee29463293"
Jul 17 18:24:19.466501 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:24:19.466194    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8_odh-ai-gateway-infra(d953167f-1a80-4ec0-9973-137eec7ba53b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b"
Jul 17 18:24:24.465676 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:24.465644    2572 scope.go:117] "RemoveContainer" containerID="11622231c3cd9540d84e0a0aba4a09a9739bacb7b669bdfd89ed767a20b55f83"
Jul 17 18:24:25.622588 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:25.622547    2572 generic.go:356] "Generic (PLEG): container finished" podID="95e513e4-a679-45fe-8d59-2ccdc0cfb2c6" containerID="260010d078b869a9c8ce3f4440b62882cb757237713528a7033fe382456fdae7" exitCode=7
Jul 17 18:24:25.623071 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:25.622624    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pff7f" event={"ID":"95e513e4-a679-45fe-8d59-2ccdc0cfb2c6","Type":"ContainerDied","Data":"260010d078b869a9c8ce3f4440b62882cb757237713528a7033fe382456fdae7"}
Jul 17 18:24:25.623071 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:25.622699    2572 scope.go:117] "RemoveContainer" containerID="11622231c3cd9540d84e0a0aba4a09a9739bacb7b669bdfd89ed767a20b55f83"
Jul 17 18:24:25.623071 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:25.623022    2572 scope.go:117] "RemoveContainer" containerID="260010d078b869a9c8ce3f4440b62882cb757237713528a7033fe382456fdae7"
Jul 17 18:24:25.623353 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:24:25.623332    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-pff7f_odh-ai-gateway-infra(95e513e4-a679-45fe-8d59-2ccdc0cfb2c6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pff7f" podUID="95e513e4-a679-45fe-8d59-2ccdc0cfb2c6"
Jul 17 18:24:26.649694 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:26.649658    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pff7f"]
Jul 17 18:24:26.790577 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:26.790551    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pff7f"
Jul 17 18:24:26.913879 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:26.913785    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/95e513e4-a679-45fe-8d59-2ccdc0cfb2c6-maas-api-service-ca\") pod \"95e513e4-a679-45fe-8d59-2ccdc0cfb2c6\" (UID: \"95e513e4-a679-45fe-8d59-2ccdc0cfb2c6\") "
Jul 17 18:24:26.914260 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:26.914215    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95e513e4-a679-45fe-8d59-2ccdc0cfb2c6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "95e513e4-a679-45fe-8d59-2ccdc0cfb2c6" (UID: "95e513e4-a679-45fe-8d59-2ccdc0cfb2c6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:24:27.015577 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:27.015530    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/95e513e4-a679-45fe-8d59-2ccdc0cfb2c6-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:24:27.635113 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:27.635074    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pff7f"
Jul 17 18:24:27.635299 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:27.635084    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pff7f" event={"ID":"95e513e4-a679-45fe-8d59-2ccdc0cfb2c6","Type":"ContainerDied","Data":"1779f095192bf65a55173e62fefd54d4992d4183ddad3c79d6081132e4857bd4"}
Jul 17 18:24:27.635299 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:27.635215    2572 scope.go:117] "RemoveContainer" containerID="260010d078b869a9c8ce3f4440b62882cb757237713528a7033fe382456fdae7"
Jul 17 18:24:27.651338 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:27.651308    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pff7f"]
Jul 17 18:24:27.655100 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:27.655064    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pff7f"]
Jul 17 18:24:29.472680 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:29.472647    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95e513e4-a679-45fe-8d59-2ccdc0cfb2c6" path="/var/lib/kubelet/pods/95e513e4-a679-45fe-8d59-2ccdc0cfb2c6/volumes"
Jul 17 18:24:30.465978 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:30.465949    2572 scope.go:117] "RemoveContainer" containerID="109f92f800637a74b92049cd9040773479f5abaf5cc239e0189ae6ee29463293"
Jul 17 18:24:30.466251 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:24:30.466226    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8_odh-ai-gateway-infra(d953167f-1a80-4ec0-9973-137eec7ba53b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b"
Jul 17 18:24:45.466153 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:45.466056    2572 scope.go:117] "RemoveContainer" containerID="109f92f800637a74b92049cd9040773479f5abaf5cc239e0189ae6ee29463293"
Jul 17 18:24:45.466718 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:24:45.466347    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8_odh-ai-gateway-infra(d953167f-1a80-4ec0-9973-137eec7ba53b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b"
Jul 17 18:24:57.465854 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:24:57.465818    2572 scope.go:117] "RemoveContainer" containerID="109f92f800637a74b92049cd9040773479f5abaf5cc239e0189ae6ee29463293"
Jul 17 18:24:57.466404 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:24:57.466059    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8_odh-ai-gateway-infra(d953167f-1a80-4ec0-9973-137eec7ba53b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b"
Jul 17 18:25:06.593757 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:06.593721    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-z5jhh"]
Jul 17 18:25:06.594220 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:06.594164    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a97f4ca6-9abf-4b06-9a97-022f2e80cb41" containerName="revoke-keys"
Jul 17 18:25:06.594220 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:06.594176    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a97f4ca6-9abf-4b06-9a97-022f2e80cb41" containerName="revoke-keys"
Jul 17 18:25:06.594220 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:06.594185    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95e513e4-a679-45fe-8d59-2ccdc0cfb2c6" containerName="revoke-keys"
Jul 17 18:25:06.594220 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:06.594190    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="95e513e4-a679-45fe-8d59-2ccdc0cfb2c6" containerName="revoke-keys"
Jul 17 18:25:06.594220 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:06.594201    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95e513e4-a679-45fe-8d59-2ccdc0cfb2c6" containerName="revoke-keys"
Jul 17 18:25:06.594220 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:06.594207    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="95e513e4-a679-45fe-8d59-2ccdc0cfb2c6" containerName="revoke-keys"
Jul 17 18:25:06.594220 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:06.594214    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95e513e4-a679-45fe-8d59-2ccdc0cfb2c6" containerName="revoke-keys"
Jul 17 18:25:06.594220 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:06.594221    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="95e513e4-a679-45fe-8d59-2ccdc0cfb2c6" containerName="revoke-keys"
Jul 17 18:25:06.594507 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:06.594288    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="95e513e4-a679-45fe-8d59-2ccdc0cfb2c6" containerName="revoke-keys"
Jul 17 18:25:06.594507 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:06.594296    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="95e513e4-a679-45fe-8d59-2ccdc0cfb2c6" containerName="revoke-keys"
Jul 17 18:25:06.594507 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:06.594304    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="95e513e4-a679-45fe-8d59-2ccdc0cfb2c6" containerName="revoke-keys"
Jul 17 18:25:06.594507 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:06.594311    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a97f4ca6-9abf-4b06-9a97-022f2e80cb41" containerName="revoke-keys"
Jul 17 18:25:06.597428 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:06.597408    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-z5jhh"
Jul 17 18:25:06.600064 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:06.600041    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:25:06.605638 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:06.605440    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-z5jhh"]
Jul 17 18:25:06.686202 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:06.686160    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1b76f42-eb23-43c4-a432-4e3f43a86829-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-z5jhh\" (UID: \"a1b76f42-eb23-43c4-a432-4e3f43a86829\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-z5jhh"
Jul 17 18:25:06.787681 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:06.787642    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1b76f42-eb23-43c4-a432-4e3f43a86829-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-z5jhh\" (UID: \"a1b76f42-eb23-43c4-a432-4e3f43a86829\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-z5jhh"
Jul 17 18:25:06.788330 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:06.788309    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1b76f42-eb23-43c4-a432-4e3f43a86829-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-z5jhh\" (UID: \"a1b76f42-eb23-43c4-a432-4e3f43a86829\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-z5jhh"
Jul 17 18:25:06.911187 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:06.911102    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-z5jhh"
Jul 17 18:25:07.050835 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:07.050777    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-z5jhh"]
Jul 17 18:25:07.053193 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:25:07.053164    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1b76f42_eb23_43c4_a432_4e3f43a86829.slice/crio-9b1f1b7386377b423ead49adc5329e06ff38ebd8a6cc8b38170fa85ca242e151 WatchSource:0}: Error finding container 9b1f1b7386377b423ead49adc5329e06ff38ebd8a6cc8b38170fa85ca242e151: Status 404 returned error can't find the container with id 9b1f1b7386377b423ead49adc5329e06ff38ebd8a6cc8b38170fa85ca242e151
Jul 17 18:25:07.834777 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:07.834747    2572 generic.go:356] "Generic (PLEG): container finished" podID="a1b76f42-eb23-43c4-a432-4e3f43a86829" containerID="06a0a83d11c3c893226f5420962923824007da51998ff17fb2b65cfcbba7b629" exitCode=7
Jul 17 18:25:07.835181 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:07.834804    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-z5jhh" event={"ID":"a1b76f42-eb23-43c4-a432-4e3f43a86829","Type":"ContainerDied","Data":"06a0a83d11c3c893226f5420962923824007da51998ff17fb2b65cfcbba7b629"}
Jul 17 18:25:07.835181 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:07.834846    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-z5jhh" event={"ID":"a1b76f42-eb23-43c4-a432-4e3f43a86829","Type":"ContainerStarted","Data":"9b1f1b7386377b423ead49adc5329e06ff38ebd8a6cc8b38170fa85ca242e151"}
Jul 17 18:25:07.835181 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:07.835053    2572 scope.go:117] "RemoveContainer" containerID="06a0a83d11c3c893226f5420962923824007da51998ff17fb2b65cfcbba7b629"
Jul 17 18:25:08.840981 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:08.840885    2572 generic.go:356] "Generic (PLEG): container finished" podID="a1b76f42-eb23-43c4-a432-4e3f43a86829" containerID="440548c4e8d648d6041f74bb9bcce82e33ad7e0e4da4c6796fc07b032f0dceb3" exitCode=7
Jul 17 18:25:08.840981 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:08.840964    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-z5jhh" event={"ID":"a1b76f42-eb23-43c4-a432-4e3f43a86829","Type":"ContainerDied","Data":"440548c4e8d648d6041f74bb9bcce82e33ad7e0e4da4c6796fc07b032f0dceb3"}
Jul 17 18:25:08.841565 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:08.841033    2572 scope.go:117] "RemoveContainer" containerID="06a0a83d11c3c893226f5420962923824007da51998ff17fb2b65cfcbba7b629"
Jul 17 18:25:08.841565 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:08.841295    2572 scope.go:117] "RemoveContainer" containerID="440548c4e8d648d6041f74bb9bcce82e33ad7e0e4da4c6796fc07b032f0dceb3"
Jul 17 18:25:08.841678 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:25:08.841561    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-z5jhh_odh-ai-gateway-infra(a1b76f42-eb23-43c4-a432-4e3f43a86829)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-z5jhh" podUID="a1b76f42-eb23-43c4-a432-4e3f43a86829"
Jul 17 18:25:09.847831 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:09.847802    2572 scope.go:117] "RemoveContainer" containerID="440548c4e8d648d6041f74bb9bcce82e33ad7e0e4da4c6796fc07b032f0dceb3"
Jul 17 18:25:09.848261 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:25:09.848023    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-z5jhh_odh-ai-gateway-infra(a1b76f42-eb23-43c4-a432-4e3f43a86829)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-z5jhh" podUID="a1b76f42-eb23-43c4-a432-4e3f43a86829"
Jul 17 18:25:11.471610 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:11.471581    2572 scope.go:117] "RemoveContainer" containerID="109f92f800637a74b92049cd9040773479f5abaf5cc239e0189ae6ee29463293"
Jul 17 18:25:12.865355 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:12.865325    2572 generic.go:356] "Generic (PLEG): container finished" podID="d953167f-1a80-4ec0-9973-137eec7ba53b" containerID="d4941a96fcc89eaa2718b81d4dd259b06cac2c0c5549d586f80dd7497b2d09c4" exitCode=1
Jul 17 18:25:12.865782 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:12.865402    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" event={"ID":"d953167f-1a80-4ec0-9973-137eec7ba53b","Type":"ContainerDied","Data":"d4941a96fcc89eaa2718b81d4dd259b06cac2c0c5549d586f80dd7497b2d09c4"}
Jul 17 18:25:12.865782 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:12.865461    2572 scope.go:117] "RemoveContainer" containerID="109f92f800637a74b92049cd9040773479f5abaf5cc239e0189ae6ee29463293"
Jul 17 18:25:12.865872 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:12.865837    2572 scope.go:117] "RemoveContainer" containerID="d4941a96fcc89eaa2718b81d4dd259b06cac2c0c5549d586f80dd7497b2d09c4"
Jul 17 18:25:12.866085 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:25:12.866066    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8_odh-ai-gateway-infra(d953167f-1a80-4ec0-9973-137eec7ba53b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b"
Jul 17 18:25:16.072819 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:16.072780    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:25:16.570274 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:16.570236    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"]
Jul 17 18:25:16.570510 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:16.570487    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg" podUID="835af52d-f0fa-4b6b-8954-ad24c4d2ae4f" containerName="istio-proxy" containerID="cri-o://3ffb13e35335e91cffa56ad37a3131b328c791b0f5fe52862d48a65adea06566" gracePeriod=30
Jul 17 18:25:17.145126 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:17.145084    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8"
Jul 17 18:25:17.145574 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:17.145494    2572 scope.go:117] "RemoveContainer" containerID="d4941a96fcc89eaa2718b81d4dd259b06cac2c0c5549d586f80dd7497b2d09c4"
Jul 17 18:25:17.145716 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:25:17.145694    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8_odh-ai-gateway-infra(d953167f-1a80-4ec0-9973-137eec7ba53b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b"
Jul 17 18:25:17.373380 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:17.373339    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:25:20.466050 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:20.465987    2572 scope.go:117] "RemoveContainer" containerID="440548c4e8d648d6041f74bb9bcce82e33ad7e0e4da4c6796fc07b032f0dceb3"
Jul 17 18:25:20.912621 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:20.912587    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-z5jhh" event={"ID":"a1b76f42-eb23-43c4-a432-4e3f43a86829","Type":"ContainerStarted","Data":"bd18d0fd5b6f472fc28eb04ef42f23ba90c0bc4929535a2f57e68eb9cdbcc6a7"}
Jul 17 18:25:20.928835 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:20.928783    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-z5jhh" podStartSLOduration=14.928767053 podStartE2EDuration="14.928767053s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:25:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:25:20.926846425 +0000 UTC m=+1748.152075733" watchObservedRunningTime="2026-07-17 18:25:20.928767053 +0000 UTC m=+1748.153996361"
Jul 17 18:25:21.821864 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:21.821834    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:25:21.834369 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:21.834284    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8"
Jul 17 18:25:21.834685 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:21.834668    2572 scope.go:117] "RemoveContainer" containerID="d4941a96fcc89eaa2718b81d4dd259b06cac2c0c5549d586f80dd7497b2d09c4"
Jul 17 18:25:21.834882 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:25:21.834859    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8_odh-ai-gateway-infra(d953167f-1a80-4ec0-9973-137eec7ba53b)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b"
Jul 17 18:25:21.920760 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:21.920729    2572 generic.go:356] "Generic (PLEG): container finished" podID="835af52d-f0fa-4b6b-8954-ad24c4d2ae4f" containerID="3ffb13e35335e91cffa56ad37a3131b328c791b0f5fe52862d48a65adea06566" exitCode=0
Jul 17 18:25:21.920947 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:21.920781    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"
Jul 17 18:25:21.920947 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:21.920811    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg" event={"ID":"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f","Type":"ContainerDied","Data":"3ffb13e35335e91cffa56ad37a3131b328c791b0f5fe52862d48a65adea06566"}
Jul 17 18:25:21.920947 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:21.920877    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg" event={"ID":"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f","Type":"ContainerDied","Data":"a1d402df47d373d2b4189f25c7825bd5aedeffed64c49d95d7a5216b7cf9dedc"}
Jul 17 18:25:21.920947 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:21.920908    2572 scope.go:117] "RemoveContainer" containerID="3ffb13e35335e91cffa56ad37a3131b328c791b0f5fe52862d48a65adea06566"
Jul 17 18:25:21.922802 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:21.922780    2572 generic.go:356] "Generic (PLEG): container finished" podID="a1b76f42-eb23-43c4-a432-4e3f43a86829" containerID="bd18d0fd5b6f472fc28eb04ef42f23ba90c0bc4929535a2f57e68eb9cdbcc6a7" exitCode=7
Jul 17 18:25:21.922928 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:21.922833    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-z5jhh" event={"ID":"a1b76f42-eb23-43c4-a432-4e3f43a86829","Type":"ContainerDied","Data":"bd18d0fd5b6f472fc28eb04ef42f23ba90c0bc4929535a2f57e68eb9cdbcc6a7"}
Jul 17 18:25:21.923139 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:21.923122    2572 scope.go:117] "RemoveContainer" containerID="bd18d0fd5b6f472fc28eb04ef42f23ba90c0bc4929535a2f57e68eb9cdbcc6a7"
Jul 17 18:25:21.923336 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:25:21.923314    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-z5jhh_odh-ai-gateway-infra(a1b76f42-eb23-43c4-a432-4e3f43a86829)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-z5jhh" podUID="a1b76f42-eb23-43c4-a432-4e3f43a86829"
Jul 17 18:25:21.930235 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:21.930210    2572 scope.go:117] "RemoveContainer" containerID="db77c9420983cfe60b4b8fd076506b8a18951eb5587f0f550d30363beedd17c4"
Jul 17 18:25:21.937549 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:21.937524    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-z5jhh"]
Jul 17 18:25:21.938653 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:21.938632    2572 scope.go:117] "RemoveContainer" containerID="3ffb13e35335e91cffa56ad37a3131b328c791b0f5fe52862d48a65adea06566"
Jul 17 18:25:21.938986 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:25:21.938964    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ffb13e35335e91cffa56ad37a3131b328c791b0f5fe52862d48a65adea06566\": container with ID starting with 3ffb13e35335e91cffa56ad37a3131b328c791b0f5fe52862d48a65adea06566 not found: ID does not exist" containerID="3ffb13e35335e91cffa56ad37a3131b328c791b0f5fe52862d48a65adea06566"
Jul 17 18:25:21.939066 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:21.939007    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ffb13e35335e91cffa56ad37a3131b328c791b0f5fe52862d48a65adea06566"} err="failed to get container status \"3ffb13e35335e91cffa56ad37a3131b328c791b0f5fe52862d48a65adea06566\": rpc error: code = NotFound desc = could not find container \"3ffb13e35335e91cffa56ad37a3131b328c791b0f5fe52862d48a65adea06566\": container with ID starting with 3ffb13e35335e91cffa56ad37a3131b328c791b0f5fe52862d48a65adea06566 not found: ID does not exist"
Jul 17 18:25:21.939066 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:21.939028    2572 scope.go:117] "RemoveContainer" containerID="db77c9420983cfe60b4b8fd076506b8a18951eb5587f0f550d30363beedd17c4"
Jul 17 18:25:21.939265 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:25:21.939250    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db77c9420983cfe60b4b8fd076506b8a18951eb5587f0f550d30363beedd17c4\": container with ID starting with db77c9420983cfe60b4b8fd076506b8a18951eb5587f0f550d30363beedd17c4 not found: ID does not exist" containerID="db77c9420983cfe60b4b8fd076506b8a18951eb5587f0f550d30363beedd17c4"
Jul 17 18:25:21.939311 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:21.939269    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db77c9420983cfe60b4b8fd076506b8a18951eb5587f0f550d30363beedd17c4"} err="failed to get container status \"db77c9420983cfe60b4b8fd076506b8a18951eb5587f0f550d30363beedd17c4\": rpc error: code = NotFound desc = could not find container \"db77c9420983cfe60b4b8fd076506b8a18951eb5587f0f550d30363beedd17c4\": container with ID starting with db77c9420983cfe60b4b8fd076506b8a18951eb5587f0f550d30363beedd17c4 not found: ID does not exist"
Jul 17 18:25:21.939311 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:21.939285    2572 scope.go:117] "RemoveContainer" containerID="440548c4e8d648d6041f74bb9bcce82e33ad7e0e4da4c6796fc07b032f0dceb3"
Jul 17 18:25:22.017266 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.017229    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-istio-envoy\") pod \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") "
Jul 17 18:25:22.017458 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.017404    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hfg25\" (UniqueName: \"kubernetes.io/projected/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-kube-api-access-hfg25\") pod \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") "
Jul 17 18:25:22.017458 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.017448    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-istio-data\") pod \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") "
Jul 17 18:25:22.017584 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.017475    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-istiod-ca-cert\") pod \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") "
Jul 17 18:25:22.017584 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.017503    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-workload-socket\") pod \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") "
Jul 17 18:25:22.017584 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.017527    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-credential-socket\") pod \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") "
Jul 17 18:25:22.017584 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.017559    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-istio-token\") pod \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") "
Jul 17 18:25:22.017584 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.017580    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-istio-podinfo\") pod \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") "
Jul 17 18:25:22.017828 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.017605    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-workload-certs\") pod \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\" (UID: \"835af52d-f0fa-4b6b-8954-ad24c4d2ae4f\") "
Jul 17 18:25:22.017907 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.017870    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "835af52d-f0fa-4b6b-8954-ad24c4d2ae4f" (UID: "835af52d-f0fa-4b6b-8954-ad24c4d2ae4f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:25:22.017907 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.017889    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "835af52d-f0fa-4b6b-8954-ad24c4d2ae4f" (UID: "835af52d-f0fa-4b6b-8954-ad24c4d2ae4f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:25:22.018231 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.018180    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "835af52d-f0fa-4b6b-8954-ad24c4d2ae4f" (UID: "835af52d-f0fa-4b6b-8954-ad24c4d2ae4f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:25:22.018345 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.018265    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "835af52d-f0fa-4b6b-8954-ad24c4d2ae4f" (UID: "835af52d-f0fa-4b6b-8954-ad24c4d2ae4f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:25:22.018477 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.018430    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-istio-data" (OuterVolumeSpecName: "istio-data") pod "835af52d-f0fa-4b6b-8954-ad24c4d2ae4f" (UID: "835af52d-f0fa-4b6b-8954-ad24c4d2ae4f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:25:22.019704 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.019678    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "835af52d-f0fa-4b6b-8954-ad24c4d2ae4f" (UID: "835af52d-f0fa-4b6b-8954-ad24c4d2ae4f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:25:22.019817 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.019777    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-kube-api-access-hfg25" (OuterVolumeSpecName: "kube-api-access-hfg25") pod "835af52d-f0fa-4b6b-8954-ad24c4d2ae4f" (UID: "835af52d-f0fa-4b6b-8954-ad24c4d2ae4f"). InnerVolumeSpecName "kube-api-access-hfg25". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:25:22.019913 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.019889    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "835af52d-f0fa-4b6b-8954-ad24c4d2ae4f" (UID: "835af52d-f0fa-4b6b-8954-ad24c4d2ae4f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 18:25:22.020031 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.019951    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-istio-token" (OuterVolumeSpecName: "istio-token") pod "835af52d-f0fa-4b6b-8954-ad24c4d2ae4f" (UID: "835af52d-f0fa-4b6b-8954-ad24c4d2ae4f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:25:22.118340 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.118250    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-workload-socket\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:25:22.118340 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.118279    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-credential-socket\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:25:22.118340 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.118292    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-istio-token\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:25:22.118340 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.118303    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-istio-podinfo\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:25:22.118340 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.118315    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-workload-certs\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:25:22.118340 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.118326    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-istio-envoy\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:25:22.118340 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.118337    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfg25\" (UniqueName: \"kubernetes.io/projected/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-kube-api-access-hfg25\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:25:22.118687 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.118348    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-istio-data\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:25:22.118687 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.118359    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f-istiod-ca-cert\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:25:22.243281 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.243249    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"]
Jul 17 18:25:22.247957 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.247925    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-02bfc37f-openshift-default-65c45bd7bf-mxbcg"]
Jul 17 18:25:22.291368 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.291330    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8"]
Jul 17 18:25:22.326404 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.326354    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:25:22.426403 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.426376    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8"
Jul 17 18:25:22.495399 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.495362    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:25:22.520192 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.520169    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d953167f-1a80-4ec0-9973-137eec7ba53b-maas-api-tls\") pod \"d953167f-1a80-4ec0-9973-137eec7ba53b\" (UID: \"d953167f-1a80-4ec0-9973-137eec7ba53b\") "
Jul 17 18:25:22.520329 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.520206    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d953167f-1a80-4ec0-9973-137eec7ba53b-openshift-service-ca\") pod \"d953167f-1a80-4ec0-9973-137eec7ba53b\" (UID: \"d953167f-1a80-4ec0-9973-137eec7ba53b\") "
Jul 17 18:25:22.520329 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.520227    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qr9r7\" (UniqueName: \"kubernetes.io/projected/d953167f-1a80-4ec0-9973-137eec7ba53b-kube-api-access-qr9r7\") pod \"d953167f-1a80-4ec0-9973-137eec7ba53b\" (UID: \"d953167f-1a80-4ec0-9973-137eec7ba53b\") "
Jul 17 18:25:22.520623 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.520591    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d953167f-1a80-4ec0-9973-137eec7ba53b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d953167f-1a80-4ec0-9973-137eec7ba53b" (UID: "d953167f-1a80-4ec0-9973-137eec7ba53b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:25:22.522443 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.522419    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d953167f-1a80-4ec0-9973-137eec7ba53b-kube-api-access-qr9r7" (OuterVolumeSpecName: "kube-api-access-qr9r7") pod "d953167f-1a80-4ec0-9973-137eec7ba53b" (UID: "d953167f-1a80-4ec0-9973-137eec7ba53b"). InnerVolumeSpecName "kube-api-access-qr9r7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:25:22.522527 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.522423    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d953167f-1a80-4ec0-9973-137eec7ba53b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d953167f-1a80-4ec0-9973-137eec7ba53b" (UID: "d953167f-1a80-4ec0-9973-137eec7ba53b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 18:25:22.621384 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.621353    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d953167f-1a80-4ec0-9973-137eec7ba53b-maas-api-tls\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:25:22.621384 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.621383    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d953167f-1a80-4ec0-9973-137eec7ba53b-openshift-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:25:22.621384 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.621393    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qr9r7\" (UniqueName: \"kubernetes.io/projected/d953167f-1a80-4ec0-9973-137eec7ba53b-kube-api-access-qr9r7\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:25:22.930263 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.930233    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8"
Jul 17 18:25:22.930647 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.930280    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8" event={"ID":"d953167f-1a80-4ec0-9973-137eec7ba53b","Type":"ContainerDied","Data":"bcac516d90e6385fb7ed0b50aabcc1c7cc8cfd96f50fe0301d1ef7a6b62755c5"}
Jul 17 18:25:22.930647 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.930351    2572 scope.go:117] "RemoveContainer" containerID="d4941a96fcc89eaa2718b81d4dd259b06cac2c0c5549d586f80dd7497b2d09c4"
Jul 17 18:25:22.976788 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.976755    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8"]
Jul 17 18:25:22.980392 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:22.980363    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-02bfc37f-6f547b8955-6nhj8"]
Jul 17 18:25:23.071447 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:23.071415    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-z5jhh"
Jul 17 18:25:23.125325 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:23.125292    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1b76f42-eb23-43c4-a432-4e3f43a86829-maas-api-service-ca\") pod \"a1b76f42-eb23-43c4-a432-4e3f43a86829\" (UID: \"a1b76f42-eb23-43c4-a432-4e3f43a86829\") "
Jul 17 18:25:23.125645 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:23.125623    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1b76f42-eb23-43c4-a432-4e3f43a86829-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a1b76f42-eb23-43c4-a432-4e3f43a86829" (UID: "a1b76f42-eb23-43c4-a432-4e3f43a86829"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:25:23.226643 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:23.226606    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1b76f42-eb23-43c4-a432-4e3f43a86829-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:25:23.472370 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:23.472329    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="835af52d-f0fa-4b6b-8954-ad24c4d2ae4f" path="/var/lib/kubelet/pods/835af52d-f0fa-4b6b-8954-ad24c4d2ae4f/volumes"
Jul 17 18:25:23.472803 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:23.472788    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b" path="/var/lib/kubelet/pods/d953167f-1a80-4ec0-9973-137eec7ba53b/volumes"
Jul 17 18:25:23.938120 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:23.938090    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-z5jhh"
Jul 17 18:25:23.938633 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:23.938100    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-z5jhh" event={"ID":"a1b76f42-eb23-43c4-a432-4e3f43a86829","Type":"ContainerDied","Data":"9b1f1b7386377b423ead49adc5329e06ff38ebd8a6cc8b38170fa85ca242e151"}
Jul 17 18:25:23.938633 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:23.938239    2572 scope.go:117] "RemoveContainer" containerID="bd18d0fd5b6f472fc28eb04ef42f23ba90c0bc4929535a2f57e68eb9cdbcc6a7"
Jul 17 18:25:23.956263 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:23.956238    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-z5jhh"]
Jul 17 18:25:23.959898 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:23.959874    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-z5jhh"]
Jul 17 18:25:25.472468 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:25.472425    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1b76f42-eb23-43c4-a432-4e3f43a86829" path="/var/lib/kubelet/pods/a1b76f42-eb23-43c4-a432-4e3f43a86829/volumes"
Jul 17 18:25:28.149163 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.149127    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:25:28.219417 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.219382    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:25:28.459740 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.459712    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:25:28.563190 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.563158    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:25:28.597599 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.597562    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"]
Jul 17 18:25:28.598084 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.598064    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="835af52d-f0fa-4b6b-8954-ad24c4d2ae4f" containerName="istio-proxy"
Jul 17 18:25:28.598084 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.598083    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="835af52d-f0fa-4b6b-8954-ad24c4d2ae4f" containerName="istio-proxy"
Jul 17 18:25:28.598266 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.598097    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b" containerName="maas-api"
Jul 17 18:25:28.598266 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.598106    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b" containerName="maas-api"
Jul 17 18:25:28.598266 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.598127    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b" containerName="maas-api"
Jul 17 18:25:28.598266 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.598135    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b" containerName="maas-api"
Jul 17 18:25:28.598266 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.598147    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b" containerName="maas-api"
Jul 17 18:25:28.598266 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.598155    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b" containerName="maas-api"
Jul 17 18:25:28.598266 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.598168    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1b76f42-eb23-43c4-a432-4e3f43a86829" containerName="revoke-keys"
Jul 17 18:25:28.598266 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.598175    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1b76f42-eb23-43c4-a432-4e3f43a86829" containerName="revoke-keys"
Jul 17 18:25:28.598266 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.598184    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1b76f42-eb23-43c4-a432-4e3f43a86829" containerName="revoke-keys"
Jul 17 18:25:28.598266 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.598192    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1b76f42-eb23-43c4-a432-4e3f43a86829" containerName="revoke-keys"
Jul 17 18:25:28.598266 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.598203    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1b76f42-eb23-43c4-a432-4e3f43a86829" containerName="revoke-keys"
Jul 17 18:25:28.598266 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.598212    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1b76f42-eb23-43c4-a432-4e3f43a86829" containerName="revoke-keys"
Jul 17 18:25:28.598266 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.598225    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="835af52d-f0fa-4b6b-8954-ad24c4d2ae4f" containerName="istio-proxy"
Jul 17 18:25:28.598266 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.598233    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="835af52d-f0fa-4b6b-8954-ad24c4d2ae4f" containerName="istio-proxy"
Jul 17 18:25:28.598266 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.598243    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b" containerName="maas-api"
Jul 17 18:25:28.598266 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.598251    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b" containerName="maas-api"
Jul 17 18:25:28.599128 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.598346    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="835af52d-f0fa-4b6b-8954-ad24c4d2ae4f" containerName="istio-proxy"
Jul 17 18:25:28.599128 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.598355    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b" containerName="maas-api"
Jul 17 18:25:28.599128 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.598364    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b" containerName="maas-api"
Jul 17 18:25:28.599128 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.598372    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b" containerName="maas-api"
Jul 17 18:25:28.599128 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.598380    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b" containerName="maas-api"
Jul 17 18:25:28.599128 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.598426    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1b76f42-eb23-43c4-a432-4e3f43a86829" containerName="revoke-keys"
Jul 17 18:25:28.599128 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.598437    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1b76f42-eb23-43c4-a432-4e3f43a86829" containerName="revoke-keys"
Jul 17 18:25:28.599128 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.598469    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b" containerName="maas-api"
Jul 17 18:25:28.599128 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.598480    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b" containerName="maas-api"
Jul 17 18:25:28.603427 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.603404    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:28.606187 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.606161    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-35dc36c4-gw-openshift-default-dockercfg-v879n\""
Jul 17 18:25:28.614657 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.614621    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"]
Jul 17 18:25:28.655317 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.655279    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:25:28.677597 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.677564    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-istiod-ca-cert\") pod \"e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") " pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:28.677852 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.677619    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-istio-token\") pod \"e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") " pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:28.677852 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.677675    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-istio-podinfo\") pod \"e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") " pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:28.677852 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.677711    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kc5m\" (UniqueName: \"kubernetes.io/projected/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-kube-api-access-4kc5m\") pod \"e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") " pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:28.677852 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.677767    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-workload-socket\") pod \"e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") " pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:28.677852 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.677811    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-istio-envoy\") pod \"e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") " pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:28.677852 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.677845    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-credential-socket\") pod \"e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") " pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:28.678119 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.677871    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-istio-data\") pod \"e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") " pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:28.678119 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.677905    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-workload-certs\") pod \"e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") " pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:28.778650 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.778549    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-workload-socket\") pod \"e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") " pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:28.778650 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.778594    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-istio-envoy\") pod \"e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") " pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:28.778650 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.778634    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-credential-socket\") pod \"e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") " pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:28.778927 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.778658    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-istio-data\") pod \"e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") " pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:28.778927 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.778693    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-workload-certs\") pod \"e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") " pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:28.778927 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.778835    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-istiod-ca-cert\") pod \"e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") " pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:28.778927 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.778901    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-istio-token\") pod \"e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") " pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:28.779153 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.778949    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-istio-podinfo\") pod \"e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") " pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:28.779153 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.778986    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kc5m\" (UniqueName: \"kubernetes.io/projected/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-kube-api-access-4kc5m\") pod \"e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") " pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:28.779153 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.779067    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-workload-socket\") pod \"e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") " pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:28.779153 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.779148    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-istio-data\") pod \"e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") " pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:28.779331 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.779166    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-workload-certs\") pod \"e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") " pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:28.779372 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.779351    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-credential-socket\") pod \"e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") " pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:28.779595 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.779561    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-istiod-ca-cert\") pod \"e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") " pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:28.781336 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.781307    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-istio-envoy\") pod \"e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") " pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:28.781524 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.781507    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-istio-podinfo\") pod \"e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") " pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:28.787921 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.787892    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-istio-token\") pod \"e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") " pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:28.788040 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.787952    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kc5m\" (UniqueName: \"kubernetes.io/projected/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-kube-api-access-4kc5m\") pod \"e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") " pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:28.916275 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:28.916224    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:29.066061 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:29.064407    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"]
Jul 17 18:25:29.073248 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:29.073212    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:25:29.073346 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:29.073278    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:25:29.073346 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:29.073305    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:25:29.888189 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:29.888155    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:25:29.968678 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:29.968624    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c"]
Jul 17 18:25:29.969219 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:29.969194    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b" containerName="maas-api"
Jul 17 18:25:29.969219 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:29.969219    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b" containerName="maas-api"
Jul 17 18:25:29.969426 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:29.969243    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b" containerName="maas-api"
Jul 17 18:25:29.969426 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:29.969252    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d953167f-1a80-4ec0-9973-137eec7ba53b" containerName="maas-api"
Jul 17 18:25:29.969426 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:29.969369    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="835af52d-f0fa-4b6b-8954-ad24c4d2ae4f" containerName="istio-proxy"
Jul 17 18:25:29.969426 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:29.969386    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1b76f42-eb23-43c4-a432-4e3f43a86829" containerName="revoke-keys"
Jul 17 18:25:29.972709 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:29.972680    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl" event={"ID":"d2fe0592-aec0-4ef2-87c4-008a91cc0caf","Type":"ContainerStarted","Data":"566bca08c5c6f83a43332c076e56a828b1085f4cfbe00d49d43744d743a94b4a"}
Jul 17 18:25:29.972829 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:29.972723    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl" event={"ID":"d2fe0592-aec0-4ef2-87c4-008a91cc0caf","Type":"ContainerStarted","Data":"7f0f8afb2d2c1e06f2bb9fa8662654f42578a08cc15009a5df186f775065f756"}
Jul 17 18:25:29.972829 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:29.972768    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c"
Jul 17 18:25:29.975126 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:29.975037    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-35dc36c4-serving-cert\""
Jul 17 18:25:29.982665 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:29.982065    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c"]
Jul 17 18:25:29.992756 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:29.992708    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl" podStartSLOduration=1.992691011 podStartE2EDuration="1.992691011s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:25:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:25:29.992210477 +0000 UTC m=+1757.217439800" watchObservedRunningTime="2026-07-17 18:25:29.992691011 +0000 UTC m=+1757.217920309"
Jul 17 18:25:30.003809 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:30.003767    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:25:30.093895 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:30.093851    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aaf7669e-bec7-4b46-9c5d-4e52815660f7-openshift-service-ca\") pod \"maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c\" (UID: \"aaf7669e-bec7-4b46-9c5d-4e52815660f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c"
Jul 17 18:25:30.094145 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:30.094048    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbc2s\" (UniqueName: \"kubernetes.io/projected/aaf7669e-bec7-4b46-9c5d-4e52815660f7-kube-api-access-fbc2s\") pod \"maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c\" (UID: \"aaf7669e-bec7-4b46-9c5d-4e52815660f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c"
Jul 17 18:25:30.094145 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:30.094135    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aaf7669e-bec7-4b46-9c5d-4e52815660f7-maas-api-tls\") pod \"maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c\" (UID: \"aaf7669e-bec7-4b46-9c5d-4e52815660f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c"
Jul 17 18:25:30.105823 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:30.105779    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:25:30.194957 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:30.194923    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aaf7669e-bec7-4b46-9c5d-4e52815660f7-maas-api-tls\") pod \"maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c\" (UID: \"aaf7669e-bec7-4b46-9c5d-4e52815660f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c"
Jul 17 18:25:30.195198 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:30.195038    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aaf7669e-bec7-4b46-9c5d-4e52815660f7-openshift-service-ca\") pod \"maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c\" (UID: \"aaf7669e-bec7-4b46-9c5d-4e52815660f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c"
Jul 17 18:25:30.195198 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:30.195073    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbc2s\" (UniqueName: \"kubernetes.io/projected/aaf7669e-bec7-4b46-9c5d-4e52815660f7-kube-api-access-fbc2s\") pod \"maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c\" (UID: \"aaf7669e-bec7-4b46-9c5d-4e52815660f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c"
Jul 17 18:25:30.195644 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:30.195622    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aaf7669e-bec7-4b46-9c5d-4e52815660f7-openshift-service-ca\") pod \"maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c\" (UID: \"aaf7669e-bec7-4b46-9c5d-4e52815660f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c"
Jul 17 18:25:30.197413 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:30.197389    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aaf7669e-bec7-4b46-9c5d-4e52815660f7-maas-api-tls\") pod \"maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c\" (UID: \"aaf7669e-bec7-4b46-9c5d-4e52815660f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c"
Jul 17 18:25:30.204035 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:30.203963    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbc2s\" (UniqueName: \"kubernetes.io/projected/aaf7669e-bec7-4b46-9c5d-4e52815660f7-kube-api-access-fbc2s\") pod \"maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c\" (UID: \"aaf7669e-bec7-4b46-9c5d-4e52815660f7\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c"
Jul 17 18:25:30.288761 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:30.288724    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c"
Jul 17 18:25:30.431333 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:30.431287    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c"]
Jul 17 18:25:30.433806 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:25:30.433779    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaf7669e_bec7_4b46_9c5d_4e52815660f7.slice/crio-bec56479ff0218703a0a8cf666e2ad089d060d3ca23cc93f8a9fc7a852d6ec49 WatchSource:0}: Error finding container bec56479ff0218703a0a8cf666e2ad089d060d3ca23cc93f8a9fc7a852d6ec49: Status 404 returned error can't find the container with id bec56479ff0218703a0a8cf666e2ad089d060d3ca23cc93f8a9fc7a852d6ec49
Jul 17 18:25:30.502761 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:30.502657    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:25:30.597587 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:30.597550    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:25:30.916363 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:30.916329    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:30.921499 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:30.921474    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:30.978721 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:30.978684    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c" event={"ID":"aaf7669e-bec7-4b46-9c5d-4e52815660f7","Type":"ContainerStarted","Data":"2409299d728f5782ff0b8fb4fd7a3a87c8ad13461a170b1b1fc2af161764590c"}
Jul 17 18:25:30.978899 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:30.978761    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:30.978899 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:30.978799    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c" event={"ID":"aaf7669e-bec7-4b46-9c5d-4e52815660f7","Type":"ContainerStarted","Data":"bec56479ff0218703a0a8cf666e2ad089d060d3ca23cc93f8a9fc7a852d6ec49"}
Jul 17 18:25:30.979127 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:30.979029    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c"
Jul 17 18:25:30.979847 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:30.979827    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:30.995700 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:30.995653    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c" podStartSLOduration=1.617985848 podStartE2EDuration="1.995639698s" totalImagesPullingTime="377.65385ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:25:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:25:30.993970527 +0000 UTC m=+1758.219199838" watchObservedRunningTime="2026-07-17 18:25:30.995639698 +0000 UTC m=+1758.220869006"
Jul 17 18:25:31.984541 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:31.984506    2572 generic.go:356] "Generic (PLEG): container finished" podID="aaf7669e-bec7-4b46-9c5d-4e52815660f7" containerID="2409299d728f5782ff0b8fb4fd7a3a87c8ad13461a170b1b1fc2af161764590c" exitCode=1
Jul 17 18:25:31.985028 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:31.984587    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c" event={"ID":"aaf7669e-bec7-4b46-9c5d-4e52815660f7","Type":"ContainerDied","Data":"2409299d728f5782ff0b8fb4fd7a3a87c8ad13461a170b1b1fc2af161764590c"}
Jul 17 18:25:31.985028 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:31.984839    2572 scope.go:117] "RemoveContainer" containerID="2409299d728f5782ff0b8fb4fd7a3a87c8ad13461a170b1b1fc2af161764590c"
Jul 17 18:25:32.991825 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:32.991785    2572 generic.go:356] "Generic (PLEG): container finished" podID="aaf7669e-bec7-4b46-9c5d-4e52815660f7" containerID="feb1e2fd087ba1743a1b20096c604b64b79e5d7d862c431ecf7c3f7f12780657" exitCode=1
Jul 17 18:25:32.992280 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:32.991825    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c" event={"ID":"aaf7669e-bec7-4b46-9c5d-4e52815660f7","Type":"ContainerDied","Data":"feb1e2fd087ba1743a1b20096c604b64b79e5d7d862c431ecf7c3f7f12780657"}
Jul 17 18:25:32.992280 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:32.991895    2572 scope.go:117] "RemoveContainer" containerID="2409299d728f5782ff0b8fb4fd7a3a87c8ad13461a170b1b1fc2af161764590c"
Jul 17 18:25:32.992280 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:32.992177    2572 scope.go:117] "RemoveContainer" containerID="feb1e2fd087ba1743a1b20096c604b64b79e5d7d862c431ecf7c3f7f12780657"
Jul 17 18:25:32.992432 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:25:32.992379    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c_odh-ai-gateway-infra(aaf7669e-bec7-4b46-9c5d-4e52815660f7)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c" podUID="aaf7669e-bec7-4b46-9c5d-4e52815660f7"
Jul 17 18:25:33.998726 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:33.998696    2572 scope.go:117] "RemoveContainer" containerID="feb1e2fd087ba1743a1b20096c604b64b79e5d7d862c431ecf7c3f7f12780657"
Jul 17 18:25:33.999127 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:25:33.998887    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c_odh-ai-gateway-infra(aaf7669e-bec7-4b46-9c5d-4e52815660f7)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c" podUID="aaf7669e-bec7-4b46-9c5d-4e52815660f7"
Jul 17 18:25:34.432991 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:34.432906    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-b9s4p"]
Jul 17 18:25:34.437821 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:34.437800    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-b9s4p"
Jul 17 18:25:34.440486 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:34.440466    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:25:34.444019 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:34.443970    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-b9s4p"]
Jul 17 18:25:34.538270 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:34.538219    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/38481940-c09d-4d4e-8dd6-d6afc31a8b9b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35dc36c4-b9s4p\" (UID: \"38481940-c09d-4d4e-8dd6-d6afc31a8b9b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-b9s4p"
Jul 17 18:25:34.639591 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:34.639553    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/38481940-c09d-4d4e-8dd6-d6afc31a8b9b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35dc36c4-b9s4p\" (UID: \"38481940-c09d-4d4e-8dd6-d6afc31a8b9b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-b9s4p"
Jul 17 18:25:34.640282 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:34.640263    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/38481940-c09d-4d4e-8dd6-d6afc31a8b9b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35dc36c4-b9s4p\" (UID: \"38481940-c09d-4d4e-8dd6-d6afc31a8b9b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-b9s4p"
Jul 17 18:25:34.749736 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:34.749699    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-b9s4p"
Jul 17 18:25:34.931948 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:34.931918    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-b9s4p"]
Jul 17 18:25:35.004949 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:35.004868    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-b9s4p" event={"ID":"38481940-c09d-4d4e-8dd6-d6afc31a8b9b","Type":"ContainerStarted","Data":"9f8d0aefb1d9e228a098aa9affef94d7f6c7730a95f7dd9f633dca390c98765f"}
Jul 17 18:25:35.979544 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:35.979503    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c"
Jul 17 18:25:35.980120 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:35.980093    2572 scope.go:117] "RemoveContainer" containerID="feb1e2fd087ba1743a1b20096c604b64b79e5d7d862c431ecf7c3f7f12780657"
Jul 17 18:25:35.980358 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:25:35.980327    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c_odh-ai-gateway-infra(aaf7669e-bec7-4b46-9c5d-4e52815660f7)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c" podUID="aaf7669e-bec7-4b46-9c5d-4e52815660f7"
Jul 17 18:25:36.011021 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:36.010975    2572 generic.go:356] "Generic (PLEG): container finished" podID="38481940-c09d-4d4e-8dd6-d6afc31a8b9b" containerID="caa84c54d2ad0406f2f5c300439085edfa86e4d1a30dde88ad09ece32c4938f2" exitCode=7
Jul 17 18:25:36.011398 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:36.011033    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-b9s4p" event={"ID":"38481940-c09d-4d4e-8dd6-d6afc31a8b9b","Type":"ContainerDied","Data":"caa84c54d2ad0406f2f5c300439085edfa86e4d1a30dde88ad09ece32c4938f2"}
Jul 17 18:25:36.011398 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:36.011294    2572 scope.go:117] "RemoveContainer" containerID="caa84c54d2ad0406f2f5c300439085edfa86e4d1a30dde88ad09ece32c4938f2"
Jul 17 18:25:37.018719 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:37.018687    2572 generic.go:356] "Generic (PLEG): container finished" podID="38481940-c09d-4d4e-8dd6-d6afc31a8b9b" containerID="cd7ffd4b819773b070168af28a1816f4b39f9bda80cefc7095b0943a6d39183b" exitCode=7
Jul 17 18:25:37.019106 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:37.018736    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-b9s4p" event={"ID":"38481940-c09d-4d4e-8dd6-d6afc31a8b9b","Type":"ContainerDied","Data":"cd7ffd4b819773b070168af28a1816f4b39f9bda80cefc7095b0943a6d39183b"}
Jul 17 18:25:37.019106 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:37.018783    2572 scope.go:117] "RemoveContainer" containerID="caa84c54d2ad0406f2f5c300439085edfa86e4d1a30dde88ad09ece32c4938f2"
Jul 17 18:25:37.019106 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:37.018974    2572 scope.go:117] "RemoveContainer" containerID="cd7ffd4b819773b070168af28a1816f4b39f9bda80cefc7095b0943a6d39183b"
Jul 17 18:25:37.019277 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:25:37.019254    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-35dc36c4-b9s4p_odh-ai-gateway-infra(38481940-c09d-4d4e-8dd6-d6afc31a8b9b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-b9s4p" podUID="38481940-c09d-4d4e-8dd6-d6afc31a8b9b"
Jul 17 18:25:38.025769 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:38.025744    2572 scope.go:117] "RemoveContainer" containerID="cd7ffd4b819773b070168af28a1816f4b39f9bda80cefc7095b0943a6d39183b"
Jul 17 18:25:38.026229 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:25:38.025983    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-35dc36c4-b9s4p_odh-ai-gateway-infra(38481940-c09d-4d4e-8dd6-d6afc31a8b9b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-b9s4p" podUID="38481940-c09d-4d4e-8dd6-d6afc31a8b9b"
Jul 17 18:25:38.096872 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:38.096817    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:25:38.188890 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:38.188774    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:25:40.289934 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:40.289885    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c"
Jul 17 18:25:40.290360 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:40.290344    2572 scope.go:117] "RemoveContainer" containerID="feb1e2fd087ba1743a1b20096c604b64b79e5d7d862c431ecf7c3f7f12780657"
Jul 17 18:25:40.290561 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:25:40.290540    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c_odh-ai-gateway-infra(aaf7669e-bec7-4b46-9c5d-4e52815660f7)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c" podUID="aaf7669e-bec7-4b46-9c5d-4e52815660f7"
Jul 17 18:25:41.042531 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:41.042449    2572 generic.go:356] "Generic (PLEG): container finished" podID="d2fe0592-aec0-4ef2-87c4-008a91cc0caf" containerID="566bca08c5c6f83a43332c076e56a828b1085f4cfbe00d49d43744d743a94b4a" exitCode=0
Jul 17 18:25:41.042531 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:41.042519    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl" event={"ID":"d2fe0592-aec0-4ef2-87c4-008a91cc0caf","Type":"ContainerDied","Data":"566bca08c5c6f83a43332c076e56a828b1085f4cfbe00d49d43744d743a94b4a"}
Jul 17 18:25:41.042924 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:41.042910    2572 scope.go:117] "RemoveContainer" containerID="566bca08c5c6f83a43332c076e56a828b1085f4cfbe00d49d43744d743a94b4a"
Jul 17 18:25:41.043920 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:41.043891    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:25:41.044041 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:41.043977    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:25:41.044113 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:41.044043    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:25:41.718415 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:41.718378    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:25:42.049615 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:42.049523    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl" event={"ID":"d2fe0592-aec0-4ef2-87c4-008a91cc0caf","Type":"ContainerStarted","Data":"00f7cd6044bc8956e8949d6cd2ddf1324454acb9b5b3aae32cbb0c18e514f82c"}
Jul 17 18:25:42.917208 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:42.917173    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:42.918248 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:42.918221    2572 patch_prober.go:28] interesting pod/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 17 18:25:42.918390 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:42.918280    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl" podUID="d2fe0592-aec0-4ef2-87c4-008a91cc0caf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 17 18:25:43.917101 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:43.917068    2572 patch_prober.go:28] interesting pod/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 17 18:25:43.917290 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:43.917121    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl" podUID="d2fe0592-aec0-4ef2-87c4-008a91cc0caf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 17 18:25:44.917132 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:44.917086    2572 patch_prober.go:28] interesting pod/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 17 18:25:44.917371 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:44.917171    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl" podUID="d2fe0592-aec0-4ef2-87c4-008a91cc0caf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 17 18:25:45.917153 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:45.917115    2572 patch_prober.go:28] interesting pod/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 17 18:25:45.917395 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:45.917190    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl" podUID="d2fe0592-aec0-4ef2-87c4-008a91cc0caf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 17 18:25:45.979235 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:45.979195    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:46.920769 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:46.920734    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:46.921790 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:46.921770    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:25:51.465733 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:51.465705    2572 scope.go:117] "RemoveContainer" containerID="feb1e2fd087ba1743a1b20096c604b64b79e5d7d862c431ecf7c3f7f12780657"
Jul 17 18:25:52.104949 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:52.104849    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c" event={"ID":"aaf7669e-bec7-4b46-9c5d-4e52815660f7","Type":"ContainerStarted","Data":"2ac4cb979d52e996cb4576859a12e8b4d128ce4bff074c1775a930999444aa23"}
Jul 17 18:25:52.105182 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:52.105162    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c"
Jul 17 18:25:53.111325 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:53.111287    2572 generic.go:356] "Generic (PLEG): container finished" podID="aaf7669e-bec7-4b46-9c5d-4e52815660f7" containerID="2ac4cb979d52e996cb4576859a12e8b4d128ce4bff074c1775a930999444aa23" exitCode=1
Jul 17 18:25:53.111767 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:53.111424    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c" event={"ID":"aaf7669e-bec7-4b46-9c5d-4e52815660f7","Type":"ContainerDied","Data":"2ac4cb979d52e996cb4576859a12e8b4d128ce4bff074c1775a930999444aa23"}
Jul 17 18:25:53.111767 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:53.111481    2572 scope.go:117] "RemoveContainer" containerID="feb1e2fd087ba1743a1b20096c604b64b79e5d7d862c431ecf7c3f7f12780657"
Jul 17 18:25:53.111767 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:53.111590    2572 scope.go:117] "RemoveContainer" containerID="2ac4cb979d52e996cb4576859a12e8b4d128ce4bff074c1775a930999444aa23"
Jul 17 18:25:53.111945 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:25:53.111847    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c_odh-ai-gateway-infra(aaf7669e-bec7-4b46-9c5d-4e52815660f7)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c" podUID="aaf7669e-bec7-4b46-9c5d-4e52815660f7"
Jul 17 18:25:53.467810 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:53.467783    2572 scope.go:117] "RemoveContainer" containerID="cd7ffd4b819773b070168af28a1816f4b39f9bda80cefc7095b0943a6d39183b"
Jul 17 18:25:54.119165 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:54.119129    2572 generic.go:356] "Generic (PLEG): container finished" podID="38481940-c09d-4d4e-8dd6-d6afc31a8b9b" containerID="c4086cb4e0852e1269d8e391195ada5d1cf757d4da4887584fc1008e416a6b66" exitCode=7
Jul 17 18:25:54.119625 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:54.119201    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-b9s4p" event={"ID":"38481940-c09d-4d4e-8dd6-d6afc31a8b9b","Type":"ContainerDied","Data":"c4086cb4e0852e1269d8e391195ada5d1cf757d4da4887584fc1008e416a6b66"}
Jul 17 18:25:54.119625 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:54.119264    2572 scope.go:117] "RemoveContainer" containerID="cd7ffd4b819773b070168af28a1816f4b39f9bda80cefc7095b0943a6d39183b"
Jul 17 18:25:54.119625 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:54.119600    2572 scope.go:117] "RemoveContainer" containerID="c4086cb4e0852e1269d8e391195ada5d1cf757d4da4887584fc1008e416a6b66"
Jul 17 18:25:54.119870 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:25:54.119850    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-35dc36c4-b9s4p_odh-ai-gateway-infra(38481940-c09d-4d4e-8dd6-d6afc31a8b9b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-b9s4p" podUID="38481940-c09d-4d4e-8dd6-d6afc31a8b9b"
Jul 17 18:25:54.121158 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:54.121142    2572 scope.go:117] "RemoveContainer" containerID="2ac4cb979d52e996cb4576859a12e8b4d128ce4bff074c1775a930999444aa23"
Jul 17 18:25:54.121394 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:25:54.121376    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c_odh-ai-gateway-infra(aaf7669e-bec7-4b46-9c5d-4e52815660f7)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c" podUID="aaf7669e-bec7-4b46-9c5d-4e52815660f7"
Jul 17 18:25:55.151635 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:55.151599    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-b9s4p"]
Jul 17 18:25:55.287950 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:55.287924    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-b9s4p"
Jul 17 18:25:55.453235 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:55.453201    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/38481940-c09d-4d4e-8dd6-d6afc31a8b9b-maas-api-service-ca\") pod \"38481940-c09d-4d4e-8dd6-d6afc31a8b9b\" (UID: \"38481940-c09d-4d4e-8dd6-d6afc31a8b9b\") "
Jul 17 18:25:55.453570 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:55.453545    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38481940-c09d-4d4e-8dd6-d6afc31a8b9b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "38481940-c09d-4d4e-8dd6-d6afc31a8b9b" (UID: "38481940-c09d-4d4e-8dd6-d6afc31a8b9b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:25:55.554382 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:55.554342    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/38481940-c09d-4d4e-8dd6-d6afc31a8b9b-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:25:56.133265 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:56.133234    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-b9s4p"
Jul 17 18:25:56.133455 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:56.133266    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-b9s4p" event={"ID":"38481940-c09d-4d4e-8dd6-d6afc31a8b9b","Type":"ContainerDied","Data":"9f8d0aefb1d9e228a098aa9affef94d7f6c7730a95f7dd9f633dca390c98765f"}
Jul 17 18:25:56.133455 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:56.133334    2572 scope.go:117] "RemoveContainer" containerID="c4086cb4e0852e1269d8e391195ada5d1cf757d4da4887584fc1008e416a6b66"
Jul 17 18:25:56.149189 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:56.149157    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-b9s4p"]
Jul 17 18:25:56.152816 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:56.152779    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-b9s4p"]
Jul 17 18:25:56.641623 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:56.641587    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-sjs4k"]
Jul 17 18:25:56.642011 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:56.641983    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38481940-c09d-4d4e-8dd6-d6afc31a8b9b" containerName="revoke-keys"
Jul 17 18:25:56.642062 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:56.642015    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="38481940-c09d-4d4e-8dd6-d6afc31a8b9b" containerName="revoke-keys"
Jul 17 18:25:56.642062 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:56.642024    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38481940-c09d-4d4e-8dd6-d6afc31a8b9b" containerName="revoke-keys"
Jul 17 18:25:56.642062 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:56.642030    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="38481940-c09d-4d4e-8dd6-d6afc31a8b9b" containerName="revoke-keys"
Jul 17 18:25:56.642062 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:56.642040    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38481940-c09d-4d4e-8dd6-d6afc31a8b9b" containerName="revoke-keys"
Jul 17 18:25:56.642062 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:56.642046    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="38481940-c09d-4d4e-8dd6-d6afc31a8b9b" containerName="revoke-keys"
Jul 17 18:25:56.642214 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:56.642100    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="38481940-c09d-4d4e-8dd6-d6afc31a8b9b" containerName="revoke-keys"
Jul 17 18:25:56.642214 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:56.642111    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="38481940-c09d-4d4e-8dd6-d6afc31a8b9b" containerName="revoke-keys"
Jul 17 18:25:56.646456 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:56.646434    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-sjs4k"
Jul 17 18:25:56.648912 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:56.648896    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:25:56.651815 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:56.651794    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-sjs4k"]
Jul 17 18:25:56.765727 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:56.765676    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f436aff-c5a2-44b1-8043-a4f01cf99852-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-sjs4k\" (UID: \"9f436aff-c5a2-44b1-8043-a4f01cf99852\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-sjs4k"
Jul 17 18:25:56.866653 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:56.866607    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f436aff-c5a2-44b1-8043-a4f01cf99852-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-sjs4k\" (UID: \"9f436aff-c5a2-44b1-8043-a4f01cf99852\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-sjs4k"
Jul 17 18:25:56.867291 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:56.867271    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f436aff-c5a2-44b1-8043-a4f01cf99852-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-sjs4k\" (UID: \"9f436aff-c5a2-44b1-8043-a4f01cf99852\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-sjs4k"
Jul 17 18:25:56.960121 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:56.960087    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-sjs4k"
Jul 17 18:25:57.098847 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:57.098818    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-sjs4k"]
Jul 17 18:25:57.100782 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:25:57.100756    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f436aff_c5a2_44b1_8043_a4f01cf99852.slice/crio-528e633026582e2a83adcf1efbbd6fce90155a6a44281b9e56bfce3538aee4fc WatchSource:0}: Error finding container 528e633026582e2a83adcf1efbbd6fce90155a6a44281b9e56bfce3538aee4fc: Status 404 returned error can't find the container with id 528e633026582e2a83adcf1efbbd6fce90155a6a44281b9e56bfce3538aee4fc
Jul 17 18:25:57.141603 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:57.141514    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-sjs4k" event={"ID":"9f436aff-c5a2-44b1-8043-a4f01cf99852","Type":"ContainerStarted","Data":"528e633026582e2a83adcf1efbbd6fce90155a6a44281b9e56bfce3538aee4fc"}
Jul 17 18:25:57.472312 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:57.472279    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38481940-c09d-4d4e-8dd6-d6afc31a8b9b" path="/var/lib/kubelet/pods/38481940-c09d-4d4e-8dd6-d6afc31a8b9b/volumes"
Jul 17 18:25:57.962219 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:57.962185    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:25:58.148188 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:58.148099    2572 generic.go:356] "Generic (PLEG): container finished" podID="9f436aff-c5a2-44b1-8043-a4f01cf99852" containerID="cde95e7d6f70a8f6e19adb68497ad3ff08c3c66f66e3ca01b8d69eea61feb259" exitCode=6
Jul 17 18:25:58.148330 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:58.148188    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-sjs4k" event={"ID":"9f436aff-c5a2-44b1-8043-a4f01cf99852","Type":"ContainerDied","Data":"cde95e7d6f70a8f6e19adb68497ad3ff08c3c66f66e3ca01b8d69eea61feb259"}
Jul 17 18:25:58.148385 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:58.148371    2572 scope.go:117] "RemoveContainer" containerID="cde95e7d6f70a8f6e19adb68497ad3ff08c3c66f66e3ca01b8d69eea61feb259"
Jul 17 18:25:59.156407 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:59.156316    2572 generic.go:356] "Generic (PLEG): container finished" podID="9f436aff-c5a2-44b1-8043-a4f01cf99852" containerID="27a4dc0fc27e84c43121d0ef725a8d70207a9bb188cef7ed39d31ef69bc83dcb" exitCode=6
Jul 17 18:25:59.156850 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:59.156405    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-sjs4k" event={"ID":"9f436aff-c5a2-44b1-8043-a4f01cf99852","Type":"ContainerDied","Data":"27a4dc0fc27e84c43121d0ef725a8d70207a9bb188cef7ed39d31ef69bc83dcb"}
Jul 17 18:25:59.156850 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:59.156498    2572 scope.go:117] "RemoveContainer" containerID="cde95e7d6f70a8f6e19adb68497ad3ff08c3c66f66e3ca01b8d69eea61feb259"
Jul 17 18:25:59.156850 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:25:59.156752    2572 scope.go:117] "RemoveContainer" containerID="27a4dc0fc27e84c43121d0ef725a8d70207a9bb188cef7ed39d31ef69bc83dcb"
Jul 17 18:25:59.157084 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:25:59.156968    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-sjs4k_odh-ai-gateway-infra(9f436aff-c5a2-44b1-8043-a4f01cf99852)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-sjs4k" podUID="9f436aff-c5a2-44b1-8043-a4f01cf99852"
Jul 17 18:26:00.163706 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:00.163672    2572 scope.go:117] "RemoveContainer" containerID="27a4dc0fc27e84c43121d0ef725a8d70207a9bb188cef7ed39d31ef69bc83dcb"
Jul 17 18:26:00.164181 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:26:00.163948    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-sjs4k_odh-ai-gateway-infra(9f436aff-c5a2-44b1-8043-a4f01cf99852)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-sjs4k" podUID="9f436aff-c5a2-44b1-8043-a4f01cf99852"
Jul 17 18:26:00.288994 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:00.288947    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c"
Jul 17 18:26:00.289444 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:00.289429    2572 scope.go:117] "RemoveContainer" containerID="2ac4cb979d52e996cb4576859a12e8b4d128ce4bff074c1775a930999444aa23"
Jul 17 18:26:00.289637 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:26:00.289618    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c_odh-ai-gateway-infra(aaf7669e-bec7-4b46-9c5d-4e52815660f7)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c" podUID="aaf7669e-bec7-4b46-9c5d-4e52815660f7"
Jul 17 18:26:11.466113 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:11.466081    2572 scope.go:117] "RemoveContainer" containerID="2ac4cb979d52e996cb4576859a12e8b4d128ce4bff074c1775a930999444aa23"
Jul 17 18:26:11.466495 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:26:11.466279    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c_odh-ai-gateway-infra(aaf7669e-bec7-4b46-9c5d-4e52815660f7)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c" podUID="aaf7669e-bec7-4b46-9c5d-4e52815660f7"
Jul 17 18:26:13.537331 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:13.537300    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tp9qm_6c101a17-a051-4e9d-a9dd-f72c67ba2a8a/console-operator/2.log"
Jul 17 18:26:13.541948 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:13.541917    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tp9qm_6c101a17-a051-4e9d-a9dd-f72c67ba2a8a/console-operator/2.log"
Jul 17 18:26:13.544105 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:13.544085    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5mdx_2e3bd369-576e-4df1-8a76-aebd537cde58/ovn-acl-logging/0.log"
Jul 17 18:26:13.548597 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:13.548176    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5mdx_2e3bd369-576e-4df1-8a76-aebd537cde58/ovn-acl-logging/0.log"
Jul 17 18:26:14.466391 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:14.466360    2572 scope.go:117] "RemoveContainer" containerID="27a4dc0fc27e84c43121d0ef725a8d70207a9bb188cef7ed39d31ef69bc83dcb"
Jul 17 18:26:15.238626 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:15.238592    2572 generic.go:356] "Generic (PLEG): container finished" podID="9f436aff-c5a2-44b1-8043-a4f01cf99852" containerID="b3e5ade157231f407f3961108de26e911154c6569e3c9bac93d8ea2979bcdea7" exitCode=6
Jul 17 18:26:15.239047 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:15.238664    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-sjs4k" event={"ID":"9f436aff-c5a2-44b1-8043-a4f01cf99852","Type":"ContainerDied","Data":"b3e5ade157231f407f3961108de26e911154c6569e3c9bac93d8ea2979bcdea7"}
Jul 17 18:26:15.239047 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:15.238722    2572 scope.go:117] "RemoveContainer" containerID="27a4dc0fc27e84c43121d0ef725a8d70207a9bb188cef7ed39d31ef69bc83dcb"
Jul 17 18:26:15.239047 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:15.238966    2572 scope.go:117] "RemoveContainer" containerID="b3e5ade157231f407f3961108de26e911154c6569e3c9bac93d8ea2979bcdea7"
Jul 17 18:26:15.239234 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:26:15.239202    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-sjs4k_odh-ai-gateway-infra(9f436aff-c5a2-44b1-8043-a4f01cf99852)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-sjs4k" podUID="9f436aff-c5a2-44b1-8043-a4f01cf99852"
Jul 17 18:26:16.264321 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:16.264284    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-sjs4k"]
Jul 17 18:26:16.401414 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:16.401376    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-sjs4k"
Jul 17 18:26:16.444459 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:16.444404    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f436aff-c5a2-44b1-8043-a4f01cf99852-maas-api-service-ca\") pod \"9f436aff-c5a2-44b1-8043-a4f01cf99852\" (UID: \"9f436aff-c5a2-44b1-8043-a4f01cf99852\") "
Jul 17 18:26:16.444809 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:16.444787    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f436aff-c5a2-44b1-8043-a4f01cf99852-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9f436aff-c5a2-44b1-8043-a4f01cf99852" (UID: "9f436aff-c5a2-44b1-8043-a4f01cf99852"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:26:16.545409 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:16.545300    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9f436aff-c5a2-44b1-8043-a4f01cf99852-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:26:17.251022 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:17.250966    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-sjs4k"
Jul 17 18:26:17.251022 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:17.250979    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-sjs4k" event={"ID":"9f436aff-c5a2-44b1-8043-a4f01cf99852","Type":"ContainerDied","Data":"528e633026582e2a83adcf1efbbd6fce90155a6a44281b9e56bfce3538aee4fc"}
Jul 17 18:26:17.251250 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:17.251063    2572 scope.go:117] "RemoveContainer" containerID="b3e5ade157231f407f3961108de26e911154c6569e3c9bac93d8ea2979bcdea7"
Jul 17 18:26:17.278750 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:17.278720    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-sjs4k"]
Jul 17 18:26:17.280422 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:17.280401    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-sjs4k"]
Jul 17 18:26:17.471382 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:17.471346    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f436aff-c5a2-44b1-8043-a4f01cf99852" path="/var/lib/kubelet/pods/9f436aff-c5a2-44b1-8043-a4f01cf99852/volumes"
Jul 17 18:26:24.465933 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:24.465899    2572 scope.go:117] "RemoveContainer" containerID="2ac4cb979d52e996cb4576859a12e8b4d128ce4bff074c1775a930999444aa23"
Jul 17 18:26:25.291768 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:25.291731    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c" event={"ID":"aaf7669e-bec7-4b46-9c5d-4e52815660f7","Type":"ContainerStarted","Data":"a16d27baf8468f93b5e12ac7d732ce7b11a803d75e81fb45e3e2e49660d2dbb7"}
Jul 17 18:26:25.291970 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:25.291952    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c"
Jul 17 18:26:26.298692 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:26.298656    2572 generic.go:356] "Generic (PLEG): container finished" podID="aaf7669e-bec7-4b46-9c5d-4e52815660f7" containerID="a16d27baf8468f93b5e12ac7d732ce7b11a803d75e81fb45e3e2e49660d2dbb7" exitCode=1
Jul 17 18:26:26.298692 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:26.298696    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c" event={"ID":"aaf7669e-bec7-4b46-9c5d-4e52815660f7","Type":"ContainerDied","Data":"a16d27baf8468f93b5e12ac7d732ce7b11a803d75e81fb45e3e2e49660d2dbb7"}
Jul 17 18:26:26.299259 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:26.298768    2572 scope.go:117] "RemoveContainer" containerID="2ac4cb979d52e996cb4576859a12e8b4d128ce4bff074c1775a930999444aa23"
Jul 17 18:26:26.299259 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:26.298963    2572 scope.go:117] "RemoveContainer" containerID="a16d27baf8468f93b5e12ac7d732ce7b11a803d75e81fb45e3e2e49660d2dbb7"
Jul 17 18:26:26.299358 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:26:26.299249    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c_odh-ai-gateway-infra(aaf7669e-bec7-4b46-9c5d-4e52815660f7)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c" podUID="aaf7669e-bec7-4b46-9c5d-4e52815660f7"
Jul 17 18:26:27.305904 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:27.305874    2572 scope.go:117] "RemoveContainer" containerID="a16d27baf8468f93b5e12ac7d732ce7b11a803d75e81fb45e3e2e49660d2dbb7"
Jul 17 18:26:27.306324 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:26:27.306102    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c_odh-ai-gateway-infra(aaf7669e-bec7-4b46-9c5d-4e52815660f7)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c" podUID="aaf7669e-bec7-4b46-9c5d-4e52815660f7"
Jul 17 18:26:30.289939 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:30.289901    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c"
Jul 17 18:26:30.290424 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:30.290326    2572 scope.go:117] "RemoveContainer" containerID="a16d27baf8468f93b5e12ac7d732ce7b11a803d75e81fb45e3e2e49660d2dbb7"
Jul 17 18:26:30.290534 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:26:30.290514    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c_odh-ai-gateway-infra(aaf7669e-bec7-4b46-9c5d-4e52815660f7)\"" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c" podUID="aaf7669e-bec7-4b46-9c5d-4e52815660f7"
Jul 17 18:26:34.477525 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:34.477487    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-6g2tl"]
Jul 17 18:26:34.477926 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:34.477871    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f436aff-c5a2-44b1-8043-a4f01cf99852" containerName="revoke-keys"
Jul 17 18:26:34.477926 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:34.477888    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f436aff-c5a2-44b1-8043-a4f01cf99852" containerName="revoke-keys"
Jul 17 18:26:34.477926 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:34.477900    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f436aff-c5a2-44b1-8043-a4f01cf99852" containerName="revoke-keys"
Jul 17 18:26:34.477926 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:34.477909    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f436aff-c5a2-44b1-8043-a4f01cf99852" containerName="revoke-keys"
Jul 17 18:26:34.477926 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:34.477921    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f436aff-c5a2-44b1-8043-a4f01cf99852" containerName="revoke-keys"
Jul 17 18:26:34.477926 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:34.477927    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f436aff-c5a2-44b1-8043-a4f01cf99852" containerName="revoke-keys"
Jul 17 18:26:34.478230 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:34.478020    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f436aff-c5a2-44b1-8043-a4f01cf99852" containerName="revoke-keys"
Jul 17 18:26:34.478230 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:34.478033    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f436aff-c5a2-44b1-8043-a4f01cf99852" containerName="revoke-keys"
Jul 17 18:26:34.478230 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:34.478039    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="38481940-c09d-4d4e-8dd6-d6afc31a8b9b" containerName="revoke-keys"
Jul 17 18:26:34.478230 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:34.478047    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f436aff-c5a2-44b1-8043-a4f01cf99852" containerName="revoke-keys"
Jul 17 18:26:34.482581 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:34.482561    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-6g2tl"
Jul 17 18:26:34.485514 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:34.485482    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:26:34.488526 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:34.488499    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-6g2tl"]
Jul 17 18:26:34.564149 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:34.564105    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"]
Jul 17 18:26:34.564397 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:34.564351    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl" podUID="d2fe0592-aec0-4ef2-87c4-008a91cc0caf" containerName="istio-proxy" containerID="cri-o://00f7cd6044bc8956e8949d6cd2ddf1324454acb9b5b3aae32cbb0c18e514f82c" gracePeriod=30
Jul 17 18:26:34.594667 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:34.594627    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:26:34.620413 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:34.620378    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ebba954-bc90-4a40-a579-33e4e191b549-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35dc36c4-6g2tl\" (UID: \"7ebba954-bc90-4a40-a579-33e4e191b549\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-6g2tl"
Jul 17 18:26:34.693483 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:34.693440    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:26:34.721660 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:34.721624    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ebba954-bc90-4a40-a579-33e4e191b549-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35dc36c4-6g2tl\" (UID: \"7ebba954-bc90-4a40-a579-33e4e191b549\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-6g2tl"
Jul 17 18:26:34.722347 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:34.722321    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ebba954-bc90-4a40-a579-33e4e191b549-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35dc36c4-6g2tl\" (UID: \"7ebba954-bc90-4a40-a579-33e4e191b549\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-6g2tl"
Jul 17 18:26:34.795805 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:34.795708    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-6g2tl"
Jul 17 18:26:34.946043 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:34.946015    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-6g2tl"]
Jul 17 18:26:34.947940 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:26:34.947914    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ebba954_bc90_4a40_a579_33e4e191b549.slice/crio-fca83ec1462db2041a25f596e6f58a49d879b33206222d87038028a1df2686e0 WatchSource:0}: Error finding container fca83ec1462db2041a25f596e6f58a49d879b33206222d87038028a1df2686e0: Status 404 returned error can't find the container with id fca83ec1462db2041a25f596e6f58a49d879b33206222d87038028a1df2686e0
Jul 17 18:26:35.350988 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:35.350954    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-6g2tl" event={"ID":"7ebba954-bc90-4a40-a579-33e4e191b549","Type":"ContainerStarted","Data":"fca83ec1462db2041a25f596e6f58a49d879b33206222d87038028a1df2686e0"}
Jul 17 18:26:36.357281 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:36.357243    2572 generic.go:356] "Generic (PLEG): container finished" podID="7ebba954-bc90-4a40-a579-33e4e191b549" containerID="9c4c50a3d0b1eb664d541e62f6e6ca9692e7fc65c1671639a337ff4d165d6576" exitCode=7
Jul 17 18:26:36.357672 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:36.357329    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-6g2tl" event={"ID":"7ebba954-bc90-4a40-a579-33e4e191b549","Type":"ContainerDied","Data":"9c4c50a3d0b1eb664d541e62f6e6ca9692e7fc65c1671639a337ff4d165d6576"}
Jul 17 18:26:36.357672 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:36.357476    2572 scope.go:117] "RemoveContainer" containerID="9c4c50a3d0b1eb664d541e62f6e6ca9692e7fc65c1671639a337ff4d165d6576"
Jul 17 18:26:37.364624 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:37.364529    2572 generic.go:356] "Generic (PLEG): container finished" podID="7ebba954-bc90-4a40-a579-33e4e191b549" containerID="3a22550b0883f65906a2b03f8aabe6e9c830d068e1a2e8abdf7f78656ffdfc2d" exitCode=7
Jul 17 18:26:37.364624 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:37.364579    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-6g2tl" event={"ID":"7ebba954-bc90-4a40-a579-33e4e191b549","Type":"ContainerDied","Data":"3a22550b0883f65906a2b03f8aabe6e9c830d068e1a2e8abdf7f78656ffdfc2d"}
Jul 17 18:26:37.365129 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:37.364671    2572 scope.go:117] "RemoveContainer" containerID="9c4c50a3d0b1eb664d541e62f6e6ca9692e7fc65c1671639a337ff4d165d6576"
Jul 17 18:26:37.365129 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:37.364916    2572 scope.go:117] "RemoveContainer" containerID="3a22550b0883f65906a2b03f8aabe6e9c830d068e1a2e8abdf7f78656ffdfc2d"
Jul 17 18:26:37.365218 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:26:37.365177    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-35dc36c4-6g2tl_odh-ai-gateway-infra(7ebba954-bc90-4a40-a579-33e4e191b549)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-6g2tl" podUID="7ebba954-bc90-4a40-a579-33e4e191b549"
Jul 17 18:26:38.371210 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:38.371177    2572 scope.go:117] "RemoveContainer" containerID="3a22550b0883f65906a2b03f8aabe6e9c830d068e1a2e8abdf7f78656ffdfc2d"
Jul 17 18:26:38.371663 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:26:38.371463    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-35dc36c4-6g2tl_odh-ai-gateway-infra(7ebba954-bc90-4a40-a579-33e4e191b549)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-6g2tl" podUID="7ebba954-bc90-4a40-a579-33e4e191b549"
Jul 17 18:26:39.821262 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:39.821233    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:26:39.871566 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:39.871539    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kc5m\" (UniqueName: \"kubernetes.io/projected/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-kube-api-access-4kc5m\") pod \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") "
Jul 17 18:26:39.871709 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:39.871574    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-credential-socket\") pod \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") "
Jul 17 18:26:39.871709 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:39.871612    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-istio-podinfo\") pod \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") "
Jul 17 18:26:39.871709 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:39.871702    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-istiod-ca-cert\") pod \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") "
Jul 17 18:26:39.871886 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:39.871761    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-istio-token\") pod \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") "
Jul 17 18:26:39.871886 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:39.871788    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-workload-certs\") pod \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") "
Jul 17 18:26:39.871886 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:39.871814    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-workload-socket\") pod \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") "
Jul 17 18:26:39.872070 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:39.871931    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d2fe0592-aec0-4ef2-87c4-008a91cc0caf" (UID: "d2fe0592-aec0-4ef2-87c4-008a91cc0caf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:26:39.872263 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:39.872142    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d2fe0592-aec0-4ef2-87c4-008a91cc0caf" (UID: "d2fe0592-aec0-4ef2-87c4-008a91cc0caf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:26:39.872342 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:39.872224    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d2fe0592-aec0-4ef2-87c4-008a91cc0caf" (UID: "d2fe0592-aec0-4ef2-87c4-008a91cc0caf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:26:39.872342 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:39.872188    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-credential-socket\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:26:39.872342 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:39.872301    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d2fe0592-aec0-4ef2-87c4-008a91cc0caf" (UID: "d2fe0592-aec0-4ef2-87c4-008a91cc0caf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:26:39.873861 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:39.873826    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d2fe0592-aec0-4ef2-87c4-008a91cc0caf" (UID: "d2fe0592-aec0-4ef2-87c4-008a91cc0caf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 18:26:39.874056 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:39.873976    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-kube-api-access-4kc5m" (OuterVolumeSpecName: "kube-api-access-4kc5m") pod "d2fe0592-aec0-4ef2-87c4-008a91cc0caf" (UID: "d2fe0592-aec0-4ef2-87c4-008a91cc0caf"). InnerVolumeSpecName "kube-api-access-4kc5m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:26:39.874180 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:39.874162    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-istio-token" (OuterVolumeSpecName: "istio-token") pod "d2fe0592-aec0-4ef2-87c4-008a91cc0caf" (UID: "d2fe0592-aec0-4ef2-87c4-008a91cc0caf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:26:39.973259 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:39.973227    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-istio-envoy\") pod \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") "
Jul 17 18:26:39.973259 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:39.973263    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-istio-data\") pod \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\" (UID: \"d2fe0592-aec0-4ef2-87c4-008a91cc0caf\") "
Jul 17 18:26:39.973509 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:39.973491    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kc5m\" (UniqueName: \"kubernetes.io/projected/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-kube-api-access-4kc5m\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:26:39.973549 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:39.973515    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-istio-podinfo\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:26:39.973549 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:39.973529    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-istiod-ca-cert\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:26:39.973549 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:39.973541    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-istio-token\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:26:39.973649 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:39.973555    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-workload-certs\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:26:39.973649 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:39.973567    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-workload-socket\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:26:39.973953 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:39.973926    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-istio-data" (OuterVolumeSpecName: "istio-data") pod "d2fe0592-aec0-4ef2-87c4-008a91cc0caf" (UID: "d2fe0592-aec0-4ef2-87c4-008a91cc0caf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:26:39.975418 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:39.975399    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d2fe0592-aec0-4ef2-87c4-008a91cc0caf" (UID: "d2fe0592-aec0-4ef2-87c4-008a91cc0caf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:26:40.051084 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:40.051042    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c"]
Jul 17 18:26:40.074427 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:40.074393    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-istio-envoy\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:26:40.074427 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:40.074430    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d2fe0592-aec0-4ef2-87c4-008a91cc0caf-istio-data\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:26:40.075495 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:40.075466    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:26:40.178917 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:40.178890    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c"
Jul 17 18:26:40.275770 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:40.275737    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aaf7669e-bec7-4b46-9c5d-4e52815660f7-openshift-service-ca\") pod \"aaf7669e-bec7-4b46-9c5d-4e52815660f7\" (UID: \"aaf7669e-bec7-4b46-9c5d-4e52815660f7\") "
Jul 17 18:26:40.275770 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:40.275782    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbc2s\" (UniqueName: \"kubernetes.io/projected/aaf7669e-bec7-4b46-9c5d-4e52815660f7-kube-api-access-fbc2s\") pod \"aaf7669e-bec7-4b46-9c5d-4e52815660f7\" (UID: \"aaf7669e-bec7-4b46-9c5d-4e52815660f7\") "
Jul 17 18:26:40.276049 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:40.275824    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aaf7669e-bec7-4b46-9c5d-4e52815660f7-maas-api-tls\") pod \"aaf7669e-bec7-4b46-9c5d-4e52815660f7\" (UID: \"aaf7669e-bec7-4b46-9c5d-4e52815660f7\") "
Jul 17 18:26:40.276164 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:40.276139    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaf7669e-bec7-4b46-9c5d-4e52815660f7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "aaf7669e-bec7-4b46-9c5d-4e52815660f7" (UID: "aaf7669e-bec7-4b46-9c5d-4e52815660f7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:26:40.277963 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:40.277937    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaf7669e-bec7-4b46-9c5d-4e52815660f7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "aaf7669e-bec7-4b46-9c5d-4e52815660f7" (UID: "aaf7669e-bec7-4b46-9c5d-4e52815660f7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 18:26:40.278068 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:40.277978    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaf7669e-bec7-4b46-9c5d-4e52815660f7-kube-api-access-fbc2s" (OuterVolumeSpecName: "kube-api-access-fbc2s") pod "aaf7669e-bec7-4b46-9c5d-4e52815660f7" (UID: "aaf7669e-bec7-4b46-9c5d-4e52815660f7"). InnerVolumeSpecName "kube-api-access-fbc2s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:26:40.376533 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:40.376493    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aaf7669e-bec7-4b46-9c5d-4e52815660f7-openshift-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:26:40.376533 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:40.376527    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbc2s\" (UniqueName: \"kubernetes.io/projected/aaf7669e-bec7-4b46-9c5d-4e52815660f7-kube-api-access-fbc2s\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:26:40.376740 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:40.376541    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aaf7669e-bec7-4b46-9c5d-4e52815660f7-maas-api-tls\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:26:40.382167 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:40.382138    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c"
Jul 17 18:26:40.382325 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:40.382172    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c" event={"ID":"aaf7669e-bec7-4b46-9c5d-4e52815660f7","Type":"ContainerDied","Data":"bec56479ff0218703a0a8cf666e2ad089d060d3ca23cc93f8a9fc7a852d6ec49"}
Jul 17 18:26:40.382325 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:40.382234    2572 scope.go:117] "RemoveContainer" containerID="a16d27baf8468f93b5e12ac7d732ce7b11a803d75e81fb45e3e2e49660d2dbb7"
Jul 17 18:26:40.384187 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:40.384150    2572 generic.go:356] "Generic (PLEG): container finished" podID="d2fe0592-aec0-4ef2-87c4-008a91cc0caf" containerID="00f7cd6044bc8956e8949d6cd2ddf1324454acb9b5b3aae32cbb0c18e514f82c" exitCode=0
Jul 17 18:26:40.384312 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:40.384190    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"
Jul 17 18:26:40.384312 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:40.384210    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl" event={"ID":"d2fe0592-aec0-4ef2-87c4-008a91cc0caf","Type":"ContainerDied","Data":"00f7cd6044bc8956e8949d6cd2ddf1324454acb9b5b3aae32cbb0c18e514f82c"}
Jul 17 18:26:40.384575 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:40.384250    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl" event={"ID":"d2fe0592-aec0-4ef2-87c4-008a91cc0caf","Type":"ContainerDied","Data":"7f0f8afb2d2c1e06f2bb9fa8662654f42578a08cc15009a5df186f775065f756"}
Jul 17 18:26:40.397265 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:40.397134    2572 scope.go:117] "RemoveContainer" containerID="00f7cd6044bc8956e8949d6cd2ddf1324454acb9b5b3aae32cbb0c18e514f82c"
Jul 17 18:26:40.406040 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:40.405987    2572 scope.go:117] "RemoveContainer" containerID="566bca08c5c6f83a43332c076e56a828b1085f4cfbe00d49d43744d743a94b4a"
Jul 17 18:26:40.409305 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:40.409281    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c"]
Jul 17 18:26:40.413238 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:40.413213    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-35dc36c4-55ddff48fd-8bx9c"]
Jul 17 18:26:40.414584 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:40.414565    2572 scope.go:117] "RemoveContainer" containerID="00f7cd6044bc8956e8949d6cd2ddf1324454acb9b5b3aae32cbb0c18e514f82c"
Jul 17 18:26:40.414933 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:26:40.414909    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00f7cd6044bc8956e8949d6cd2ddf1324454acb9b5b3aae32cbb0c18e514f82c\": container with ID starting with 00f7cd6044bc8956e8949d6cd2ddf1324454acb9b5b3aae32cbb0c18e514f82c not found: ID does not exist" containerID="00f7cd6044bc8956e8949d6cd2ddf1324454acb9b5b3aae32cbb0c18e514f82c"
Jul 17 18:26:40.415070 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:40.414941    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00f7cd6044bc8956e8949d6cd2ddf1324454acb9b5b3aae32cbb0c18e514f82c"} err="failed to get container status \"00f7cd6044bc8956e8949d6cd2ddf1324454acb9b5b3aae32cbb0c18e514f82c\": rpc error: code = NotFound desc = could not find container \"00f7cd6044bc8956e8949d6cd2ddf1324454acb9b5b3aae32cbb0c18e514f82c\": container with ID starting with 00f7cd6044bc8956e8949d6cd2ddf1324454acb9b5b3aae32cbb0c18e514f82c not found: ID does not exist"
Jul 17 18:26:40.415070 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:40.414959    2572 scope.go:117] "RemoveContainer" containerID="566bca08c5c6f83a43332c076e56a828b1085f4cfbe00d49d43744d743a94b4a"
Jul 17 18:26:40.415309 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:26:40.415284    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"566bca08c5c6f83a43332c076e56a828b1085f4cfbe00d49d43744d743a94b4a\": container with ID starting with 566bca08c5c6f83a43332c076e56a828b1085f4cfbe00d49d43744d743a94b4a not found: ID does not exist" containerID="566bca08c5c6f83a43332c076e56a828b1085f4cfbe00d49d43744d743a94b4a"
Jul 17 18:26:40.415399 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:40.415315    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"566bca08c5c6f83a43332c076e56a828b1085f4cfbe00d49d43744d743a94b4a"} err="failed to get container status \"566bca08c5c6f83a43332c076e56a828b1085f4cfbe00d49d43744d743a94b4a\": rpc error: code = NotFound desc = could not find container \"566bca08c5c6f83a43332c076e56a828b1085f4cfbe00d49d43744d743a94b4a\": container with ID starting with 566bca08c5c6f83a43332c076e56a828b1085f4cfbe00d49d43744d743a94b4a not found: ID does not exist"
Jul 17 18:26:40.425091 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:40.425024    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"]
Jul 17 18:26:40.430191 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:40.430165    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-35dc36c4-gw-openshift-default-545f95958c-dhcbl"]
Jul 17 18:26:40.443352 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:40.443321    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:26:41.471915 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:41.471884    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aaf7669e-bec7-4b46-9c5d-4e52815660f7" path="/var/lib/kubelet/pods/aaf7669e-bec7-4b46-9c5d-4e52815660f7/volumes"
Jul 17 18:26:41.472449 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:41.472432    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2fe0592-aec0-4ef2-87c4-008a91cc0caf" path="/var/lib/kubelet/pods/d2fe0592-aec0-4ef2-87c4-008a91cc0caf/volumes"
Jul 17 18:26:45.982952 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:45.982923    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:26:46.204255 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.204221    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:26:46.266816 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.266728    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:26:46.402498 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.402456    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"]
Jul 17 18:26:46.402923 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.402905    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2fe0592-aec0-4ef2-87c4-008a91cc0caf" containerName="istio-proxy"
Jul 17 18:26:46.403026 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.402925    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2fe0592-aec0-4ef2-87c4-008a91cc0caf" containerName="istio-proxy"
Jul 17 18:26:46.403026 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.402938    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaf7669e-bec7-4b46-9c5d-4e52815660f7" containerName="maas-api"
Jul 17 18:26:46.403026 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.402946    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaf7669e-bec7-4b46-9c5d-4e52815660f7" containerName="maas-api"
Jul 17 18:26:46.403026 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.402960    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaf7669e-bec7-4b46-9c5d-4e52815660f7" containerName="maas-api"
Jul 17 18:26:46.403026 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.402968    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaf7669e-bec7-4b46-9c5d-4e52815660f7" containerName="maas-api"
Jul 17 18:26:46.403026 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.402977    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaf7669e-bec7-4b46-9c5d-4e52815660f7" containerName="maas-api"
Jul 17 18:26:46.403026 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.402986    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaf7669e-bec7-4b46-9c5d-4e52815660f7" containerName="maas-api"
Jul 17 18:26:46.403026 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.403023    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaf7669e-bec7-4b46-9c5d-4e52815660f7" containerName="maas-api"
Jul 17 18:26:46.403491 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.403032    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaf7669e-bec7-4b46-9c5d-4e52815660f7" containerName="maas-api"
Jul 17 18:26:46.403491 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.403134    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaf7669e-bec7-4b46-9c5d-4e52815660f7" containerName="maas-api"
Jul 17 18:26:46.403491 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.403151    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2fe0592-aec0-4ef2-87c4-008a91cc0caf" containerName="istio-proxy"
Jul 17 18:26:46.403491 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.403160    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaf7669e-bec7-4b46-9c5d-4e52815660f7" containerName="maas-api"
Jul 17 18:26:46.403491 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.403170    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2fe0592-aec0-4ef2-87c4-008a91cc0caf" containerName="istio-proxy"
Jul 17 18:26:46.406512 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.406488    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:26:46.409310 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.409288    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a5b144da-openshift-default-dockercfg-qk8m6\""
Jul 17 18:26:46.424483 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.424448    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"]
Jul 17 18:26:46.430345 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.430313    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-credential-socket\") pod \"e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") " pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:26:46.430510 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.430354    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-workload-certs\") pod \"e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") " pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:26:46.430510 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.430379    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-istio-podinfo\") pod \"e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") " pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:26:46.430510 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.430456    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7ggw\" (UniqueName: \"kubernetes.io/projected/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-kube-api-access-s7ggw\") pod \"e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") " pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:26:46.430510 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.430505    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-istiod-ca-cert\") pod \"e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") " pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:26:46.430665 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.430573    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-istio-data\") pod \"e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") " pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:26:46.430665 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.430608    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-istio-token\") pod \"e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") " pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:26:46.430665 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.430644    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-workload-socket\") pod \"e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") " pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:26:46.430765 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.430699    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-istio-envoy\") pod \"e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") " pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:26:46.435314 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.435282    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:26:46.532145 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.532040    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-credential-socket\") pod \"e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") " pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:26:46.532145 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.532083    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-workload-certs\") pod \"e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") " pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:26:46.532145 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.532100    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-istio-podinfo\") pod \"e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") " pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:26:46.532145 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.532122    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7ggw\" (UniqueName: \"kubernetes.io/projected/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-kube-api-access-s7ggw\") pod \"e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") " pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:26:46.532506 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.532175    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-istiod-ca-cert\") pod \"e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") " pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:26:46.532506 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.532248    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-istio-data\") pod \"e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") " pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:26:46.532506 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.532306    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-istio-token\") pod \"e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") " pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:26:46.532506 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.532360    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-workload-socket\") pod \"e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") " pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:26:46.532506 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.532411    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-istio-envoy\") pod \"e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") " pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:26:46.532753 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.532504    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-workload-certs\") pod \"e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") " pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:26:46.532753 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.532545    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-credential-socket\") pod \"e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") " pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:26:46.532753 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.532578    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-istio-data\") pod \"e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") " pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:26:46.533115 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.533086    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-workload-socket\") pod \"e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") " pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:26:46.533474 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.533451    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-istiod-ca-cert\") pod \"e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") " pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:26:46.534722 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.534700    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-istio-envoy\") pod \"e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") " pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:26:46.535067 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.535045    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-istio-podinfo\") pod \"e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") " pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:26:46.535308 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.535289    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:26:46.543422 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.543398    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-istio-token\") pod \"e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") " pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:26:46.543633 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.543613    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7ggw\" (UniqueName: \"kubernetes.io/projected/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-kube-api-access-s7ggw\") pod \"e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") " pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:26:46.718613 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.718558    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:26:46.860871 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.860837    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"]
Jul 17 18:26:46.863476 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:26:46.863442    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4b84b29_e955_45bb_a1ef_7e0d9245a2cb.slice/crio-5182eb0d69933ad7ecc30f28c4218884fb8d315e11925e8f7c53af60ff10e18e WatchSource:0}: Error finding container 5182eb0d69933ad7ecc30f28c4218884fb8d315e11925e8f7c53af60ff10e18e: Status 404 returned error can't find the container with id 5182eb0d69933ad7ecc30f28c4218884fb8d315e11925e8f7c53af60ff10e18e
Jul 17 18:26:46.865605 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.865572    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:26:46.865681 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.865650    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:26:46.865732 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:46.865678    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:26:47.420992 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:47.420949    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6" event={"ID":"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb","Type":"ContainerStarted","Data":"b132a2970888ede0ee4e35f2e29726227d2e55feb65c200fb2d18417681dfcb9"}
Jul 17 18:26:47.421410 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:47.421028    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6" event={"ID":"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb","Type":"ContainerStarted","Data":"5182eb0d69933ad7ecc30f28c4218884fb8d315e11925e8f7c53af60ff10e18e"}
Jul 17 18:26:47.445677 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:47.445617    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6" podStartSLOduration=1.445603015 podStartE2EDuration="1.445603015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:26:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:26:47.444034522 +0000 UTC m=+1834.669263833" watchObservedRunningTime="2026-07-17 18:26:47.445603015 +0000 UTC m=+1834.670832322"
Jul 17 18:26:47.573291 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:47.573254    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:26:47.640201 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:47.640166    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g"]
Jul 17 18:26:47.640547 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:47.640535    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2fe0592-aec0-4ef2-87c4-008a91cc0caf" containerName="istio-proxy"
Jul 17 18:26:47.640587 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:47.640549    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2fe0592-aec0-4ef2-87c4-008a91cc0caf" containerName="istio-proxy"
Jul 17 18:26:47.640637 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:47.640628    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaf7669e-bec7-4b46-9c5d-4e52815660f7" containerName="maas-api"
Jul 17 18:26:47.644549 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:47.644511    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g"
Jul 17 18:26:47.647187 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:47.647159    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-a5b144da-serving-cert\""
Jul 17 18:26:47.652690 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:47.652659    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g"]
Jul 17 18:26:47.659969 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:47.659937    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:26:47.719484 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:47.719449    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:26:47.724600 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:47.724575    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:26:47.744400 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:47.744370    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:26:47.744799 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:47.744773    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7a3f452-fa0c-4763-8469-effe6c26b42e-openshift-service-ca\") pod \"maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g\" (UID: \"b7a3f452-fa0c-4763-8469-effe6c26b42e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g"
Jul 17 18:26:47.744898 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:47.744872    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vd9s\" (UniqueName: \"kubernetes.io/projected/b7a3f452-fa0c-4763-8469-effe6c26b42e-kube-api-access-8vd9s\") pod \"maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g\" (UID: \"b7a3f452-fa0c-4763-8469-effe6c26b42e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g"
Jul 17 18:26:47.744951 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:47.744917    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7a3f452-fa0c-4763-8469-effe6c26b42e-maas-api-tls\") pod \"maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g\" (UID: \"b7a3f452-fa0c-4763-8469-effe6c26b42e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g"
Jul 17 18:26:47.846461 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:47.846422    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vd9s\" (UniqueName: \"kubernetes.io/projected/b7a3f452-fa0c-4763-8469-effe6c26b42e-kube-api-access-8vd9s\") pod \"maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g\" (UID: \"b7a3f452-fa0c-4763-8469-effe6c26b42e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g"
Jul 17 18:26:47.846626 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:47.846478    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7a3f452-fa0c-4763-8469-effe6c26b42e-maas-api-tls\") pod \"maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g\" (UID: \"b7a3f452-fa0c-4763-8469-effe6c26b42e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g"
Jul 17 18:26:47.846626 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:26:47.846582    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-serving-cert: secret "maas-api-e2e-ait-a5b144da-serving-cert" not found
Jul 17 18:26:47.846716 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:26:47.846651    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7a3f452-fa0c-4763-8469-effe6c26b42e-maas-api-tls podName:b7a3f452-fa0c-4763-8469-effe6c26b42e nodeName:}" failed. No retries permitted until 2026-07-17 18:26:48.346630518 +0000 UTC m=+1835.571859803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b7a3f452-fa0c-4763-8469-effe6c26b42e-maas-api-tls") pod "maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" (UID: "b7a3f452-fa0c-4763-8469-effe6c26b42e") : secret "maas-api-e2e-ait-a5b144da-serving-cert" not found
Jul 17 18:26:47.846716 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:47.846586    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7a3f452-fa0c-4763-8469-effe6c26b42e-openshift-service-ca\") pod \"maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g\" (UID: \"b7a3f452-fa0c-4763-8469-effe6c26b42e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g"
Jul 17 18:26:47.847319 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:47.847298    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7a3f452-fa0c-4763-8469-effe6c26b42e-openshift-service-ca\") pod \"maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g\" (UID: \"b7a3f452-fa0c-4763-8469-effe6c26b42e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g"
Jul 17 18:26:47.855114 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:47.855070    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vd9s\" (UniqueName: \"kubernetes.io/projected/b7a3f452-fa0c-4763-8469-effe6c26b42e-kube-api-access-8vd9s\") pod \"maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g\" (UID: \"b7a3f452-fa0c-4763-8469-effe6c26b42e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g"
Jul 17 18:26:47.971867 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:47.971773    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:26:48.329115 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:48.328989    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:26:48.352388 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:48.352356    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7a3f452-fa0c-4763-8469-effe6c26b42e-maas-api-tls\") pod \"maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g\" (UID: \"b7a3f452-fa0c-4763-8469-effe6c26b42e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g"
Jul 17 18:26:48.355009 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:48.354973    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7a3f452-fa0c-4763-8469-effe6c26b42e-maas-api-tls\") pod \"maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g\" (UID: \"b7a3f452-fa0c-4763-8469-effe6c26b42e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g"
Jul 17 18:26:48.425763 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:48.425738    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:26:48.425763 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:48.425758    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:26:48.426791 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:48.426770    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:26:48.558867 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:48.558831    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g"
Jul 17 18:26:48.699424 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:48.699389    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g"]
Jul 17 18:26:48.701550 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:26:48.701517    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7a3f452_fa0c_4763_8469_effe6c26b42e.slice/crio-690552b80107dc72d80681f023144dc9ff29470ea28762235649e01cbc5094be WatchSource:0}: Error finding container 690552b80107dc72d80681f023144dc9ff29470ea28762235649e01cbc5094be: Status 404 returned error can't find the container with id 690552b80107dc72d80681f023144dc9ff29470ea28762235649e01cbc5094be
Jul 17 18:26:49.433413 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:49.433380    2572 generic.go:356] "Generic (PLEG): container finished" podID="b7a3f452-fa0c-4763-8469-effe6c26b42e" containerID="365056a7c4408d32aed4c6907c9b9f1d072d722b6a7b3a8ec6d7e9f32ecc51d4" exitCode=1
Jul 17 18:26:49.433791 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:49.433456    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" event={"ID":"b7a3f452-fa0c-4763-8469-effe6c26b42e","Type":"ContainerDied","Data":"365056a7c4408d32aed4c6907c9b9f1d072d722b6a7b3a8ec6d7e9f32ecc51d4"}
Jul 17 18:26:49.433791 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:49.433505    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" event={"ID":"b7a3f452-fa0c-4763-8469-effe6c26b42e","Type":"ContainerStarted","Data":"690552b80107dc72d80681f023144dc9ff29470ea28762235649e01cbc5094be"}
Jul 17 18:26:49.433791 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:49.433680    2572 scope.go:117] "RemoveContainer" containerID="365056a7c4408d32aed4c6907c9b9f1d072d722b6a7b3a8ec6d7e9f32ecc51d4"
Jul 17 18:26:50.088827 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:50.088792    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:26:50.439831 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:50.439803    2572 generic.go:356] "Generic (PLEG): container finished" podID="b7a3f452-fa0c-4763-8469-effe6c26b42e" containerID="a959fff011d72c65498acb0c2b754cf2856cbc794371580ffb7b5fc0ad9526ed" exitCode=1
Jul 17 18:26:50.440312 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:50.439894    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" event={"ID":"b7a3f452-fa0c-4763-8469-effe6c26b42e","Type":"ContainerDied","Data":"a959fff011d72c65498acb0c2b754cf2856cbc794371580ffb7b5fc0ad9526ed"}
Jul 17 18:26:50.440312 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:50.439968    2572 scope.go:117] "RemoveContainer" containerID="365056a7c4408d32aed4c6907c9b9f1d072d722b6a7b3a8ec6d7e9f32ecc51d4"
Jul 17 18:26:50.440312 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:50.440281    2572 scope.go:117] "RemoveContainer" containerID="a959fff011d72c65498acb0c2b754cf2856cbc794371580ffb7b5fc0ad9526ed"
Jul 17 18:26:50.440554 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:26:50.440527    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:26:50.466328 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:50.466304    2572 scope.go:117] "RemoveContainer" containerID="3a22550b0883f65906a2b03f8aabe6e9c830d068e1a2e8abdf7f78656ffdfc2d"
Jul 17 18:26:51.446812 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:51.446785    2572 scope.go:117] "RemoveContainer" containerID="a959fff011d72c65498acb0c2b754cf2856cbc794371580ffb7b5fc0ad9526ed"
Jul 17 18:26:51.447294 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:26:51.447061    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:26:51.448332 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:51.448309    2572 generic.go:356] "Generic (PLEG): container finished" podID="7ebba954-bc90-4a40-a579-33e4e191b549" containerID="867382f2b4d715f14f8f64efee2fe12bce8b2f567a02e87af95f875fcd059205" exitCode=6
Jul 17 18:26:51.448468 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:51.448382    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-6g2tl" event={"ID":"7ebba954-bc90-4a40-a579-33e4e191b549","Type":"ContainerDied","Data":"867382f2b4d715f14f8f64efee2fe12bce8b2f567a02e87af95f875fcd059205"}
Jul 17 18:26:51.448468 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:51.448445    2572 scope.go:117] "RemoveContainer" containerID="3a22550b0883f65906a2b03f8aabe6e9c830d068e1a2e8abdf7f78656ffdfc2d"
Jul 17 18:26:51.448752 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:51.448736    2572 scope.go:117] "RemoveContainer" containerID="867382f2b4d715f14f8f64efee2fe12bce8b2f567a02e87af95f875fcd059205"
Jul 17 18:26:51.448969 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:26:51.448950    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-35dc36c4-6g2tl_odh-ai-gateway-infra(7ebba954-bc90-4a40-a579-33e4e191b549)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-6g2tl" podUID="7ebba954-bc90-4a40-a579-33e4e191b549"
Jul 17 18:26:52.490653 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:52.490617    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-6g2tl"]
Jul 17 18:26:52.651378 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:52.651349    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-6g2tl"
Jul 17 18:26:52.698071 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:52.696591    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ebba954-bc90-4a40-a579-33e4e191b549-maas-api-service-ca\") pod \"7ebba954-bc90-4a40-a579-33e4e191b549\" (UID: \"7ebba954-bc90-4a40-a579-33e4e191b549\") "
Jul 17 18:26:52.698071 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:52.697264    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ebba954-bc90-4a40-a579-33e4e191b549-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7ebba954-bc90-4a40-a579-33e4e191b549" (UID: "7ebba954-bc90-4a40-a579-33e4e191b549"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:26:52.711423 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:52.711381    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lgkwb"]
Jul 17 18:26:52.711840 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:52.711824    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ebba954-bc90-4a40-a579-33e4e191b549" containerName="revoke-keys"
Jul 17 18:26:52.711840 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:52.711840    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ebba954-bc90-4a40-a579-33e4e191b549" containerName="revoke-keys"
Jul 17 18:26:52.711964 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:52.711855    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ebba954-bc90-4a40-a579-33e4e191b549" containerName="revoke-keys"
Jul 17 18:26:52.711964 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:52.711861    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ebba954-bc90-4a40-a579-33e4e191b549" containerName="revoke-keys"
Jul 17 18:26:52.711964 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:52.711866    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ebba954-bc90-4a40-a579-33e4e191b549" containerName="revoke-keys"
Jul 17 18:26:52.711964 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:52.711874    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ebba954-bc90-4a40-a579-33e4e191b549" containerName="revoke-keys"
Jul 17 18:26:52.711964 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:52.711933    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ebba954-bc90-4a40-a579-33e4e191b549" containerName="revoke-keys"
Jul 17 18:26:52.711964 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:52.711942    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ebba954-bc90-4a40-a579-33e4e191b549" containerName="revoke-keys"
Jul 17 18:26:52.711964 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:52.711952    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaf7669e-bec7-4b46-9c5d-4e52815660f7" containerName="maas-api"
Jul 17 18:26:52.714807 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:52.714787    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lgkwb"
Jul 17 18:26:52.724270 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:52.724243    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lgkwb"]
Jul 17 18:26:52.798113 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:52.797991    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/961377df-7690-4de7-b349-78fc1bb5c749-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a5b144da-lgkwb\" (UID: \"961377df-7690-4de7-b349-78fc1bb5c749\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lgkwb"
Jul 17 18:26:52.798113 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:52.798114    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ebba954-bc90-4a40-a579-33e4e191b549-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:26:52.899584 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:52.899543    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/961377df-7690-4de7-b349-78fc1bb5c749-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a5b144da-lgkwb\" (UID: \"961377df-7690-4de7-b349-78fc1bb5c749\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lgkwb"
Jul 17 18:26:52.900238 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:52.900218    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/961377df-7690-4de7-b349-78fc1bb5c749-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a5b144da-lgkwb\" (UID: \"961377df-7690-4de7-b349-78fc1bb5c749\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lgkwb"
Jul 17 18:26:53.026212 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:53.026177    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lgkwb"
Jul 17 18:26:53.213887 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:53.213859    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lgkwb"]
Jul 17 18:26:53.216425 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:26:53.216398    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod961377df_7690_4de7_b349_78fc1bb5c749.slice/crio-9d2dfcb5150fbc478cc67794a4a5d7f3887805b31776d960fb335d43dff0d1e2 WatchSource:0}: Error finding container 9d2dfcb5150fbc478cc67794a4a5d7f3887805b31776d960fb335d43dff0d1e2: Status 404 returned error can't find the container with id 9d2dfcb5150fbc478cc67794a4a5d7f3887805b31776d960fb335d43dff0d1e2
Jul 17 18:26:53.466045 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:53.462535    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-6g2tl" event={"ID":"7ebba954-bc90-4a40-a579-33e4e191b549","Type":"ContainerDied","Data":"fca83ec1462db2041a25f596e6f58a49d879b33206222d87038028a1df2686e0"}
Jul 17 18:26:53.466045 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:53.462612    2572 scope.go:117] "RemoveContainer" containerID="867382f2b4d715f14f8f64efee2fe12bce8b2f567a02e87af95f875fcd059205"
Jul 17 18:26:53.466045 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:53.462724    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-6g2tl"
Jul 17 18:26:53.500403 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:53.500364    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lgkwb" event={"ID":"961377df-7690-4de7-b349-78fc1bb5c749","Type":"ContainerStarted","Data":"9d2dfcb5150fbc478cc67794a4a5d7f3887805b31776d960fb335d43dff0d1e2"}
Jul 17 18:26:53.513210 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:53.513178    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-6g2tl"]
Jul 17 18:26:53.516553 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:53.516526    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-6g2tl"]
Jul 17 18:26:53.559684 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:53.559652    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g"
Jul 17 18:26:53.560144 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:53.560129    2572 scope.go:117] "RemoveContainer" containerID="a959fff011d72c65498acb0c2b754cf2856cbc794371580ffb7b5fc0ad9526ed"
Jul 17 18:26:53.560344 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:26:53.560317    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:26:54.502329 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:54.502289    2572 generic.go:356] "Generic (PLEG): container finished" podID="961377df-7690-4de7-b349-78fc1bb5c749" containerID="cb715923259c669178cd0bfb6cfedf4b30cf77e59913a518bf780fa4ca137505" exitCode=7
Jul 17 18:26:54.502329 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:54.502330    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lgkwb" event={"ID":"961377df-7690-4de7-b349-78fc1bb5c749","Type":"ContainerDied","Data":"cb715923259c669178cd0bfb6cfedf4b30cf77e59913a518bf780fa4ca137505"}
Jul 17 18:26:54.502735 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:54.502555    2572 scope.go:117] "RemoveContainer" containerID="cb715923259c669178cd0bfb6cfedf4b30cf77e59913a518bf780fa4ca137505"
Jul 17 18:26:55.480609 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:55.480566    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ebba954-bc90-4a40-a579-33e4e191b549" path="/var/lib/kubelet/pods/7ebba954-bc90-4a40-a579-33e4e191b549/volumes"
Jul 17 18:26:55.508493 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:55.508463    2572 generic.go:356] "Generic (PLEG): container finished" podID="961377df-7690-4de7-b349-78fc1bb5c749" containerID="d16b9747e9edcb74fe2bf7f2c20f7bf59dca929017217c2d7d41396be021a08a" exitCode=7
Jul 17 18:26:55.508942 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:55.508544    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lgkwb" event={"ID":"961377df-7690-4de7-b349-78fc1bb5c749","Type":"ContainerDied","Data":"d16b9747e9edcb74fe2bf7f2c20f7bf59dca929017217c2d7d41396be021a08a"}
Jul 17 18:26:55.508942 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:55.508608    2572 scope.go:117] "RemoveContainer" containerID="cb715923259c669178cd0bfb6cfedf4b30cf77e59913a518bf780fa4ca137505"
Jul 17 18:26:55.508942 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:55.508809    2572 scope.go:117] "RemoveContainer" containerID="d16b9747e9edcb74fe2bf7f2c20f7bf59dca929017217c2d7d41396be021a08a"
Jul 17 18:26:55.509123 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:26:55.509098    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a5b144da-lgkwb_odh-ai-gateway-infra(961377df-7690-4de7-b349-78fc1bb5c749)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lgkwb" podUID="961377df-7690-4de7-b349-78fc1bb5c749"
Jul 17 18:26:56.514655 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:56.514629    2572 scope.go:117] "RemoveContainer" containerID="d16b9747e9edcb74fe2bf7f2c20f7bf59dca929017217c2d7d41396be021a08a"
Jul 17 18:26:56.515084 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:26:56.514839    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a5b144da-lgkwb_odh-ai-gateway-infra(961377df-7690-4de7-b349-78fc1bb5c749)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lgkwb" podUID="961377df-7690-4de7-b349-78fc1bb5c749"
Jul 17 18:26:58.559699 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:58.559667    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g"
Jul 17 18:26:58.560104 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:58.560031    2572 scope.go:117] "RemoveContainer" containerID="a959fff011d72c65498acb0c2b754cf2856cbc794371580ffb7b5fc0ad9526ed"
Jul 17 18:26:58.560204 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:26:58.560186    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:26:59.532557 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:59.532469    2572 generic.go:356] "Generic (PLEG): container finished" podID="a4b84b29-e955-45bb-a1ef-7e0d9245a2cb" containerID="b132a2970888ede0ee4e35f2e29726227d2e55feb65c200fb2d18417681dfcb9" exitCode=0
Jul 17 18:26:59.532557 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:59.532522    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6" event={"ID":"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb","Type":"ContainerDied","Data":"b132a2970888ede0ee4e35f2e29726227d2e55feb65c200fb2d18417681dfcb9"}
Jul 17 18:26:59.532984 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:59.532965    2572 scope.go:117] "RemoveContainer" containerID="b132a2970888ede0ee4e35f2e29726227d2e55feb65c200fb2d18417681dfcb9"
Jul 17 18:26:59.534049 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:59.534013    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:26:59.534118 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:59.534090    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:26:59.534165 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:26:59.534150    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:27:00.539633 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:00.539597    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6" event={"ID":"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb","Type":"ContainerStarted","Data":"255f4a9af6d4b967af8ea25e08090903b886d6bffeac4ea0a3bbecd99e1fc36a"}
Jul 17 18:27:00.719421 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:00.719388    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:27:00.720443 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:00.720415    2572 patch_prober.go:28] interesting pod/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 17 18:27:00.720581 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:00.720472    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6" podUID="a4b84b29-e955-45bb-a1ef-7e0d9245a2cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 17 18:27:01.719029 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:01.718965    2572 patch_prober.go:28] interesting pod/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 17 18:27:01.719444 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:01.719060    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6" podUID="a4b84b29-e955-45bb-a1ef-7e0d9245a2cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 17 18:27:02.719442 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:02.719402    2572 patch_prober.go:28] interesting pod/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 17 18:27:02.719847 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:02.719466    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6" podUID="a4b84b29-e955-45bb-a1ef-7e0d9245a2cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 17 18:27:03.426687 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:03.426644    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:27:03.719746 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:03.719708    2572 patch_prober.go:28] interesting pod/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 17 18:27:03.720218 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:03.719781    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6" podUID="a4b84b29-e955-45bb-a1ef-7e0d9245a2cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 17 18:27:04.719855 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:04.719816    2572 patch_prober.go:28] interesting pod/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Jul 17 18:27:04.720284 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:04.719872    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6" podUID="a4b84b29-e955-45bb-a1ef-7e0d9245a2cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Jul 17 18:27:05.722664 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:05.722631    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:27:05.723610 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:05.723594    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:27:11.465530 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:11.465500    2572 scope.go:117] "RemoveContainer" containerID="a959fff011d72c65498acb0c2b754cf2856cbc794371580ffb7b5fc0ad9526ed"
Jul 17 18:27:11.465989 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:11.465610    2572 scope.go:117] "RemoveContainer" containerID="d16b9747e9edcb74fe2bf7f2c20f7bf59dca929017217c2d7d41396be021a08a"
Jul 17 18:27:12.612489 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:12.612459    2572 generic.go:356] "Generic (PLEG): container finished" podID="b7a3f452-fa0c-4763-8469-effe6c26b42e" containerID="1c49dd107f026d4c26121dd03a81d5b122de2988d1a0b1dc5e767f265765a3d1" exitCode=1
Jul 17 18:27:12.612912 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:12.612530    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" event={"ID":"b7a3f452-fa0c-4763-8469-effe6c26b42e","Type":"ContainerDied","Data":"1c49dd107f026d4c26121dd03a81d5b122de2988d1a0b1dc5e767f265765a3d1"}
Jul 17 18:27:12.612912 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:12.612587    2572 scope.go:117] "RemoveContainer" containerID="a959fff011d72c65498acb0c2b754cf2856cbc794371580ffb7b5fc0ad9526ed"
Jul 17 18:27:12.613055 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:12.612926    2572 scope.go:117] "RemoveContainer" containerID="1c49dd107f026d4c26121dd03a81d5b122de2988d1a0b1dc5e767f265765a3d1"
Jul 17 18:27:12.613212 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:27:12.613182    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:27:12.614480 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:12.614461    2572 generic.go:356] "Generic (PLEG): container finished" podID="961377df-7690-4de7-b349-78fc1bb5c749" containerID="398295c2fcd757cece6ad1c3ee8b01df693bbd67406efd22fda6da9267c21b3f" exitCode=7
Jul 17 18:27:12.614572 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:12.614530    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lgkwb" event={"ID":"961377df-7690-4de7-b349-78fc1bb5c749","Type":"ContainerDied","Data":"398295c2fcd757cece6ad1c3ee8b01df693bbd67406efd22fda6da9267c21b3f"}
Jul 17 18:27:12.614766 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:12.614753    2572 scope.go:117] "RemoveContainer" containerID="398295c2fcd757cece6ad1c3ee8b01df693bbd67406efd22fda6da9267c21b3f"
Jul 17 18:27:12.614926 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:27:12.614910    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a5b144da-lgkwb_odh-ai-gateway-infra(961377df-7690-4de7-b349-78fc1bb5c749)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lgkwb" podUID="961377df-7690-4de7-b349-78fc1bb5c749"
Jul 17 18:27:12.623507 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:12.623492    2572 scope.go:117] "RemoveContainer" containerID="d16b9747e9edcb74fe2bf7f2c20f7bf59dca929017217c2d7d41396be021a08a"
Jul 17 18:27:13.559871 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:13.559836    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g"
Jul 17 18:27:13.621642 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:13.621615    2572 scope.go:117] "RemoveContainer" containerID="1c49dd107f026d4c26121dd03a81d5b122de2988d1a0b1dc5e767f265765a3d1"
Jul 17 18:27:13.622138 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:27:13.621828    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:27:13.657093 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:13.657062    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lgkwb"]
Jul 17 18:27:13.796499 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:13.796472    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lgkwb"
Jul 17 18:27:13.899103 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:13.898964    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/961377df-7690-4de7-b349-78fc1bb5c749-maas-api-service-ca\") pod \"961377df-7690-4de7-b349-78fc1bb5c749\" (UID: \"961377df-7690-4de7-b349-78fc1bb5c749\") "
Jul 17 18:27:13.899335 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:13.899311    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/961377df-7690-4de7-b349-78fc1bb5c749-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "961377df-7690-4de7-b349-78fc1bb5c749" (UID: "961377df-7690-4de7-b349-78fc1bb5c749"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:27:13.999922 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:13.999888    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/961377df-7690-4de7-b349-78fc1bb5c749-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:27:14.635378 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:14.635351    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lgkwb"
Jul 17 18:27:14.635808 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:14.635388    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lgkwb" event={"ID":"961377df-7690-4de7-b349-78fc1bb5c749","Type":"ContainerDied","Data":"9d2dfcb5150fbc478cc67794a4a5d7f3887805b31776d960fb335d43dff0d1e2"}
Jul 17 18:27:14.635808 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:14.635473    2572 scope.go:117] "RemoveContainer" containerID="398295c2fcd757cece6ad1c3ee8b01df693bbd67406efd22fda6da9267c21b3f"
Jul 17 18:27:14.682878 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:14.682843    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lgkwb"]
Jul 17 18:27:14.694835 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:14.694806    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lgkwb"]
Jul 17 18:27:15.471504 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:15.471466    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="961377df-7690-4de7-b349-78fc1bb5c749" path="/var/lib/kubelet/pods/961377df-7690-4de7-b349-78fc1bb5c749/volumes"
Jul 17 18:27:18.559883 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:18.559833    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g"
Jul 17 18:27:18.560345 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:18.560299    2572 scope.go:117] "RemoveContainer" containerID="1c49dd107f026d4c26121dd03a81d5b122de2988d1a0b1dc5e767f265765a3d1"
Jul 17 18:27:18.560494 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:27:18.560473    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:27:24.526522 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:24.526477    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lp92r"]
Jul 17 18:27:24.527072 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:24.527052    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="961377df-7690-4de7-b349-78fc1bb5c749" containerName="revoke-keys"
Jul 17 18:27:24.527168 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:24.527075    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="961377df-7690-4de7-b349-78fc1bb5c749" containerName="revoke-keys"
Jul 17 18:27:24.527168 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:24.527093    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="961377df-7690-4de7-b349-78fc1bb5c749" containerName="revoke-keys"
Jul 17 18:27:24.527168 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:24.527101    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="961377df-7690-4de7-b349-78fc1bb5c749" containerName="revoke-keys"
Jul 17 18:27:24.527332 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:24.527241    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="961377df-7690-4de7-b349-78fc1bb5c749" containerName="revoke-keys"
Jul 17 18:27:24.527332 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:24.527254    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="961377df-7690-4de7-b349-78fc1bb5c749" containerName="revoke-keys"
Jul 17 18:27:24.527332 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:24.527269    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ebba954-bc90-4a40-a579-33e4e191b549" containerName="revoke-keys"
Jul 17 18:27:24.527332 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:24.527278    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="961377df-7690-4de7-b349-78fc1bb5c749" containerName="revoke-keys"
Jul 17 18:27:24.530619 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:24.530595    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lp92r"
Jul 17 18:27:24.533877 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:24.533852    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:27:24.539793 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:24.539770    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lp92r"]
Jul 17 18:27:24.599921 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:24.599875    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42ff0338-358f-4df7-a6c7-cbfce1808e93-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35dc36c4-lp92r\" (UID: \"42ff0338-358f-4df7-a6c7-cbfce1808e93\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lp92r"
Jul 17 18:27:24.701354 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:24.701316    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42ff0338-358f-4df7-a6c7-cbfce1808e93-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35dc36c4-lp92r\" (UID: \"42ff0338-358f-4df7-a6c7-cbfce1808e93\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lp92r"
Jul 17 18:27:24.702054 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:24.702031    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42ff0338-358f-4df7-a6c7-cbfce1808e93-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35dc36c4-lp92r\" (UID: \"42ff0338-358f-4df7-a6c7-cbfce1808e93\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lp92r"
Jul 17 18:27:24.842867 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:24.842780    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lp92r"
Jul 17 18:27:24.980312 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:24.980283    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lp92r"]
Jul 17 18:27:24.983530 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:27:24.983496    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42ff0338_358f_4df7_a6c7_cbfce1808e93.slice/crio-e0c2b91a1008fb1891efe6fd7f16c8f583a8c1cd78791018394b6b9e7bf8f366 WatchSource:0}: Error finding container e0c2b91a1008fb1891efe6fd7f16c8f583a8c1cd78791018394b6b9e7bf8f366: Status 404 returned error can't find the container with id e0c2b91a1008fb1891efe6fd7f16c8f583a8c1cd78791018394b6b9e7bf8f366
Jul 17 18:27:25.691180 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:25.691138    2572 generic.go:356] "Generic (PLEG): container finished" podID="42ff0338-358f-4df7-a6c7-cbfce1808e93" containerID="10b52f08dd9ec1a5b30a51937b2586ca80f404d6ceb6fdf01e66108127f391a9" exitCode=6
Jul 17 18:27:25.691565 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:25.691218    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lp92r" event={"ID":"42ff0338-358f-4df7-a6c7-cbfce1808e93","Type":"ContainerDied","Data":"10b52f08dd9ec1a5b30a51937b2586ca80f404d6ceb6fdf01e66108127f391a9"}
Jul 17 18:27:25.691565 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:25.691262    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lp92r" event={"ID":"42ff0338-358f-4df7-a6c7-cbfce1808e93","Type":"ContainerStarted","Data":"e0c2b91a1008fb1891efe6fd7f16c8f583a8c1cd78791018394b6b9e7bf8f366"}
Jul 17 18:27:25.691565 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:25.691399    2572 scope.go:117] "RemoveContainer" containerID="10b52f08dd9ec1a5b30a51937b2586ca80f404d6ceb6fdf01e66108127f391a9"
Jul 17 18:27:26.698436 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:26.698404    2572 generic.go:356] "Generic (PLEG): container finished" podID="42ff0338-358f-4df7-a6c7-cbfce1808e93" containerID="609d5a6b66db50e7ab475797300b44db4ba24aed7243141ad9ed28edb1575927" exitCode=6
Jul 17 18:27:26.698949 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:26.698452    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lp92r" event={"ID":"42ff0338-358f-4df7-a6c7-cbfce1808e93","Type":"ContainerDied","Data":"609d5a6b66db50e7ab475797300b44db4ba24aed7243141ad9ed28edb1575927"}
Jul 17 18:27:26.698949 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:26.698500    2572 scope.go:117] "RemoveContainer" containerID="10b52f08dd9ec1a5b30a51937b2586ca80f404d6ceb6fdf01e66108127f391a9"
Jul 17 18:27:26.698949 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:26.698761    2572 scope.go:117] "RemoveContainer" containerID="609d5a6b66db50e7ab475797300b44db4ba24aed7243141ad9ed28edb1575927"
Jul 17 18:27:26.699133 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:27:26.699049    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-35dc36c4-lp92r_odh-ai-gateway-infra(42ff0338-358f-4df7-a6c7-cbfce1808e93)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lp92r" podUID="42ff0338-358f-4df7-a6c7-cbfce1808e93"
Jul 17 18:27:27.705238 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:27.705207    2572 scope.go:117] "RemoveContainer" containerID="609d5a6b66db50e7ab475797300b44db4ba24aed7243141ad9ed28edb1575927"
Jul 17 18:27:27.705749 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:27:27.705432    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-35dc36c4-lp92r_odh-ai-gateway-infra(42ff0338-358f-4df7-a6c7-cbfce1808e93)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lp92r" podUID="42ff0338-358f-4df7-a6c7-cbfce1808e93"
Jul 17 18:27:31.466401 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:31.466370    2572 scope.go:117] "RemoveContainer" containerID="1c49dd107f026d4c26121dd03a81d5b122de2988d1a0b1dc5e767f265765a3d1"
Jul 17 18:27:31.466830 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:27:31.466553    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:27:39.466429 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:39.466338    2572 scope.go:117] "RemoveContainer" containerID="609d5a6b66db50e7ab475797300b44db4ba24aed7243141ad9ed28edb1575927"
Jul 17 18:27:39.770967 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:39.770882    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lp92r" event={"ID":"42ff0338-358f-4df7-a6c7-cbfce1808e93","Type":"ContainerStarted","Data":"fa40e8641aea1310d50995558a8f44ea8d6ae6870b73bcb8d94a0ab82802fc2b"}
Jul 17 18:27:39.798239 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:39.798178    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lp92r" podStartSLOduration=15.798162155 podStartE2EDuration="15.798162155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:27:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:27:39.797413311 +0000 UTC m=+1887.022642619" watchObservedRunningTime="2026-07-17 18:27:39.798162155 +0000 UTC m=+1887.023391462"
Jul 17 18:27:40.777695 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:40.777656    2572 generic.go:356] "Generic (PLEG): container finished" podID="42ff0338-358f-4df7-a6c7-cbfce1808e93" containerID="fa40e8641aea1310d50995558a8f44ea8d6ae6870b73bcb8d94a0ab82802fc2b" exitCode=6
Jul 17 18:27:40.778138 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:40.777714    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lp92r" event={"ID":"42ff0338-358f-4df7-a6c7-cbfce1808e93","Type":"ContainerDied","Data":"fa40e8641aea1310d50995558a8f44ea8d6ae6870b73bcb8d94a0ab82802fc2b"}
Jul 17 18:27:40.778138 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:40.777784    2572 scope.go:117] "RemoveContainer" containerID="609d5a6b66db50e7ab475797300b44db4ba24aed7243141ad9ed28edb1575927"
Jul 17 18:27:40.778254 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:40.778163    2572 scope.go:117] "RemoveContainer" containerID="fa40e8641aea1310d50995558a8f44ea8d6ae6870b73bcb8d94a0ab82802fc2b"
Jul 17 18:27:40.778376 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:27:40.778352    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-35dc36c4-lp92r_odh-ai-gateway-infra(42ff0338-358f-4df7-a6c7-cbfce1808e93)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lp92r" podUID="42ff0338-358f-4df7-a6c7-cbfce1808e93"
Jul 17 18:27:40.814349 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:40.814308    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lp92r"]
Jul 17 18:27:41.923433 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:41.923406    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lp92r"
Jul 17 18:27:41.959132 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:41.959099    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42ff0338-358f-4df7-a6c7-cbfce1808e93-maas-api-service-ca\") pod \"42ff0338-358f-4df7-a6c7-cbfce1808e93\" (UID: \"42ff0338-358f-4df7-a6c7-cbfce1808e93\") "
Jul 17 18:27:41.959561 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:41.959450    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42ff0338-358f-4df7-a6c7-cbfce1808e93-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "42ff0338-358f-4df7-a6c7-cbfce1808e93" (UID: "42ff0338-358f-4df7-a6c7-cbfce1808e93"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:27:42.060307 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:42.060203    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/42ff0338-358f-4df7-a6c7-cbfce1808e93-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:27:42.790647 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:42.790618    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lp92r"
Jul 17 18:27:42.790928 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:42.790664    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lp92r" event={"ID":"42ff0338-358f-4df7-a6c7-cbfce1808e93","Type":"ContainerDied","Data":"e0c2b91a1008fb1891efe6fd7f16c8f583a8c1cd78791018394b6b9e7bf8f366"}
Jul 17 18:27:42.790928 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:42.790729    2572 scope.go:117] "RemoveContainer" containerID="fa40e8641aea1310d50995558a8f44ea8d6ae6870b73bcb8d94a0ab82802fc2b"
Jul 17 18:27:42.811987 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:42.811956    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lp92r"]
Jul 17 18:27:42.816409 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:42.816385    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lp92r"]
Jul 17 18:27:43.472877 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:43.472842    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42ff0338-358f-4df7-a6c7-cbfce1808e93" path="/var/lib/kubelet/pods/42ff0338-358f-4df7-a6c7-cbfce1808e93/volumes"
Jul 17 18:27:44.465691 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:44.465653    2572 scope.go:117] "RemoveContainer" containerID="1c49dd107f026d4c26121dd03a81d5b122de2988d1a0b1dc5e767f265765a3d1"
Jul 17 18:27:44.465941 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:44.465926    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 18:27:45.808048 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:45.808017    2572 generic.go:356] "Generic (PLEG): container finished" podID="b7a3f452-fa0c-4763-8469-effe6c26b42e" containerID="1246beb142d1797678d768d8075bf05ef1d2576a5dbdf011b7687d308097e648" exitCode=1
Jul 17 18:27:45.808472 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:45.808087    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" event={"ID":"b7a3f452-fa0c-4763-8469-effe6c26b42e","Type":"ContainerDied","Data":"1246beb142d1797678d768d8075bf05ef1d2576a5dbdf011b7687d308097e648"}
Jul 17 18:27:45.808472 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:45.808152    2572 scope.go:117] "RemoveContainer" containerID="1c49dd107f026d4c26121dd03a81d5b122de2988d1a0b1dc5e767f265765a3d1"
Jul 17 18:27:45.808587 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:45.808487    2572 scope.go:117] "RemoveContainer" containerID="1246beb142d1797678d768d8075bf05ef1d2576a5dbdf011b7687d308097e648"
Jul 17 18:27:45.808747 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:27:45.808727    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:27:48.559246 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:48.559209    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g"
Jul 17 18:27:48.559716 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:48.559288    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g"
Jul 17 18:27:48.559716 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:48.559708    2572 scope.go:117] "RemoveContainer" containerID="1246beb142d1797678d768d8075bf05ef1d2576a5dbdf011b7687d308097e648"
Jul 17 18:27:48.559957 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:27:48.559933    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:27:52.758805 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:52.758767    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-pspzw"]
Jul 17 18:27:52.759224 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:52.759160    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="961377df-7690-4de7-b349-78fc1bb5c749" containerName="revoke-keys"
Jul 17 18:27:52.759224 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:52.759171    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="961377df-7690-4de7-b349-78fc1bb5c749" containerName="revoke-keys"
Jul 17 18:27:52.759224 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:52.759179    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42ff0338-358f-4df7-a6c7-cbfce1808e93" containerName="revoke-keys"
Jul 17 18:27:52.759224 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:52.759184    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="42ff0338-358f-4df7-a6c7-cbfce1808e93" containerName="revoke-keys"
Jul 17 18:27:52.759224 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:52.759211    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42ff0338-358f-4df7-a6c7-cbfce1808e93" containerName="revoke-keys"
Jul 17 18:27:52.759224 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:52.759218    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="42ff0338-358f-4df7-a6c7-cbfce1808e93" containerName="revoke-keys"
Jul 17 18:27:52.759420 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:52.759295    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="42ff0338-358f-4df7-a6c7-cbfce1808e93" containerName="revoke-keys"
Jul 17 18:27:52.759420 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:52.759303    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="42ff0338-358f-4df7-a6c7-cbfce1808e93" containerName="revoke-keys"
Jul 17 18:27:52.759420 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:52.759310    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="42ff0338-358f-4df7-a6c7-cbfce1808e93" containerName="revoke-keys"
Jul 17 18:27:52.762424 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:52.762405    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-pspzw"
Jul 17 18:27:52.765170 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:52.765142    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:27:52.773157 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:52.773131    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-pspzw"]
Jul 17 18:27:52.867476 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:52.867441    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e53eccda-1c4b-4ca6-8d34-f7ce57564d6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a5b144da-pspzw\" (UID: \"e53eccda-1c4b-4ca6-8d34-f7ce57564d6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-pspzw"
Jul 17 18:27:52.968359 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:52.968318    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e53eccda-1c4b-4ca6-8d34-f7ce57564d6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a5b144da-pspzw\" (UID: \"e53eccda-1c4b-4ca6-8d34-f7ce57564d6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-pspzw"
Jul 17 18:27:52.968989 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:52.968968    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e53eccda-1c4b-4ca6-8d34-f7ce57564d6f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a5b144da-pspzw\" (UID: \"e53eccda-1c4b-4ca6-8d34-f7ce57564d6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-pspzw"
Jul 17 18:27:53.073673 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:53.073583    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-pspzw"
Jul 17 18:27:53.217803 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:53.217772    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-pspzw"]
Jul 17 18:27:53.219982 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:27:53.219953    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode53eccda_1c4b_4ca6_8d34_f7ce57564d6f.slice/crio-c5074df4b17eedbe696032c58af08be1b6591a4d7bbd2429d911d7fe6a4fd166 WatchSource:0}: Error finding container c5074df4b17eedbe696032c58af08be1b6591a4d7bbd2429d911d7fe6a4fd166: Status 404 returned error can't find the container with id c5074df4b17eedbe696032c58af08be1b6591a4d7bbd2429d911d7fe6a4fd166
Jul 17 18:27:53.851106 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:53.851074    2572 generic.go:356] "Generic (PLEG): container finished" podID="e53eccda-1c4b-4ca6-8d34-f7ce57564d6f" containerID="d858bc328754091cfd110f9ffa829d1642b7c1a689dd4d4896fac7356a072df1" exitCode=7
Jul 17 18:27:53.851519 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:53.851128    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-pspzw" event={"ID":"e53eccda-1c4b-4ca6-8d34-f7ce57564d6f","Type":"ContainerDied","Data":"d858bc328754091cfd110f9ffa829d1642b7c1a689dd4d4896fac7356a072df1"}
Jul 17 18:27:53.851519 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:53.851172    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-pspzw" event={"ID":"e53eccda-1c4b-4ca6-8d34-f7ce57564d6f","Type":"ContainerStarted","Data":"c5074df4b17eedbe696032c58af08be1b6591a4d7bbd2429d911d7fe6a4fd166"}
Jul 17 18:27:53.851519 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:53.851374    2572 scope.go:117] "RemoveContainer" containerID="d858bc328754091cfd110f9ffa829d1642b7c1a689dd4d4896fac7356a072df1"
Jul 17 18:27:54.857390 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:54.857301    2572 generic.go:356] "Generic (PLEG): container finished" podID="e53eccda-1c4b-4ca6-8d34-f7ce57564d6f" containerID="b5d7451feaede9820fa3313d96e31cabe8f86a88d694c330a6d7459ef391b775" exitCode=7
Jul 17 18:27:54.857390 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:54.857380    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-pspzw" event={"ID":"e53eccda-1c4b-4ca6-8d34-f7ce57564d6f","Type":"ContainerDied","Data":"b5d7451feaede9820fa3313d96e31cabe8f86a88d694c330a6d7459ef391b775"}
Jul 17 18:27:54.857837 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:54.857438    2572 scope.go:117] "RemoveContainer" containerID="d858bc328754091cfd110f9ffa829d1642b7c1a689dd4d4896fac7356a072df1"
Jul 17 18:27:54.857837 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:54.857661    2572 scope.go:117] "RemoveContainer" containerID="b5d7451feaede9820fa3313d96e31cabe8f86a88d694c330a6d7459ef391b775"
Jul 17 18:27:54.857913 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:27:54.857870    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a5b144da-pspzw_odh-ai-gateway-infra(e53eccda-1c4b-4ca6-8d34-f7ce57564d6f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-pspzw" podUID="e53eccda-1c4b-4ca6-8d34-f7ce57564d6f"
Jul 17 18:27:55.863502 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:27:55.863475    2572 scope.go:117] "RemoveContainer" containerID="b5d7451feaede9820fa3313d96e31cabe8f86a88d694c330a6d7459ef391b775"
Jul 17 18:27:55.863903 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:27:55.863671    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a5b144da-pspzw_odh-ai-gateway-infra(e53eccda-1c4b-4ca6-8d34-f7ce57564d6f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-pspzw" podUID="e53eccda-1c4b-4ca6-8d34-f7ce57564d6f"
Jul 17 18:28:03.468672 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:03.468638    2572 scope.go:117] "RemoveContainer" containerID="1246beb142d1797678d768d8075bf05ef1d2576a5dbdf011b7687d308097e648"
Jul 17 18:28:03.469210 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:28:03.468876    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:28:08.465873 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:08.465838    2572 scope.go:117] "RemoveContainer" containerID="b5d7451feaede9820fa3313d96e31cabe8f86a88d694c330a6d7459ef391b775"
Jul 17 18:28:08.928887 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:08.928801    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-pspzw" event={"ID":"e53eccda-1c4b-4ca6-8d34-f7ce57564d6f","Type":"ContainerStarted","Data":"38ef25b88f3d06c6f5774c64101e182da4ef91c36032443d9c75f52ff84d9214"}
Jul 17 18:28:08.945407 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:08.945353    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-pspzw" podStartSLOduration=16.945338226 podStartE2EDuration="16.945338226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:27:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:28:08.943755907 +0000 UTC m=+1916.168985216" watchObservedRunningTime="2026-07-17 18:28:08.945338226 +0000 UTC m=+1916.170567555"
Jul 17 18:28:09.935644 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:09.935613    2572 generic.go:356] "Generic (PLEG): container finished" podID="e53eccda-1c4b-4ca6-8d34-f7ce57564d6f" containerID="38ef25b88f3d06c6f5774c64101e182da4ef91c36032443d9c75f52ff84d9214" exitCode=7
Jul 17 18:28:09.936079 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:09.935676    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-pspzw" event={"ID":"e53eccda-1c4b-4ca6-8d34-f7ce57564d6f","Type":"ContainerDied","Data":"38ef25b88f3d06c6f5774c64101e182da4ef91c36032443d9c75f52ff84d9214"}
Jul 17 18:28:09.936079 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:09.935736    2572 scope.go:117] "RemoveContainer" containerID="b5d7451feaede9820fa3313d96e31cabe8f86a88d694c330a6d7459ef391b775"
Jul 17 18:28:09.936079 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:09.936065    2572 scope.go:117] "RemoveContainer" containerID="38ef25b88f3d06c6f5774c64101e182da4ef91c36032443d9c75f52ff84d9214"
Jul 17 18:28:09.936292 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:28:09.936272    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a5b144da-pspzw_odh-ai-gateway-infra(e53eccda-1c4b-4ca6-8d34-f7ce57564d6f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-pspzw" podUID="e53eccda-1c4b-4ca6-8d34-f7ce57564d6f"
Jul 17 18:28:09.954108 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:09.954079    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-pspzw"]
Jul 17 18:28:11.085554 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:11.085530    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-pspzw"
Jul 17 18:28:11.239443 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:11.239357    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e53eccda-1c4b-4ca6-8d34-f7ce57564d6f-maas-api-service-ca\") pod \"e53eccda-1c4b-4ca6-8d34-f7ce57564d6f\" (UID: \"e53eccda-1c4b-4ca6-8d34-f7ce57564d6f\") "
Jul 17 18:28:11.239784 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:11.239762    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e53eccda-1c4b-4ca6-8d34-f7ce57564d6f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e53eccda-1c4b-4ca6-8d34-f7ce57564d6f" (UID: "e53eccda-1c4b-4ca6-8d34-f7ce57564d6f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:28:11.341041 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:11.340981    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e53eccda-1c4b-4ca6-8d34-f7ce57564d6f-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:28:11.948649 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:11.948613    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-pspzw"
Jul 17 18:28:11.948837 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:11.948651    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-pspzw" event={"ID":"e53eccda-1c4b-4ca6-8d34-f7ce57564d6f","Type":"ContainerDied","Data":"c5074df4b17eedbe696032c58af08be1b6591a4d7bbd2429d911d7fe6a4fd166"}
Jul 17 18:28:11.948837 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:11.948714    2572 scope.go:117] "RemoveContainer" containerID="38ef25b88f3d06c6f5774c64101e182da4ef91c36032443d9c75f52ff84d9214"
Jul 17 18:28:11.965150 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:11.965120    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-pspzw"]
Jul 17 18:28:11.970855 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:11.970823    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-pspzw"]
Jul 17 18:28:13.472146 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:13.472113    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e53eccda-1c4b-4ca6-8d34-f7ce57564d6f" path="/var/lib/kubelet/pods/e53eccda-1c4b-4ca6-8d34-f7ce57564d6f/volumes"
Jul 17 18:28:14.571451 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:14.571411    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-xwpj9"]
Jul 17 18:28:14.571952 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:14.571935    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42ff0338-358f-4df7-a6c7-cbfce1808e93" containerName="revoke-keys"
Jul 17 18:28:14.572031 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:14.571954    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="42ff0338-358f-4df7-a6c7-cbfce1808e93" containerName="revoke-keys"
Jul 17 18:28:14.572031 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:14.571969    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e53eccda-1c4b-4ca6-8d34-f7ce57564d6f" containerName="revoke-keys"
Jul 17 18:28:14.572031 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:14.571974    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e53eccda-1c4b-4ca6-8d34-f7ce57564d6f" containerName="revoke-keys"
Jul 17 18:28:14.572031 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:14.571983    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e53eccda-1c4b-4ca6-8d34-f7ce57564d6f" containerName="revoke-keys"
Jul 17 18:28:14.572031 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:14.571988    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e53eccda-1c4b-4ca6-8d34-f7ce57564d6f" containerName="revoke-keys"
Jul 17 18:28:14.572031 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:14.572016    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e53eccda-1c4b-4ca6-8d34-f7ce57564d6f" containerName="revoke-keys"
Jul 17 18:28:14.572031 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:14.572021    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e53eccda-1c4b-4ca6-8d34-f7ce57564d6f" containerName="revoke-keys"
Jul 17 18:28:14.572282 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:14.572082    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e53eccda-1c4b-4ca6-8d34-f7ce57564d6f" containerName="revoke-keys"
Jul 17 18:28:14.572282 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:14.572090    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e53eccda-1c4b-4ca6-8d34-f7ce57564d6f" containerName="revoke-keys"
Jul 17 18:28:14.572282 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:14.572095    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e53eccda-1c4b-4ca6-8d34-f7ce57564d6f" containerName="revoke-keys"
Jul 17 18:28:14.576669 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:14.576651    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-xwpj9"
Jul 17 18:28:14.579171 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:14.579154    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:28:14.583306 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:14.583219    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-xwpj9"]
Jul 17 18:28:14.672994 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:14.672949    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1388656c-8766-4d9d-bbe7-afa426a763a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35dc36c4-xwpj9\" (UID: \"1388656c-8766-4d9d-bbe7-afa426a763a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-xwpj9"
Jul 17 18:28:14.774463 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:14.774424    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1388656c-8766-4d9d-bbe7-afa426a763a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35dc36c4-xwpj9\" (UID: \"1388656c-8766-4d9d-bbe7-afa426a763a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-xwpj9"
Jul 17 18:28:14.775112 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:14.775092    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1388656c-8766-4d9d-bbe7-afa426a763a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35dc36c4-xwpj9\" (UID: \"1388656c-8766-4d9d-bbe7-afa426a763a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-xwpj9"
Jul 17 18:28:14.890497 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:14.890410    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-xwpj9"
Jul 17 18:28:15.028304 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:15.028276    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-xwpj9"]
Jul 17 18:28:15.030482 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:28:15.030457    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1388656c_8766_4d9d_bbe7_afa426a763a7.slice/crio-7b6947edaf40e4d6758076b35326437bd126c80e80f9e7ec050198fe0764afd5 WatchSource:0}: Error finding container 7b6947edaf40e4d6758076b35326437bd126c80e80f9e7ec050198fe0764afd5: Status 404 returned error can't find the container with id 7b6947edaf40e4d6758076b35326437bd126c80e80f9e7ec050198fe0764afd5
Jul 17 18:28:15.970363 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:15.970326    2572 generic.go:356] "Generic (PLEG): container finished" podID="1388656c-8766-4d9d-bbe7-afa426a763a7" containerID="296bb2e738a61eed211f360c80d7f382ae1573067945d1cbfce19923f795209d" exitCode=6
Jul 17 18:28:15.970846 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:15.970406    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-xwpj9" event={"ID":"1388656c-8766-4d9d-bbe7-afa426a763a7","Type":"ContainerDied","Data":"296bb2e738a61eed211f360c80d7f382ae1573067945d1cbfce19923f795209d"}
Jul 17 18:28:15.970846 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:15.970457    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-xwpj9" event={"ID":"1388656c-8766-4d9d-bbe7-afa426a763a7","Type":"ContainerStarted","Data":"7b6947edaf40e4d6758076b35326437bd126c80e80f9e7ec050198fe0764afd5"}
Jul 17 18:28:15.970846 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:15.970647    2572 scope.go:117] "RemoveContainer" containerID="296bb2e738a61eed211f360c80d7f382ae1573067945d1cbfce19923f795209d"
Jul 17 18:28:16.976887 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:16.976856    2572 generic.go:356] "Generic (PLEG): container finished" podID="1388656c-8766-4d9d-bbe7-afa426a763a7" containerID="0711cddcb77a5eaa7ff29ef8b2c7328cbed5848070fcda04ddc9a6b064e28708" exitCode=6
Jul 17 18:28:16.977327 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:16.976936    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-xwpj9" event={"ID":"1388656c-8766-4d9d-bbe7-afa426a763a7","Type":"ContainerDied","Data":"0711cddcb77a5eaa7ff29ef8b2c7328cbed5848070fcda04ddc9a6b064e28708"}
Jul 17 18:28:16.977327 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:16.976993    2572 scope.go:117] "RemoveContainer" containerID="296bb2e738a61eed211f360c80d7f382ae1573067945d1cbfce19923f795209d"
Jul 17 18:28:16.977327 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:16.977219    2572 scope.go:117] "RemoveContainer" containerID="0711cddcb77a5eaa7ff29ef8b2c7328cbed5848070fcda04ddc9a6b064e28708"
Jul 17 18:28:16.977475 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:28:16.977455    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-35dc36c4-xwpj9_odh-ai-gateway-infra(1388656c-8766-4d9d-bbe7-afa426a763a7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-xwpj9" podUID="1388656c-8766-4d9d-bbe7-afa426a763a7"
Jul 17 18:28:17.983533 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:17.983505    2572 scope.go:117] "RemoveContainer" containerID="0711cddcb77a5eaa7ff29ef8b2c7328cbed5848070fcda04ddc9a6b064e28708"
Jul 17 18:28:17.983919 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:28:17.983747    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-35dc36c4-xwpj9_odh-ai-gateway-infra(1388656c-8766-4d9d-bbe7-afa426a763a7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-xwpj9" podUID="1388656c-8766-4d9d-bbe7-afa426a763a7"
Jul 17 18:28:18.466154 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:18.466119    2572 scope.go:117] "RemoveContainer" containerID="1246beb142d1797678d768d8075bf05ef1d2576a5dbdf011b7687d308097e648"
Jul 17 18:28:18.466337 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:28:18.466300    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:28:29.465478 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:29.465447    2572 scope.go:117] "RemoveContainer" containerID="0711cddcb77a5eaa7ff29ef8b2c7328cbed5848070fcda04ddc9a6b064e28708"
Jul 17 18:28:30.042664 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:30.042579    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-xwpj9" event={"ID":"1388656c-8766-4d9d-bbe7-afa426a763a7","Type":"ContainerStarted","Data":"9fca1cbeba9c3e7d0b091e33169259ae6d2f3fb15756187e0a3d8b5a73486fab"}
Jul 17 18:28:30.060467 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:30.060413    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-xwpj9" podStartSLOduration=16.060396808 podStartE2EDuration="16.060396808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:28:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:28:30.058110607 +0000 UTC m=+1937.283339916" watchObservedRunningTime="2026-07-17 18:28:30.060396808 +0000 UTC m=+1937.285626116"
Jul 17 18:28:31.050061 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:31.050023    2572 generic.go:356] "Generic (PLEG): container finished" podID="1388656c-8766-4d9d-bbe7-afa426a763a7" containerID="9fca1cbeba9c3e7d0b091e33169259ae6d2f3fb15756187e0a3d8b5a73486fab" exitCode=6
Jul 17 18:28:31.050503 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:31.050094    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-xwpj9" event={"ID":"1388656c-8766-4d9d-bbe7-afa426a763a7","Type":"ContainerDied","Data":"9fca1cbeba9c3e7d0b091e33169259ae6d2f3fb15756187e0a3d8b5a73486fab"}
Jul 17 18:28:31.050503 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:31.050156    2572 scope.go:117] "RemoveContainer" containerID="0711cddcb77a5eaa7ff29ef8b2c7328cbed5848070fcda04ddc9a6b064e28708"
Jul 17 18:28:31.050503 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:31.050404    2572 scope.go:117] "RemoveContainer" containerID="9fca1cbeba9c3e7d0b091e33169259ae6d2f3fb15756187e0a3d8b5a73486fab"
Jul 17 18:28:31.050684 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:28:31.050662    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-35dc36c4-xwpj9_odh-ai-gateway-infra(1388656c-8766-4d9d-bbe7-afa426a763a7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-xwpj9" podUID="1388656c-8766-4d9d-bbe7-afa426a763a7"
Jul 17 18:28:31.067443 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:31.067416    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-xwpj9"]
Jul 17 18:28:31.465611 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:31.465575    2572 scope.go:117] "RemoveContainer" containerID="1246beb142d1797678d768d8075bf05ef1d2576a5dbdf011b7687d308097e648"
Jul 17 18:28:32.059866 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:32.059836    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" event={"ID":"b7a3f452-fa0c-4763-8469-effe6c26b42e","Type":"ContainerStarted","Data":"6824c99cfc9b63efd1678b2d4402d2409bc36af30b400827c383434c9dceb8c3"}
Jul 17 18:28:32.060256 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:32.060068    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g"
Jul 17 18:28:32.091401 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:32.091334    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podStartSLOduration=102.981049546 podStartE2EDuration="1m45.09131136s" totalImagesPullingTime="2.110261814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:26:47 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:28:32.09075604 +0000 UTC m=+1939.315985365" watchObservedRunningTime="2026-07-17 18:28:32.09131136 +0000 UTC m=+1939.316540669"
Jul 17 18:28:32.196949 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:32.196875    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-xwpj9"
Jul 17 18:28:32.242545 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:32.242517    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1388656c-8766-4d9d-bbe7-afa426a763a7-maas-api-service-ca\") pod \"1388656c-8766-4d9d-bbe7-afa426a763a7\" (UID: \"1388656c-8766-4d9d-bbe7-afa426a763a7\") "
Jul 17 18:28:32.242921 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:32.242892    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1388656c-8766-4d9d-bbe7-afa426a763a7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1388656c-8766-4d9d-bbe7-afa426a763a7" (UID: "1388656c-8766-4d9d-bbe7-afa426a763a7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:28:32.343820 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:32.343777    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1388656c-8766-4d9d-bbe7-afa426a763a7-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:28:33.067022 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:33.066963    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-xwpj9"
Jul 17 18:28:33.067534 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:33.067031    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-xwpj9" event={"ID":"1388656c-8766-4d9d-bbe7-afa426a763a7","Type":"ContainerDied","Data":"7b6947edaf40e4d6758076b35326437bd126c80e80f9e7ec050198fe0764afd5"}
Jul 17 18:28:33.067534 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:33.067099    2572 scope.go:117] "RemoveContainer" containerID="9fca1cbeba9c3e7d0b091e33169259ae6d2f3fb15756187e0a3d8b5a73486fab"
Jul 17 18:28:33.069589 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:33.069562    2572 generic.go:356] "Generic (PLEG): container finished" podID="b7a3f452-fa0c-4763-8469-effe6c26b42e" containerID="6824c99cfc9b63efd1678b2d4402d2409bc36af30b400827c383434c9dceb8c3" exitCode=1
Jul 17 18:28:33.069724 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:33.069610    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" event={"ID":"b7a3f452-fa0c-4763-8469-effe6c26b42e","Type":"ContainerDied","Data":"6824c99cfc9b63efd1678b2d4402d2409bc36af30b400827c383434c9dceb8c3"}
Jul 17 18:28:33.069861 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:33.069846    2572 scope.go:117] "RemoveContainer" containerID="6824c99cfc9b63efd1678b2d4402d2409bc36af30b400827c383434c9dceb8c3"
Jul 17 18:28:33.070069 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:28:33.070047    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:28:33.077632 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:33.077613    2572 scope.go:117] "RemoveContainer" containerID="1246beb142d1797678d768d8075bf05ef1d2576a5dbdf011b7687d308097e648"
Jul 17 18:28:33.100359 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:33.100331    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-xwpj9"]
Jul 17 18:28:33.106259 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:33.106233    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-xwpj9"]
Jul 17 18:28:33.472343 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:33.472308    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1388656c-8766-4d9d-bbe7-afa426a763a7" path="/var/lib/kubelet/pods/1388656c-8766-4d9d-bbe7-afa426a763a7/volumes"
Jul 17 18:28:34.078205 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:34.078174    2572 scope.go:117] "RemoveContainer" containerID="6824c99cfc9b63efd1678b2d4402d2409bc36af30b400827c383434c9dceb8c3"
Jul 17 18:28:34.078613 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:28:34.078360    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:28:38.559248 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:38.559207    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g"
Jul 17 18:28:38.559659 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:38.559584    2572 scope.go:117] "RemoveContainer" containerID="6824c99cfc9b63efd1678b2d4402d2409bc36af30b400827c383434c9dceb8c3"
Jul 17 18:28:38.559784 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:28:38.559761    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:28:52.466253 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:28:52.466218    2572 scope.go:117] "RemoveContainer" containerID="6824c99cfc9b63efd1678b2d4402d2409bc36af30b400827c383434c9dceb8c3"
Jul 17 18:28:52.466747 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:28:52.466415    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:29:03.468233 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:03.468203    2572 scope.go:117] "RemoveContainer" containerID="6824c99cfc9b63efd1678b2d4402d2409bc36af30b400827c383434c9dceb8c3"
Jul 17 18:29:03.468632 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:29:03.468393    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:29:15.465603 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:15.465564    2572 scope.go:117] "RemoveContainer" containerID="6824c99cfc9b63efd1678b2d4402d2409bc36af30b400827c383434c9dceb8c3"
Jul 17 18:29:15.466091 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:29:15.465807    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:29:19.264469 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:19.264429    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:29:30.466088 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:30.466055    2572 scope.go:117] "RemoveContainer" containerID="6824c99cfc9b63efd1678b2d4402d2409bc36af30b400827c383434c9dceb8c3"
Jul 17 18:29:30.466578 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:29:30.466266    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:29:34.836570 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:34.836532    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:29:41.465467 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:41.465439    2572 scope.go:117] "RemoveContainer" containerID="6824c99cfc9b63efd1678b2d4402d2409bc36af30b400827c383434c9dceb8c3"
Jul 17 18:29:41.465949 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:29:41.465638    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:29:53.469472 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:53.469441    2572 scope.go:117] "RemoveContainer" containerID="6824c99cfc9b63efd1678b2d4402d2409bc36af30b400827c383434c9dceb8c3"
Jul 17 18:29:54.468670 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:54.468634    2572 generic.go:356] "Generic (PLEG): container finished" podID="b7a3f452-fa0c-4763-8469-effe6c26b42e" containerID="bb2e5ccd009b25617f71691a21092796db638f4746b97d57426c523aa7ae1fd6" exitCode=1
Jul 17 18:29:54.468843 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:54.468679    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" event={"ID":"b7a3f452-fa0c-4763-8469-effe6c26b42e","Type":"ContainerDied","Data":"bb2e5ccd009b25617f71691a21092796db638f4746b97d57426c523aa7ae1fd6"}
Jul 17 18:29:54.468843 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:54.468754    2572 scope.go:117] "RemoveContainer" containerID="6824c99cfc9b63efd1678b2d4402d2409bc36af30b400827c383434c9dceb8c3"
Jul 17 18:29:54.469144 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:54.469121    2572 scope.go:117] "RemoveContainer" containerID="bb2e5ccd009b25617f71691a21092796db638f4746b97d57426c523aa7ae1fd6"
Jul 17 18:29:54.469382 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:29:54.469361    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:29:56.829684 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:56.829646    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pncxm"]
Jul 17 18:29:56.830124 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:56.830070    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1388656c-8766-4d9d-bbe7-afa426a763a7" containerName="revoke-keys"
Jul 17 18:29:56.830124 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:56.830082    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1388656c-8766-4d9d-bbe7-afa426a763a7" containerName="revoke-keys"
Jul 17 18:29:56.830124 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:56.830090    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1388656c-8766-4d9d-bbe7-afa426a763a7" containerName="revoke-keys"
Jul 17 18:29:56.830124 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:56.830095    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1388656c-8766-4d9d-bbe7-afa426a763a7" containerName="revoke-keys"
Jul 17 18:29:56.830124 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:56.830102    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1388656c-8766-4d9d-bbe7-afa426a763a7" containerName="revoke-keys"
Jul 17 18:29:56.830124 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:56.830109    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1388656c-8766-4d9d-bbe7-afa426a763a7" containerName="revoke-keys"
Jul 17 18:29:56.830342 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:56.830171    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1388656c-8766-4d9d-bbe7-afa426a763a7" containerName="revoke-keys"
Jul 17 18:29:56.830342 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:56.830178    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1388656c-8766-4d9d-bbe7-afa426a763a7" containerName="revoke-keys"
Jul 17 18:29:56.830342 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:56.830185    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1388656c-8766-4d9d-bbe7-afa426a763a7" containerName="revoke-keys"
Jul 17 18:29:56.834614 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:56.834592    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pncxm"
Jul 17 18:29:56.837754 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:56.837557    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:29:56.840401 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:56.840360    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pncxm"]
Jul 17 18:29:56.949155 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:56.949114    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a40b0bbb-d950-4ade-8df2-02826b4ff3e2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-pncxm\" (UID: \"a40b0bbb-d950-4ade-8df2-02826b4ff3e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pncxm"
Jul 17 18:29:57.050162 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:57.050117    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a40b0bbb-d950-4ade-8df2-02826b4ff3e2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-pncxm\" (UID: \"a40b0bbb-d950-4ade-8df2-02826b4ff3e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pncxm"
Jul 17 18:29:57.050811 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:57.050781    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a40b0bbb-d950-4ade-8df2-02826b4ff3e2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-pncxm\" (UID: \"a40b0bbb-d950-4ade-8df2-02826b4ff3e2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pncxm"
Jul 17 18:29:57.060841 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:57.060809    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g"
Jul 17 18:29:57.061207 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:57.061191    2572 scope.go:117] "RemoveContainer" containerID="bb2e5ccd009b25617f71691a21092796db638f4746b97d57426c523aa7ae1fd6"
Jul 17 18:29:57.061400 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:29:57.061378    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:29:57.147298 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:57.147215    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pncxm"
Jul 17 18:29:57.285207 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:57.285178    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pncxm"]
Jul 17 18:29:57.287202 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:29:57.287169    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda40b0bbb_d950_4ade_8df2_02826b4ff3e2.slice/crio-979194a1edd3483ede6971a030ec7627a0e0be1da15f6aa087af6de4c35d9524 WatchSource:0}: Error finding container 979194a1edd3483ede6971a030ec7627a0e0be1da15f6aa087af6de4c35d9524: Status 404 returned error can't find the container with id 979194a1edd3483ede6971a030ec7627a0e0be1da15f6aa087af6de4c35d9524
Jul 17 18:29:57.488412 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:57.488384    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pncxm" event={"ID":"a40b0bbb-d950-4ade-8df2-02826b4ff3e2","Type":"ContainerStarted","Data":"979194a1edd3483ede6971a030ec7627a0e0be1da15f6aa087af6de4c35d9524"}
Jul 17 18:29:58.495059 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:58.495027    2572 generic.go:356] "Generic (PLEG): container finished" podID="a40b0bbb-d950-4ade-8df2-02826b4ff3e2" containerID="1fdaa12458b26ecaca5992472aea5da7032b93ca63e92ed7a23d94f6e0d216c1" exitCode=6
Jul 17 18:29:58.495570 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:58.495125    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pncxm" event={"ID":"a40b0bbb-d950-4ade-8df2-02826b4ff3e2","Type":"ContainerDied","Data":"1fdaa12458b26ecaca5992472aea5da7032b93ca63e92ed7a23d94f6e0d216c1"}
Jul 17 18:29:58.495570 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:58.495377    2572 scope.go:117] "RemoveContainer" containerID="1fdaa12458b26ecaca5992472aea5da7032b93ca63e92ed7a23d94f6e0d216c1"
Jul 17 18:29:58.558951 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:58.558919    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g"
Jul 17 18:29:58.559342 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:58.559327    2572 scope.go:117] "RemoveContainer" containerID="bb2e5ccd009b25617f71691a21092796db638f4746b97d57426c523aa7ae1fd6"
Jul 17 18:29:58.559520 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:29:58.559501    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:29:59.501416 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:59.501375    2572 generic.go:356] "Generic (PLEG): container finished" podID="a40b0bbb-d950-4ade-8df2-02826b4ff3e2" containerID="fc4002534c6ad5748efc70021d2785ba5b0901121da8ea15334b17cc6c62f5c1" exitCode=6
Jul 17 18:29:59.501877 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:59.501430    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pncxm" event={"ID":"a40b0bbb-d950-4ade-8df2-02826b4ff3e2","Type":"ContainerDied","Data":"fc4002534c6ad5748efc70021d2785ba5b0901121da8ea15334b17cc6c62f5c1"}
Jul 17 18:29:59.501877 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:59.501502    2572 scope.go:117] "RemoveContainer" containerID="1fdaa12458b26ecaca5992472aea5da7032b93ca63e92ed7a23d94f6e0d216c1"
Jul 17 18:29:59.501877 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:29:59.501750    2572 scope.go:117] "RemoveContainer" containerID="fc4002534c6ad5748efc70021d2785ba5b0901121da8ea15334b17cc6c62f5c1"
Jul 17 18:29:59.502067 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:29:59.501991    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-pncxm_odh-ai-gateway-infra(a40b0bbb-d950-4ade-8df2-02826b4ff3e2)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pncxm" podUID="a40b0bbb-d950-4ade-8df2-02826b4ff3e2"
Jul 17 18:30:00.508130 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:00.508100    2572 scope.go:117] "RemoveContainer" containerID="fc4002534c6ad5748efc70021d2785ba5b0901121da8ea15334b17cc6c62f5c1"
Jul 17 18:30:00.508509 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:30:00.508344    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-pncxm_odh-ai-gateway-infra(a40b0bbb-d950-4ade-8df2-02826b4ff3e2)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pncxm" podUID="a40b0bbb-d950-4ade-8df2-02826b4ff3e2"
Jul 17 18:30:11.466201 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:11.466166    2572 scope.go:117] "RemoveContainer" containerID="bb2e5ccd009b25617f71691a21092796db638f4746b97d57426c523aa7ae1fd6"
Jul 17 18:30:11.466698 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:30:11.466365    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:30:14.466179 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:14.466148    2572 scope.go:117] "RemoveContainer" containerID="fc4002534c6ad5748efc70021d2785ba5b0901121da8ea15334b17cc6c62f5c1"
Jul 17 18:30:15.582189 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:15.582153    2572 generic.go:356] "Generic (PLEG): container finished" podID="a40b0bbb-d950-4ade-8df2-02826b4ff3e2" containerID="a1ffe8ea1304e1cf0cc80b617b66fe5c6a5b8c013f45cd2487ba5ce5bb238157" exitCode=6
Jul 17 18:30:15.582598 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:15.582213    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pncxm" event={"ID":"a40b0bbb-d950-4ade-8df2-02826b4ff3e2","Type":"ContainerDied","Data":"a1ffe8ea1304e1cf0cc80b617b66fe5c6a5b8c013f45cd2487ba5ce5bb238157"}
Jul 17 18:30:15.582598 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:15.582265    2572 scope.go:117] "RemoveContainer" containerID="fc4002534c6ad5748efc70021d2785ba5b0901121da8ea15334b17cc6c62f5c1"
Jul 17 18:30:15.582598 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:15.582556    2572 scope.go:117] "RemoveContainer" containerID="a1ffe8ea1304e1cf0cc80b617b66fe5c6a5b8c013f45cd2487ba5ce5bb238157"
Jul 17 18:30:15.582818 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:30:15.582792    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-pncxm_odh-ai-gateway-infra(a40b0bbb-d950-4ade-8df2-02826b4ff3e2)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pncxm" podUID="a40b0bbb-d950-4ade-8df2-02826b4ff3e2"
Jul 17 18:30:16.609674 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:16.609642    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pncxm"]
Jul 17 18:30:16.750214 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:16.750183    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pncxm"
Jul 17 18:30:16.816446 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:16.816411    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:30:16.915032 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:16.914907    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:30:16.937763 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:16.937726    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a40b0bbb-d950-4ade-8df2-02826b4ff3e2-maas-api-service-ca\") pod \"a40b0bbb-d950-4ade-8df2-02826b4ff3e2\" (UID: \"a40b0bbb-d950-4ade-8df2-02826b4ff3e2\") "
Jul 17 18:30:16.938150 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:16.938127    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a40b0bbb-d950-4ade-8df2-02826b4ff3e2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a40b0bbb-d950-4ade-8df2-02826b4ff3e2" (UID: "a40b0bbb-d950-4ade-8df2-02826b4ff3e2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:30:17.039250 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:17.039218    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a40b0bbb-d950-4ade-8df2-02826b4ff3e2-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:30:17.594376 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:17.594341    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pncxm" event={"ID":"a40b0bbb-d950-4ade-8df2-02826b4ff3e2","Type":"ContainerDied","Data":"979194a1edd3483ede6971a030ec7627a0e0be1da15f6aa087af6de4c35d9524"}
Jul 17 18:30:17.594376 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:17.594368    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pncxm"
Jul 17 18:30:17.594634 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:17.594406    2572 scope.go:117] "RemoveContainer" containerID="a1ffe8ea1304e1cf0cc80b617b66fe5c6a5b8c013f45cd2487ba5ce5bb238157"
Jul 17 18:30:17.617180 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:17.617152    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pncxm"]
Jul 17 18:30:17.621391 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:17.621367    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-pncxm"]
Jul 17 18:30:19.471308 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:19.471274    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a40b0bbb-d950-4ade-8df2-02826b4ff3e2" path="/var/lib/kubelet/pods/a40b0bbb-d950-4ade-8df2-02826b4ff3e2/volumes"
Jul 17 18:30:22.885320 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:22.885279    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-l6w5j"]
Jul 17 18:30:22.885906 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:22.885885    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a40b0bbb-d950-4ade-8df2-02826b4ff3e2" containerName="revoke-keys"
Jul 17 18:30:22.885950 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:22.885912    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a40b0bbb-d950-4ade-8df2-02826b4ff3e2" containerName="revoke-keys"
Jul 17 18:30:22.885985 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:22.885960    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a40b0bbb-d950-4ade-8df2-02826b4ff3e2" containerName="revoke-keys"
Jul 17 18:30:22.885985 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:22.885969    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a40b0bbb-d950-4ade-8df2-02826b4ff3e2" containerName="revoke-keys"
Jul 17 18:30:22.886108 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:22.886095    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a40b0bbb-d950-4ade-8df2-02826b4ff3e2" containerName="revoke-keys"
Jul 17 18:30:22.886141 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:22.886110    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a40b0bbb-d950-4ade-8df2-02826b4ff3e2" containerName="revoke-keys"
Jul 17 18:30:22.886141 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:22.886122    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a40b0bbb-d950-4ade-8df2-02826b4ff3e2" containerName="revoke-keys"
Jul 17 18:30:22.890985 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:22.890966    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-l6w5j"
Jul 17 18:30:22.893649 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:22.893461    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:30:22.894564 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:22.894535    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-l6w5j"]
Jul 17 18:30:22.985863 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:22.985821    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a5b144da-l6w5j\" (UID: \"30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-l6w5j"
Jul 17 18:30:23.087095 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:23.087059    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a5b144da-l6w5j\" (UID: \"30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-l6w5j"
Jul 17 18:30:23.087689 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:23.087669    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a5b144da-l6w5j\" (UID: \"30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-l6w5j"
Jul 17 18:30:23.203944 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:23.203912    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-l6w5j"
Jul 17 18:30:23.340643 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:23.340577    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-l6w5j"]
Jul 17 18:30:23.343070 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:30:23.343038    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30b3f10d_4c3e_4cdb_84d1_8f781a5d41b8.slice/crio-4da4c5ac7fafda84c7875a6f8acbce6692a2127f77725bbfdc8f5310ed3e08c7 WatchSource:0}: Error finding container 4da4c5ac7fafda84c7875a6f8acbce6692a2127f77725bbfdc8f5310ed3e08c7: Status 404 returned error can't find the container with id 4da4c5ac7fafda84c7875a6f8acbce6692a2127f77725bbfdc8f5310ed3e08c7
Jul 17 18:30:23.424287 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:23.424239    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:30:23.625283 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:23.625247    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-l6w5j" event={"ID":"30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8","Type":"ContainerStarted","Data":"4da4c5ac7fafda84c7875a6f8acbce6692a2127f77725bbfdc8f5310ed3e08c7"}
Jul 17 18:30:24.631353 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:24.631317    2572 generic.go:356] "Generic (PLEG): container finished" podID="30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8" containerID="e40d21823f8a590d8e5f23bae0708b9f67ada84e74d968f01cab0b108426614b" exitCode=7
Jul 17 18:30:24.631887 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:24.631380    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-l6w5j" event={"ID":"30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8","Type":"ContainerDied","Data":"e40d21823f8a590d8e5f23bae0708b9f67ada84e74d968f01cab0b108426614b"}
Jul 17 18:30:24.631887 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:24.631590    2572 scope.go:117] "RemoveContainer" containerID="e40d21823f8a590d8e5f23bae0708b9f67ada84e74d968f01cab0b108426614b"
Jul 17 18:30:24.659899 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:24.659871    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:30:25.465830 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:25.465798    2572 scope.go:117] "RemoveContainer" containerID="bb2e5ccd009b25617f71691a21092796db638f4746b97d57426c523aa7ae1fd6"
Jul 17 18:30:25.466077 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:30:25.465992    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:30:25.638108 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:25.638008    2572 generic.go:356] "Generic (PLEG): container finished" podID="30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8" containerID="901a55c679f84a2207fa77a7a5bebe471b905c5b648cf97bd95202647880ea96" exitCode=7
Jul 17 18:30:25.638576 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:25.638103    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-l6w5j" event={"ID":"30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8","Type":"ContainerDied","Data":"901a55c679f84a2207fa77a7a5bebe471b905c5b648cf97bd95202647880ea96"}
Jul 17 18:30:25.638576 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:25.638167    2572 scope.go:117] "RemoveContainer" containerID="e40d21823f8a590d8e5f23bae0708b9f67ada84e74d968f01cab0b108426614b"
Jul 17 18:30:25.638576 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:25.638413    2572 scope.go:117] "RemoveContainer" containerID="901a55c679f84a2207fa77a7a5bebe471b905c5b648cf97bd95202647880ea96"
Jul 17 18:30:25.638752 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:30:25.638605    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a5b144da-l6w5j_odh-ai-gateway-infra(30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-l6w5j" podUID="30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8"
Jul 17 18:30:26.645388 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:26.645355    2572 scope.go:117] "RemoveContainer" containerID="901a55c679f84a2207fa77a7a5bebe471b905c5b648cf97bd95202647880ea96"
Jul 17 18:30:26.645797 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:30:26.645586    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a5b144da-l6w5j_odh-ai-gateway-infra(30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-l6w5j" podUID="30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8"
Jul 17 18:30:39.465549 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:39.465463    2572 scope.go:117] "RemoveContainer" containerID="901a55c679f84a2207fa77a7a5bebe471b905c5b648cf97bd95202647880ea96"
Jul 17 18:30:40.466397 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:40.466362    2572 scope.go:117] "RemoveContainer" containerID="bb2e5ccd009b25617f71691a21092796db638f4746b97d57426c523aa7ae1fd6"
Jul 17 18:30:40.466856 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:30:40.466540    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:30:40.728745 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:40.728657    2572 generic.go:356] "Generic (PLEG): container finished" podID="30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8" containerID="db4aec374e815ec9a9117d7c441101e114960c35ecee0f201048adda176063c8" exitCode=7
Jul 17 18:30:40.728745 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:40.728684    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-l6w5j" event={"ID":"30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8","Type":"ContainerDied","Data":"db4aec374e815ec9a9117d7c441101e114960c35ecee0f201048adda176063c8"}
Jul 17 18:30:40.728966 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:40.728774    2572 scope.go:117] "RemoveContainer" containerID="901a55c679f84a2207fa77a7a5bebe471b905c5b648cf97bd95202647880ea96"
Jul 17 18:30:40.729081 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:40.729064    2572 scope.go:117] "RemoveContainer" containerID="db4aec374e815ec9a9117d7c441101e114960c35ecee0f201048adda176063c8"
Jul 17 18:30:40.729308 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:30:40.729287    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a5b144da-l6w5j_odh-ai-gateway-infra(30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-l6w5j" podUID="30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8"
Jul 17 18:30:41.753156 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:41.753121    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-l6w5j"]
Jul 17 18:30:41.894013 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:41.893977    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-l6w5j"
Jul 17 18:30:41.966164 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:41.966117    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8-maas-api-service-ca\") pod \"30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8\" (UID: \"30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8\") "
Jul 17 18:30:41.966481 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:41.966457    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8" (UID: "30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:30:42.067786 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:42.067686    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:30:42.741829 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:42.741793    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-l6w5j" event={"ID":"30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8","Type":"ContainerDied","Data":"4da4c5ac7fafda84c7875a6f8acbce6692a2127f77725bbfdc8f5310ed3e08c7"}
Jul 17 18:30:42.741829 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:42.741814    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-l6w5j"
Jul 17 18:30:42.742120 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:42.741853    2572 scope.go:117] "RemoveContainer" containerID="db4aec374e815ec9a9117d7c441101e114960c35ecee0f201048adda176063c8"
Jul 17 18:30:42.765344 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:42.765312    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-l6w5j"]
Jul 17 18:30:42.770124 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:42.770097    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-l6w5j"]
Jul 17 18:30:43.472419 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:43.472389    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8" path="/var/lib/kubelet/pods/30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8/volumes"
Jul 17 18:30:48.697913 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:48.697877    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:30:51.466302 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:30:51.466271    2572 scope.go:117] "RemoveContainer" containerID="bb2e5ccd009b25617f71691a21092796db638f4746b97d57426c523aa7ae1fd6"
Jul 17 18:30:51.466679 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:30:51.466507    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:31:02.307810 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:02.307776    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:31:02.411293 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:02.411253    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:31:06.466080 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:06.466053    2572 scope.go:117] "RemoveContainer" containerID="bb2e5ccd009b25617f71691a21092796db638f4746b97d57426c523aa7ae1fd6"
Jul 17 18:31:06.466477 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:31:06.466244    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:31:12.929702 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:12.929668    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-9vqs5"]
Jul 17 18:31:12.930120 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:12.930104    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a40b0bbb-d950-4ade-8df2-02826b4ff3e2" containerName="revoke-keys"
Jul 17 18:31:12.930120 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:12.930121    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a40b0bbb-d950-4ade-8df2-02826b4ff3e2" containerName="revoke-keys"
Jul 17 18:31:12.930206 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:12.930130    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8" containerName="revoke-keys"
Jul 17 18:31:12.930206 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:12.930135    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8" containerName="revoke-keys"
Jul 17 18:31:12.930206 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:12.930150    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8" containerName="revoke-keys"
Jul 17 18:31:12.930206 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:12.930156    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8" containerName="revoke-keys"
Jul 17 18:31:12.930325 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:12.930219    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8" containerName="revoke-keys"
Jul 17 18:31:12.930325 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:12.930229    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8" containerName="revoke-keys"
Jul 17 18:31:12.930325 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:12.930235    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8" containerName="revoke-keys"
Jul 17 18:31:12.933434 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:12.933415    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-9vqs5"
Jul 17 18:31:12.935811 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:12.935781    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:31:12.939572 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:12.939546    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-9vqs5"]
Jul 17 18:31:12.947737 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:12.947707    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05e0efd2-88f7-4f47-8c00-5e62c5ba7560-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a5b144da-9vqs5\" (UID: \"05e0efd2-88f7-4f47-8c00-5e62c5ba7560\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-9vqs5"
Jul 17 18:31:13.048682 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:13.048648    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05e0efd2-88f7-4f47-8c00-5e62c5ba7560-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a5b144da-9vqs5\" (UID: \"05e0efd2-88f7-4f47-8c00-5e62c5ba7560\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-9vqs5"
Jul 17 18:31:13.049340 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:13.049320    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05e0efd2-88f7-4f47-8c00-5e62c5ba7560-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a5b144da-9vqs5\" (UID: \"05e0efd2-88f7-4f47-8c00-5e62c5ba7560\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-9vqs5"
Jul 17 18:31:13.247248 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:13.247213    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-9vqs5"
Jul 17 18:31:13.389077 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:13.389049    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-9vqs5"]
Jul 17 18:31:13.391388 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:31:13.391357    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05e0efd2_88f7_4f47_8c00_5e62c5ba7560.slice/crio-9e06e134f5289a1c91d6b6ea6c5ca963e2d32a0ff2ef5185082ae15f3bc3179e WatchSource:0}: Error finding container 9e06e134f5289a1c91d6b6ea6c5ca963e2d32a0ff2ef5185082ae15f3bc3179e: Status 404 returned error can't find the container with id 9e06e134f5289a1c91d6b6ea6c5ca963e2d32a0ff2ef5185082ae15f3bc3179e
Jul 17 18:31:13.566362 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:13.566268    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tp9qm_6c101a17-a051-4e9d-a9dd-f72c67ba2a8a/console-operator/2.log"
Jul 17 18:31:13.573239 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:13.573215    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5mdx_2e3bd369-576e-4df1-8a76-aebd537cde58/ovn-acl-logging/0.log"
Jul 17 18:31:13.581399 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:13.581378    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tp9qm_6c101a17-a051-4e9d-a9dd-f72c67ba2a8a/console-operator/2.log"
Jul 17 18:31:13.594882 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:13.594857    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5mdx_2e3bd369-576e-4df1-8a76-aebd537cde58/ovn-acl-logging/0.log"
Jul 17 18:31:13.903314 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:13.903224    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-9vqs5" event={"ID":"05e0efd2-88f7-4f47-8c00-5e62c5ba7560","Type":"ContainerStarted","Data":"d3e4604a5e326668876350e799cb424530cacd9ae9349c05cc3f25cfc04ce3cf"}
Jul 17 18:31:13.903464 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:13.903312    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-9vqs5" event={"ID":"05e0efd2-88f7-4f47-8c00-5e62c5ba7560","Type":"ContainerStarted","Data":"9e06e134f5289a1c91d6b6ea6c5ca963e2d32a0ff2ef5185082ae15f3bc3179e"}
Jul 17 18:31:13.918498 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:13.918443    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-9vqs5" podStartSLOduration=1.918426117 podStartE2EDuration="1.918426117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:31:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:31:13.917065635 +0000 UTC m=+2101.142294939" watchObservedRunningTime="2026-07-17 18:31:13.918426117 +0000 UTC m=+2101.143655469"
Jul 17 18:31:14.909878 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:14.909847    2572 generic.go:356] "Generic (PLEG): container finished" podID="05e0efd2-88f7-4f47-8c00-5e62c5ba7560" containerID="d3e4604a5e326668876350e799cb424530cacd9ae9349c05cc3f25cfc04ce3cf" exitCode=7
Jul 17 18:31:14.910331 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:14.909927    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-9vqs5" event={"ID":"05e0efd2-88f7-4f47-8c00-5e62c5ba7560","Type":"ContainerDied","Data":"d3e4604a5e326668876350e799cb424530cacd9ae9349c05cc3f25cfc04ce3cf"}
Jul 17 18:31:14.910331 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:14.910106    2572 scope.go:117] "RemoveContainer" containerID="d3e4604a5e326668876350e799cb424530cacd9ae9349c05cc3f25cfc04ce3cf"
Jul 17 18:31:15.916744 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:15.916653    2572 generic.go:356] "Generic (PLEG): container finished" podID="05e0efd2-88f7-4f47-8c00-5e62c5ba7560" containerID="ca285149cf5aedc0db98ab78f3cb3629c0b2400aa710f03d7045754c1a40df56" exitCode=7
Jul 17 18:31:15.917179 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:15.916739    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-9vqs5" event={"ID":"05e0efd2-88f7-4f47-8c00-5e62c5ba7560","Type":"ContainerDied","Data":"ca285149cf5aedc0db98ab78f3cb3629c0b2400aa710f03d7045754c1a40df56"}
Jul 17 18:31:15.917179 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:15.916801    2572 scope.go:117] "RemoveContainer" containerID="d3e4604a5e326668876350e799cb424530cacd9ae9349c05cc3f25cfc04ce3cf"
Jul 17 18:31:15.917179 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:15.917036    2572 scope.go:117] "RemoveContainer" containerID="ca285149cf5aedc0db98ab78f3cb3629c0b2400aa710f03d7045754c1a40df56"
Jul 17 18:31:15.917318 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:31:15.917293    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a5b144da-9vqs5_odh-ai-gateway-infra(05e0efd2-88f7-4f47-8c00-5e62c5ba7560)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-9vqs5" podUID="05e0efd2-88f7-4f47-8c00-5e62c5ba7560"
Jul 17 18:31:16.923908 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:16.923878    2572 scope.go:117] "RemoveContainer" containerID="ca285149cf5aedc0db98ab78f3cb3629c0b2400aa710f03d7045754c1a40df56"
Jul 17 18:31:16.924329 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:31:16.924102    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a5b144da-9vqs5_odh-ai-gateway-infra(05e0efd2-88f7-4f47-8c00-5e62c5ba7560)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-9vqs5" podUID="05e0efd2-88f7-4f47-8c00-5e62c5ba7560"
Jul 17 18:31:17.466330 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:17.466298    2572 scope.go:117] "RemoveContainer" containerID="bb2e5ccd009b25617f71691a21092796db638f4746b97d57426c523aa7ae1fd6"
Jul 17 18:31:17.466508 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:31:17.466485    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:31:30.465436 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:30.465401    2572 scope.go:117] "RemoveContainer" containerID="ca285149cf5aedc0db98ab78f3cb3629c0b2400aa710f03d7045754c1a40df56"
Jul 17 18:31:30.992215 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:30.992180    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-9vqs5" event={"ID":"05e0efd2-88f7-4f47-8c00-5e62c5ba7560","Type":"ContainerStarted","Data":"1cba46270f026b0b78a7b2517e799d83115c748b4bd6d1f27f39bfeb9de76b1c"}
Jul 17 18:31:31.466024 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:31.465975    2572 scope.go:117] "RemoveContainer" containerID="bb2e5ccd009b25617f71691a21092796db638f4746b97d57426c523aa7ae1fd6"
Jul 17 18:31:31.466411 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:31:31.466187    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:31:31.998830 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:31.998793    2572 generic.go:356] "Generic (PLEG): container finished" podID="05e0efd2-88f7-4f47-8c00-5e62c5ba7560" containerID="1cba46270f026b0b78a7b2517e799d83115c748b4bd6d1f27f39bfeb9de76b1c" exitCode=7
Jul 17 18:31:31.999064 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:31.998864    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-9vqs5" event={"ID":"05e0efd2-88f7-4f47-8c00-5e62c5ba7560","Type":"ContainerDied","Data":"1cba46270f026b0b78a7b2517e799d83115c748b4bd6d1f27f39bfeb9de76b1c"}
Jul 17 18:31:31.999064 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:31.998924    2572 scope.go:117] "RemoveContainer" containerID="ca285149cf5aedc0db98ab78f3cb3629c0b2400aa710f03d7045754c1a40df56"
Jul 17 18:31:31.999242 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:31.999224    2572 scope.go:117] "RemoveContainer" containerID="1cba46270f026b0b78a7b2517e799d83115c748b4bd6d1f27f39bfeb9de76b1c"
Jul 17 18:31:31.999501 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:31:31.999477    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a5b144da-9vqs5_odh-ai-gateway-infra(05e0efd2-88f7-4f47-8c00-5e62c5ba7560)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-9vqs5" podUID="05e0efd2-88f7-4f47-8c00-5e62c5ba7560"
Jul 17 18:31:32.020732 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:32.020695    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-9vqs5"]
Jul 17 18:31:33.146307 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:33.146275    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-9vqs5"
Jul 17 18:31:33.235195 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:33.235158    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05e0efd2-88f7-4f47-8c00-5e62c5ba7560-maas-api-service-ca\") pod \"05e0efd2-88f7-4f47-8c00-5e62c5ba7560\" (UID: \"05e0efd2-88f7-4f47-8c00-5e62c5ba7560\") "
Jul 17 18:31:33.235611 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:33.235585    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05e0efd2-88f7-4f47-8c00-5e62c5ba7560-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "05e0efd2-88f7-4f47-8c00-5e62c5ba7560" (UID: "05e0efd2-88f7-4f47-8c00-5e62c5ba7560"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:31:33.336121 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:33.335992    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/05e0efd2-88f7-4f47-8c00-5e62c5ba7560-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:31:34.019237 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:34.019199    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-9vqs5"
Jul 17 18:31:34.019237 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:34.019226    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-9vqs5" event={"ID":"05e0efd2-88f7-4f47-8c00-5e62c5ba7560","Type":"ContainerDied","Data":"9e06e134f5289a1c91d6b6ea6c5ca963e2d32a0ff2ef5185082ae15f3bc3179e"}
Jul 17 18:31:34.019511 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:34.019323    2572 scope.go:117] "RemoveContainer" containerID="1cba46270f026b0b78a7b2517e799d83115c748b4bd6d1f27f39bfeb9de76b1c"
Jul 17 18:31:34.040768 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:34.040732    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-9vqs5"]
Jul 17 18:31:34.046365 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:34.046332    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-9vqs5"]
Jul 17 18:31:35.471349 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:35.471300    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05e0efd2-88f7-4f47-8c00-5e62c5ba7560" path="/var/lib/kubelet/pods/05e0efd2-88f7-4f47-8c00-5e62c5ba7560/volumes"
Jul 17 18:31:42.466536 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:42.466504    2572 scope.go:117] "RemoveContainer" containerID="bb2e5ccd009b25617f71691a21092796db638f4746b97d57426c523aa7ae1fd6"
Jul 17 18:31:42.466925 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:31:42.466665    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:31:56.466017 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:31:56.465964    2572 scope.go:117] "RemoveContainer" containerID="bb2e5ccd009b25617f71691a21092796db638f4746b97d57426c523aa7ae1fd6"
Jul 17 18:31:56.466414 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:31:56.466204    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:32:07.466079 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:07.465965    2572 scope.go:117] "RemoveContainer" containerID="bb2e5ccd009b25617f71691a21092796db638f4746b97d57426c523aa7ae1fd6"
Jul 17 18:32:07.468216 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:32:07.466186    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:32:12.971495 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:12.971455    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-757zl"]
Jul 17 18:32:12.971888 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:12.971878    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8" containerName="revoke-keys"
Jul 17 18:32:12.971945 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:12.971901    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="30b3f10d-4c3e-4cdb-84d1-8f781a5d41b8" containerName="revoke-keys"
Jul 17 18:32:12.971945 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:12.971911    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05e0efd2-88f7-4f47-8c00-5e62c5ba7560" containerName="revoke-keys"
Jul 17 18:32:12.971945 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:12.971916    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="05e0efd2-88f7-4f47-8c00-5e62c5ba7560" containerName="revoke-keys"
Jul 17 18:32:12.971945 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:12.971933    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05e0efd2-88f7-4f47-8c00-5e62c5ba7560" containerName="revoke-keys"
Jul 17 18:32:12.971945 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:12.971938    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="05e0efd2-88f7-4f47-8c00-5e62c5ba7560" containerName="revoke-keys"
Jul 17 18:32:12.972142 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:12.972030    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="05e0efd2-88f7-4f47-8c00-5e62c5ba7560" containerName="revoke-keys"
Jul 17 18:32:12.972142 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:12.972038    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="05e0efd2-88f7-4f47-8c00-5e62c5ba7560" containerName="revoke-keys"
Jul 17 18:32:12.975106 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:12.975088    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-757zl"
Jul 17 18:32:12.977516 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:12.977495    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:32:12.982179 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:12.982147    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-757zl"]
Jul 17 18:32:13.102967 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:13.102925    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e7321fd-13fb-4d10-8bab-62ed2f69816f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a5b144da-757zl\" (UID: \"7e7321fd-13fb-4d10-8bab-62ed2f69816f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-757zl"
Jul 17 18:32:13.203539 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:13.203498    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e7321fd-13fb-4d10-8bab-62ed2f69816f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a5b144da-757zl\" (UID: \"7e7321fd-13fb-4d10-8bab-62ed2f69816f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-757zl"
Jul 17 18:32:13.204171 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:13.204150    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e7321fd-13fb-4d10-8bab-62ed2f69816f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a5b144da-757zl\" (UID: \"7e7321fd-13fb-4d10-8bab-62ed2f69816f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-757zl"
Jul 17 18:32:13.290416 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:13.290331    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-757zl"
Jul 17 18:32:13.426258 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:13.426223    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-757zl"]
Jul 17 18:32:13.426676 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:32:13.426637    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e7321fd_13fb_4d10_8bab_62ed2f69816f.slice/crio-95330aa72d2de1e46c26e0f595a5262756500c33a51958ad94a4ed1ccb72da2b WatchSource:0}: Error finding container 95330aa72d2de1e46c26e0f595a5262756500c33a51958ad94a4ed1ccb72da2b: Status 404 returned error can't find the container with id 95330aa72d2de1e46c26e0f595a5262756500c33a51958ad94a4ed1ccb72da2b
Jul 17 18:32:14.218537 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:14.218503    2572 generic.go:356] "Generic (PLEG): container finished" podID="7e7321fd-13fb-4d10-8bab-62ed2f69816f" containerID="a57f5eac5d7b767d798afe8526f904d37a79d532e8e0479d51b500007d7a8962" exitCode=7
Jul 17 18:32:14.218985 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:14.218553    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-757zl" event={"ID":"7e7321fd-13fb-4d10-8bab-62ed2f69816f","Type":"ContainerDied","Data":"a57f5eac5d7b767d798afe8526f904d37a79d532e8e0479d51b500007d7a8962"}
Jul 17 18:32:14.218985 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:14.218590    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-757zl" event={"ID":"7e7321fd-13fb-4d10-8bab-62ed2f69816f","Type":"ContainerStarted","Data":"95330aa72d2de1e46c26e0f595a5262756500c33a51958ad94a4ed1ccb72da2b"}
Jul 17 18:32:14.218985 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:14.218779    2572 scope.go:117] "RemoveContainer" containerID="a57f5eac5d7b767d798afe8526f904d37a79d532e8e0479d51b500007d7a8962"
Jul 17 18:32:15.225426 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:15.225391    2572 generic.go:356] "Generic (PLEG): container finished" podID="7e7321fd-13fb-4d10-8bab-62ed2f69816f" containerID="4b88100edeacbaf924cd1426e97d04f1a36f5d11b0c723c14556e075eb38f97a" exitCode=7
Jul 17 18:32:15.225889 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:15.225482    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-757zl" event={"ID":"7e7321fd-13fb-4d10-8bab-62ed2f69816f","Type":"ContainerDied","Data":"4b88100edeacbaf924cd1426e97d04f1a36f5d11b0c723c14556e075eb38f97a"}
Jul 17 18:32:15.225889 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:15.225552    2572 scope.go:117] "RemoveContainer" containerID="a57f5eac5d7b767d798afe8526f904d37a79d532e8e0479d51b500007d7a8962"
Jul 17 18:32:15.225889 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:15.225658    2572 scope.go:117] "RemoveContainer" containerID="4b88100edeacbaf924cd1426e97d04f1a36f5d11b0c723c14556e075eb38f97a"
Jul 17 18:32:15.226053 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:32:15.225908    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a5b144da-757zl_odh-ai-gateway-infra(7e7321fd-13fb-4d10-8bab-62ed2f69816f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-757zl" podUID="7e7321fd-13fb-4d10-8bab-62ed2f69816f"
Jul 17 18:32:16.232354 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:16.232326    2572 scope.go:117] "RemoveContainer" containerID="4b88100edeacbaf924cd1426e97d04f1a36f5d11b0c723c14556e075eb38f97a"
Jul 17 18:32:16.232725 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:32:16.232519    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a5b144da-757zl_odh-ai-gateway-infra(7e7321fd-13fb-4d10-8bab-62ed2f69816f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-757zl" podUID="7e7321fd-13fb-4d10-8bab-62ed2f69816f"
Jul 17 18:32:22.466767 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:22.466736    2572 scope.go:117] "RemoveContainer" containerID="bb2e5ccd009b25617f71691a21092796db638f4746b97d57426c523aa7ae1fd6"
Jul 17 18:32:22.467172 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:32:22.466884    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:32:30.466153 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:30.466122    2572 scope.go:117] "RemoveContainer" containerID="4b88100edeacbaf924cd1426e97d04f1a36f5d11b0c723c14556e075eb38f97a"
Jul 17 18:32:31.306028 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:31.305960    2572 generic.go:356] "Generic (PLEG): container finished" podID="7e7321fd-13fb-4d10-8bab-62ed2f69816f" containerID="62bf69b39b7fc995354ef047f8b99468a3eab45df8fe63abd29b7838850b3344" exitCode=7
Jul 17 18:32:31.306232 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:31.306043    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-757zl" event={"ID":"7e7321fd-13fb-4d10-8bab-62ed2f69816f","Type":"ContainerDied","Data":"62bf69b39b7fc995354ef047f8b99468a3eab45df8fe63abd29b7838850b3344"}
Jul 17 18:32:31.306232 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:31.306133    2572 scope.go:117] "RemoveContainer" containerID="4b88100edeacbaf924cd1426e97d04f1a36f5d11b0c723c14556e075eb38f97a"
Jul 17 18:32:31.306470 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:31.306453    2572 scope.go:117] "RemoveContainer" containerID="62bf69b39b7fc995354ef047f8b99468a3eab45df8fe63abd29b7838850b3344"
Jul 17 18:32:31.306706 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:32:31.306686    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a5b144da-757zl_odh-ai-gateway-infra(7e7321fd-13fb-4d10-8bab-62ed2f69816f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-757zl" podUID="7e7321fd-13fb-4d10-8bab-62ed2f69816f"
Jul 17 18:32:32.337323 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:32.337283    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-757zl"]
Jul 17 18:32:32.481632 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:32.481606    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-757zl"
Jul 17 18:32:32.495122 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:32.495091    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e7321fd-13fb-4d10-8bab-62ed2f69816f-maas-api-service-ca\") pod \"7e7321fd-13fb-4d10-8bab-62ed2f69816f\" (UID: \"7e7321fd-13fb-4d10-8bab-62ed2f69816f\") "
Jul 17 18:32:32.495460 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:32.495432    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e7321fd-13fb-4d10-8bab-62ed2f69816f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7e7321fd-13fb-4d10-8bab-62ed2f69816f" (UID: "7e7321fd-13fb-4d10-8bab-62ed2f69816f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:32:32.596034 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:32.595921    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e7321fd-13fb-4d10-8bab-62ed2f69816f-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:32:33.319617 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:33.319588    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-757zl"
Jul 17 18:32:33.319802 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:33.319625    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-757zl" event={"ID":"7e7321fd-13fb-4d10-8bab-62ed2f69816f","Type":"ContainerDied","Data":"95330aa72d2de1e46c26e0f595a5262756500c33a51958ad94a4ed1ccb72da2b"}
Jul 17 18:32:33.319802 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:33.319689    2572 scope.go:117] "RemoveContainer" containerID="62bf69b39b7fc995354ef047f8b99468a3eab45df8fe63abd29b7838850b3344"
Jul 17 18:32:33.340976 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:33.340946    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-757zl"]
Jul 17 18:32:33.347040 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:33.347013    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-757zl"]
Jul 17 18:32:33.474757 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:33.474725    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e7321fd-13fb-4d10-8bab-62ed2f69816f" path="/var/lib/kubelet/pods/7e7321fd-13fb-4d10-8bab-62ed2f69816f/volumes"
Jul 17 18:32:35.465533 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:35.465494    2572 scope.go:117] "RemoveContainer" containerID="bb2e5ccd009b25617f71691a21092796db638f4746b97d57426c523aa7ae1fd6"
Jul 17 18:32:36.336782 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:36.336744    2572 generic.go:356] "Generic (PLEG): container finished" podID="b7a3f452-fa0c-4763-8469-effe6c26b42e" containerID="85482828db94bcead54c10ea52940e7f275a18f9f5b67c2f496a5ec69eef350d" exitCode=1
Jul 17 18:32:36.336952 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:36.336818    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" event={"ID":"b7a3f452-fa0c-4763-8469-effe6c26b42e","Type":"ContainerDied","Data":"85482828db94bcead54c10ea52940e7f275a18f9f5b67c2f496a5ec69eef350d"}
Jul 17 18:32:36.336952 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:36.336893    2572 scope.go:117] "RemoveContainer" containerID="bb2e5ccd009b25617f71691a21092796db638f4746b97d57426c523aa7ae1fd6"
Jul 17 18:32:36.337258 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:36.337234    2572 scope.go:117] "RemoveContainer" containerID="85482828db94bcead54c10ea52940e7f275a18f9f5b67c2f496a5ec69eef350d"
Jul 17 18:32:36.337504 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:32:36.337477    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:32:37.060498 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:37.060460    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g"
Jul 17 18:32:37.344384 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:37.344305    2572 scope.go:117] "RemoveContainer" containerID="85482828db94bcead54c10ea52940e7f275a18f9f5b67c2f496a5ec69eef350d"
Jul 17 18:32:37.344534 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:32:37.344478    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:32:38.559346 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:38.559312    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g"
Jul 17 18:32:38.559860 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:38.559659    2572 scope.go:117] "RemoveContainer" containerID="85482828db94bcead54c10ea52940e7f275a18f9f5b67c2f496a5ec69eef350d"
Jul 17 18:32:38.559905 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:32:38.559852    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:32:52.953277 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:52.953238    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"]
Jul 17 18:32:52.958017 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:52.953907    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6" podUID="a4b84b29-e955-45bb-a1ef-7e0d9245a2cb" containerName="istio-proxy" containerID="cri-o://255f4a9af6d4b967af8ea25e08090903b886d6bffeac4ea0a3bbecd99e1fc36a" gracePeriod=30
Jul 17 18:32:53.003789 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:53.003751    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:32:53.087596 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:53.087548    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:32:53.468114 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:53.468059    2572 scope.go:117] "RemoveContainer" containerID="85482828db94bcead54c10ea52940e7f275a18f9f5b67c2f496a5ec69eef350d"
Jul 17 18:32:53.468334 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:32:53.468273    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g_odh-ai-gateway-infra(b7a3f452-fa0c-4763-8469-effe6c26b42e)\"" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e"
Jul 17 18:32:58.223748 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.223717    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:32:58.330230 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.330196    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-istio-data\") pod \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") "
Jul 17 18:32:58.330413 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.330243    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-credential-socket\") pod \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") "
Jul 17 18:32:58.330413 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.330275    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7ggw\" (UniqueName: \"kubernetes.io/projected/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-kube-api-access-s7ggw\") pod \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") "
Jul 17 18:32:58.330413 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.330319    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-istio-token\") pod \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") "
Jul 17 18:32:58.330413 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.330350    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-workload-socket\") pod \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") "
Jul 17 18:32:58.330413 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.330380    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-istio-envoy\") pod \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") "
Jul 17 18:32:58.330692 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.330439    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-workload-certs\") pod \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") "
Jul 17 18:32:58.330692 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.330485    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a4b84b29-e955-45bb-a1ef-7e0d9245a2cb" (UID: "a4b84b29-e955-45bb-a1ef-7e0d9245a2cb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:32:58.330692 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.330503    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-istio-podinfo\") pod \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") "
Jul 17 18:32:58.330692 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.330528    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-istiod-ca-cert\") pod \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\" (UID: \"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb\") "
Jul 17 18:32:58.330909 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.330801    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a4b84b29-e955-45bb-a1ef-7e0d9245a2cb" (UID: "a4b84b29-e955-45bb-a1ef-7e0d9245a2cb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:32:58.330909 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.330860    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-credential-socket\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:32:58.330909 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.330862    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a4b84b29-e955-45bb-a1ef-7e0d9245a2cb" (UID: "a4b84b29-e955-45bb-a1ef-7e0d9245a2cb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:32:58.331185 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.331155    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-istio-data" (OuterVolumeSpecName: "istio-data") pod "a4b84b29-e955-45bb-a1ef-7e0d9245a2cb" (UID: "a4b84b29-e955-45bb-a1ef-7e0d9245a2cb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:32:58.331330 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.331192    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a4b84b29-e955-45bb-a1ef-7e0d9245a2cb" (UID: "a4b84b29-e955-45bb-a1ef-7e0d9245a2cb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:32:58.332671 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.332643    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a4b84b29-e955-45bb-a1ef-7e0d9245a2cb" (UID: "a4b84b29-e955-45bb-a1ef-7e0d9245a2cb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 18:32:58.332770 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.332682    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-kube-api-access-s7ggw" (OuterVolumeSpecName: "kube-api-access-s7ggw") pod "a4b84b29-e955-45bb-a1ef-7e0d9245a2cb" (UID: "a4b84b29-e955-45bb-a1ef-7e0d9245a2cb"). InnerVolumeSpecName "kube-api-access-s7ggw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:32:58.332770 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.332699    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a4b84b29-e955-45bb-a1ef-7e0d9245a2cb" (UID: "a4b84b29-e955-45bb-a1ef-7e0d9245a2cb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:32:58.332770 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.332740    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-istio-token" (OuterVolumeSpecName: "istio-token") pod "a4b84b29-e955-45bb-a1ef-7e0d9245a2cb" (UID: "a4b84b29-e955-45bb-a1ef-7e0d9245a2cb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:32:58.420175 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.419638    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g"]
Jul 17 18:32:58.432027 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.431952    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-workload-certs\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:32:58.432177 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.432045    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-istio-podinfo\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:32:58.432177 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.432062    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-istiod-ca-cert\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:32:58.432177 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.432076    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-istio-data\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:32:58.432177 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.432089    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7ggw\" (UniqueName: \"kubernetes.io/projected/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-kube-api-access-s7ggw\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:32:58.432177 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.432103    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-istio-token\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:32:58.432177 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.432117    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-workload-socket\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:32:58.432177 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.432129    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb-istio-envoy\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:32:58.433542 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.433519    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:32:58.446248 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.446217    2572 generic.go:356] "Generic (PLEG): container finished" podID="a4b84b29-e955-45bb-a1ef-7e0d9245a2cb" containerID="255f4a9af6d4b967af8ea25e08090903b886d6bffeac4ea0a3bbecd99e1fc36a" exitCode=0
Jul 17 18:32:58.446422 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.446277    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"
Jul 17 18:32:58.446422 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.446312    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6" event={"ID":"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb","Type":"ContainerDied","Data":"255f4a9af6d4b967af8ea25e08090903b886d6bffeac4ea0a3bbecd99e1fc36a"}
Jul 17 18:32:58.446422 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.446387    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6" event={"ID":"a4b84b29-e955-45bb-a1ef-7e0d9245a2cb","Type":"ContainerDied","Data":"5182eb0d69933ad7ecc30f28c4218884fb8d315e11925e8f7c53af60ff10e18e"}
Jul 17 18:32:58.446542 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.446426    2572 scope.go:117] "RemoveContainer" containerID="255f4a9af6d4b967af8ea25e08090903b886d6bffeac4ea0a3bbecd99e1fc36a"
Jul 17 18:32:58.459185 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.459159    2572 scope.go:117] "RemoveContainer" containerID="b132a2970888ede0ee4e35f2e29726227d2e55feb65c200fb2d18417681dfcb9"
Jul 17 18:32:58.469872 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.469844    2572 scope.go:117] "RemoveContainer" containerID="255f4a9af6d4b967af8ea25e08090903b886d6bffeac4ea0a3bbecd99e1fc36a"
Jul 17 18:32:58.470200 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:32:58.470172    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"255f4a9af6d4b967af8ea25e08090903b886d6bffeac4ea0a3bbecd99e1fc36a\": container with ID starting with 255f4a9af6d4b967af8ea25e08090903b886d6bffeac4ea0a3bbecd99e1fc36a not found: ID does not exist" containerID="255f4a9af6d4b967af8ea25e08090903b886d6bffeac4ea0a3bbecd99e1fc36a"
Jul 17 18:32:58.470313 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.470214    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"255f4a9af6d4b967af8ea25e08090903b886d6bffeac4ea0a3bbecd99e1fc36a"} err="failed to get container status \"255f4a9af6d4b967af8ea25e08090903b886d6bffeac4ea0a3bbecd99e1fc36a\": rpc error: code = NotFound desc = could not find container \"255f4a9af6d4b967af8ea25e08090903b886d6bffeac4ea0a3bbecd99e1fc36a\": container with ID starting with 255f4a9af6d4b967af8ea25e08090903b886d6bffeac4ea0a3bbecd99e1fc36a not found: ID does not exist"
Jul 17 18:32:58.470313 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.470239    2572 scope.go:117] "RemoveContainer" containerID="b132a2970888ede0ee4e35f2e29726227d2e55feb65c200fb2d18417681dfcb9"
Jul 17 18:32:58.470572 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:32:58.470509    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b132a2970888ede0ee4e35f2e29726227d2e55feb65c200fb2d18417681dfcb9\": container with ID starting with b132a2970888ede0ee4e35f2e29726227d2e55feb65c200fb2d18417681dfcb9 not found: ID does not exist" containerID="b132a2970888ede0ee4e35f2e29726227d2e55feb65c200fb2d18417681dfcb9"
Jul 17 18:32:58.470572 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.470547    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b132a2970888ede0ee4e35f2e29726227d2e55feb65c200fb2d18417681dfcb9"} err="failed to get container status \"b132a2970888ede0ee4e35f2e29726227d2e55feb65c200fb2d18417681dfcb9\": rpc error: code = NotFound desc = could not find container \"b132a2970888ede0ee4e35f2e29726227d2e55feb65c200fb2d18417681dfcb9\": container with ID starting with b132a2970888ede0ee4e35f2e29726227d2e55feb65c200fb2d18417681dfcb9 not found: ID does not exist"
Jul 17 18:32:58.471556 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.471457    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"]
Jul 17 18:32:58.473344 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.473321    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a5b144da-openshift-default-85958fbf4c-lbvb6"]
Jul 17 18:32:58.547349 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.547320    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g"
Jul 17 18:32:58.634425 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.634390    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8vd9s\" (UniqueName: \"kubernetes.io/projected/b7a3f452-fa0c-4763-8469-effe6c26b42e-kube-api-access-8vd9s\") pod \"b7a3f452-fa0c-4763-8469-effe6c26b42e\" (UID: \"b7a3f452-fa0c-4763-8469-effe6c26b42e\") "
Jul 17 18:32:58.634632 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.634453    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7a3f452-fa0c-4763-8469-effe6c26b42e-maas-api-tls\") pod \"b7a3f452-fa0c-4763-8469-effe6c26b42e\" (UID: \"b7a3f452-fa0c-4763-8469-effe6c26b42e\") "
Jul 17 18:32:58.634632 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.634539    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7a3f452-fa0c-4763-8469-effe6c26b42e-openshift-service-ca\") pod \"b7a3f452-fa0c-4763-8469-effe6c26b42e\" (UID: \"b7a3f452-fa0c-4763-8469-effe6c26b42e\") "
Jul 17 18:32:58.634965 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.634930    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7a3f452-fa0c-4763-8469-effe6c26b42e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b7a3f452-fa0c-4763-8469-effe6c26b42e" (UID: "b7a3f452-fa0c-4763-8469-effe6c26b42e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:32:58.636543 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.636518    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7a3f452-fa0c-4763-8469-effe6c26b42e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b7a3f452-fa0c-4763-8469-effe6c26b42e" (UID: "b7a3f452-fa0c-4763-8469-effe6c26b42e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 18:32:58.636630 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.636549    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7a3f452-fa0c-4763-8469-effe6c26b42e-kube-api-access-8vd9s" (OuterVolumeSpecName: "kube-api-access-8vd9s") pod "b7a3f452-fa0c-4763-8469-effe6c26b42e" (UID: "b7a3f452-fa0c-4763-8469-effe6c26b42e"). InnerVolumeSpecName "kube-api-access-8vd9s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:32:58.736233 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.736180    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8vd9s\" (UniqueName: \"kubernetes.io/projected/b7a3f452-fa0c-4763-8469-effe6c26b42e-kube-api-access-8vd9s\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:32:58.736233 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.736227    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b7a3f452-fa0c-4763-8469-effe6c26b42e-maas-api-tls\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:32:58.736233 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.736241    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b7a3f452-fa0c-4763-8469-effe6c26b42e-openshift-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:32:58.930051 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:58.929944    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:32:59.453225 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:59.453196    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g"
Jul 17 18:32:59.453706 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:59.453195    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g" event={"ID":"b7a3f452-fa0c-4763-8469-effe6c26b42e","Type":"ContainerDied","Data":"690552b80107dc72d80681f023144dc9ff29470ea28762235649e01cbc5094be"}
Jul 17 18:32:59.453706 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:59.453370    2572 scope.go:117] "RemoveContainer" containerID="85482828db94bcead54c10ea52940e7f275a18f9f5b67c2f496a5ec69eef350d"
Jul 17 18:32:59.470791 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:59.470765    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4b84b29-e955-45bb-a1ef-7e0d9245a2cb" path="/var/lib/kubelet/pods/a4b84b29-e955-45bb-a1ef-7e0d9245a2cb/volumes"
Jul 17 18:32:59.474551 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:59.474525    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g"]
Jul 17 18:32:59.480455 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:32:59.480433    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-a5b144da-7fcf855b9d-jtc2g"]
Jul 17 18:33:01.471040 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:01.470989    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e" path="/var/lib/kubelet/pods/b7a3f452-fa0c-4763-8469-effe6c26b42e/volumes"
Jul 17 18:33:04.416063 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.416030    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:33:04.476339 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.476303    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:33:04.817898 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.817860    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"]
Jul 17 18:33:04.818487 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.818464    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e7321fd-13fb-4d10-8bab-62ed2f69816f" containerName="revoke-keys"
Jul 17 18:33:04.818487 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.818485    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e7321fd-13fb-4d10-8bab-62ed2f69816f" containerName="revoke-keys"
Jul 17 18:33:04.818657 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.818495    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e" containerName="maas-api"
Jul 17 18:33:04.818657 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.818502    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e" containerName="maas-api"
Jul 17 18:33:04.818657 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.818509    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e" containerName="maas-api"
Jul 17 18:33:04.818657 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.818516    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e" containerName="maas-api"
Jul 17 18:33:04.818657 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.818523    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e" containerName="maas-api"
Jul 17 18:33:04.818657 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.818528    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e" containerName="maas-api"
Jul 17 18:33:04.818657 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.818535    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4b84b29-e955-45bb-a1ef-7e0d9245a2cb" containerName="istio-proxy"
Jul 17 18:33:04.818657 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.818540    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4b84b29-e955-45bb-a1ef-7e0d9245a2cb" containerName="istio-proxy"
Jul 17 18:33:04.818657 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.818547    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e7321fd-13fb-4d10-8bab-62ed2f69816f" containerName="revoke-keys"
Jul 17 18:33:04.818657 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.818552    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e7321fd-13fb-4d10-8bab-62ed2f69816f" containerName="revoke-keys"
Jul 17 18:33:04.818657 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.818557    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e" containerName="maas-api"
Jul 17 18:33:04.818657 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.818562    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e" containerName="maas-api"
Jul 17 18:33:04.818657 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.818568    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e" containerName="maas-api"
Jul 17 18:33:04.818657 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.818573    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e" containerName="maas-api"
Jul 17 18:33:04.818657 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.818587    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05e0efd2-88f7-4f47-8c00-5e62c5ba7560" containerName="revoke-keys"
Jul 17 18:33:04.818657 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.818592    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="05e0efd2-88f7-4f47-8c00-5e62c5ba7560" containerName="revoke-keys"
Jul 17 18:33:04.818657 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.818602    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4b84b29-e955-45bb-a1ef-7e0d9245a2cb" containerName="istio-proxy"
Jul 17 18:33:04.818657 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.818607    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4b84b29-e955-45bb-a1ef-7e0d9245a2cb" containerName="istio-proxy"
Jul 17 18:33:04.818657 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.818659    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="05e0efd2-88f7-4f47-8c00-5e62c5ba7560" containerName="revoke-keys"
Jul 17 18:33:04.818657 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.818667    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e" containerName="maas-api"
Jul 17 18:33:04.818657 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.818673    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e7321fd-13fb-4d10-8bab-62ed2f69816f" containerName="revoke-keys"
Jul 17 18:33:04.819768 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.818679    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e" containerName="maas-api"
Jul 17 18:33:04.819768 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.818684    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e" containerName="maas-api"
Jul 17 18:33:04.819768 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.818689    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e" containerName="maas-api"
Jul 17 18:33:04.819768 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.818694    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4b84b29-e955-45bb-a1ef-7e0d9245a2cb" containerName="istio-proxy"
Jul 17 18:33:04.819768 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.818700    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4b84b29-e955-45bb-a1ef-7e0d9245a2cb" containerName="istio-proxy"
Jul 17 18:33:04.819768 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.818707    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e7321fd-13fb-4d10-8bab-62ed2f69816f" containerName="revoke-keys"
Jul 17 18:33:04.823390 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.823365    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:04.826174 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.826152    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-df78e9c5-openshift-default-dockercfg-gkqf7\""
Jul 17 18:33:04.835953 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.835929    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"]
Jul 17 18:33:04.857528 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.857495    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:33:04.992124 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.992089    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aba6a3d-1419-4dc9-8e50-52461343204e-credential-socket\") pod \"e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") " pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:04.992310 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.992141    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1aba6a3d-1419-4dc9-8e50-52461343204e-istio-podinfo\") pod \"e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") " pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:04.992310 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.992170    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1aba6a3d-1419-4dc9-8e50-52461343204e-istio-token\") pod \"e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") " pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:04.992310 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.992193    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aba6a3d-1419-4dc9-8e50-52461343204e-workload-socket\") pod \"e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") " pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:04.992310 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.992219    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-854mm\" (UniqueName: \"kubernetes.io/projected/1aba6a3d-1419-4dc9-8e50-52461343204e-kube-api-access-854mm\") pod \"e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") " pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:04.992310 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.992280    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1aba6a3d-1419-4dc9-8e50-52461343204e-istiod-ca-cert\") pod \"e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") " pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:04.992485 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.992333    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1aba6a3d-1419-4dc9-8e50-52461343204e-istio-envoy\") pod \"e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") " pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:04.992485 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.992363    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1aba6a3d-1419-4dc9-8e50-52461343204e-workload-certs\") pod \"e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") " pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:04.992485 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:04.992395    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1aba6a3d-1419-4dc9-8e50-52461343204e-istio-data\") pod \"e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") " pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:05.093627 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:05.093533    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aba6a3d-1419-4dc9-8e50-52461343204e-credential-socket\") pod \"e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") " pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:05.093627 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:05.093589    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1aba6a3d-1419-4dc9-8e50-52461343204e-istio-podinfo\") pod \"e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") " pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:05.093627 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:05.093607    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1aba6a3d-1419-4dc9-8e50-52461343204e-istio-token\") pod \"e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") " pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:05.093627 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:05.093628    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aba6a3d-1419-4dc9-8e50-52461343204e-workload-socket\") pod \"e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") " pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:05.094048 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:05.093658    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-854mm\" (UniqueName: \"kubernetes.io/projected/1aba6a3d-1419-4dc9-8e50-52461343204e-kube-api-access-854mm\") pod \"e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") " pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:05.094048 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:05.093678    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1aba6a3d-1419-4dc9-8e50-52461343204e-istiod-ca-cert\") pod \"e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") " pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:05.094048 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:05.093711    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1aba6a3d-1419-4dc9-8e50-52461343204e-istio-envoy\") pod \"e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") " pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:05.094048 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:05.093752    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1aba6a3d-1419-4dc9-8e50-52461343204e-workload-certs\") pod \"e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") " pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:05.094048 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:05.093936    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1aba6a3d-1419-4dc9-8e50-52461343204e-istio-data\") pod \"e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") " pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:05.094249 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:05.094092    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aba6a3d-1419-4dc9-8e50-52461343204e-credential-socket\") pod \"e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") " pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:05.094249 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:05.094119    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1aba6a3d-1419-4dc9-8e50-52461343204e-workload-certs\") pod \"e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") " pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:05.094249 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:05.094241    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aba6a3d-1419-4dc9-8e50-52461343204e-workload-socket\") pod \"e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") " pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:05.094347 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:05.094290    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1aba6a3d-1419-4dc9-8e50-52461343204e-istio-data\") pod \"e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") " pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:05.094529 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:05.094507    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1aba6a3d-1419-4dc9-8e50-52461343204e-istiod-ca-cert\") pod \"e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") " pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:05.096061 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:05.096037    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1aba6a3d-1419-4dc9-8e50-52461343204e-istio-envoy\") pod \"e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") " pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:05.096372 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:05.096355    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1aba6a3d-1419-4dc9-8e50-52461343204e-istio-podinfo\") pod \"e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") " pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:05.102626 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:05.102601    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1aba6a3d-1419-4dc9-8e50-52461343204e-istio-token\") pod \"e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") " pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:05.102891 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:05.102864    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-854mm\" (UniqueName: \"kubernetes.io/projected/1aba6a3d-1419-4dc9-8e50-52461343204e-kube-api-access-854mm\") pod \"e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") " pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:05.137560 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:05.137519    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:05.284815 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:05.284777    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"]
Jul 17 18:33:05.287941 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:33:05.287913    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aba6a3d_1419_4dc9_8e50_52461343204e.slice/crio-3842d9cd5af28e1453a7267b90d2877c1c5b540481300a4a91383b3f8fb150f5 WatchSource:0}: Error finding container 3842d9cd5af28e1453a7267b90d2877c1c5b540481300a4a91383b3f8fb150f5: Status 404 returned error can't find the container with id 3842d9cd5af28e1453a7267b90d2877c1c5b540481300a4a91383b3f8fb150f5
Jul 17 18:33:05.290037 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:05.289984    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:33:05.290150 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:05.290089    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:33:05.290150 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:05.290136    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:33:05.487273 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:05.487235    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9" event={"ID":"1aba6a3d-1419-4dc9-8e50-52461343204e","Type":"ContainerStarted","Data":"76c3e750e4a33b52b946c169e3db59220320f67a6203d31697c8fc2dba5f5ad2"}
Jul 17 18:33:05.487648 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:05.487292    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9" event={"ID":"1aba6a3d-1419-4dc9-8e50-52461343204e","Type":"ContainerStarted","Data":"3842d9cd5af28e1453a7267b90d2877c1c5b540481300a4a91383b3f8fb150f5"}
Jul 17 18:33:05.510889 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:05.510831    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9" podStartSLOduration=1.510814546 podStartE2EDuration="1.510814546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:33:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:33:05.509350138 +0000 UTC m=+2212.734579450" watchObservedRunningTime="2026-07-17 18:33:05.510814546 +0000 UTC m=+2212.736043853"
Jul 17 18:33:06.071794 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.071764    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:33:06.138591 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.138552    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:06.143931 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.143903    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:06.165808 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.165764    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd"]
Jul 17 18:33:06.166403 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.166375    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e7321fd-13fb-4d10-8bab-62ed2f69816f" containerName="revoke-keys"
Jul 17 18:33:06.166403 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.166401    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e7321fd-13fb-4d10-8bab-62ed2f69816f" containerName="revoke-keys"
Jul 17 18:33:06.166500 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.166415    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e" containerName="maas-api"
Jul 17 18:33:06.166500 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.166424    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e" containerName="maas-api"
Jul 17 18:33:06.166500 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.166437    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e" containerName="maas-api"
Jul 17 18:33:06.166500 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.166446    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e" containerName="maas-api"
Jul 17 18:33:06.166646 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.166573    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e" containerName="maas-api"
Jul 17 18:33:06.166646 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.166585    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e" containerName="maas-api"
Jul 17 18:33:06.166646 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.166601    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e7321fd-13fb-4d10-8bab-62ed2f69816f" containerName="revoke-keys"
Jul 17 18:33:06.168910 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.168879    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:33:06.170256 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.170236    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd"
Jul 17 18:33:06.173160 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.173138    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-df78e9c5-serving-cert\""
Jul 17 18:33:06.180081 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.179740    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd"]
Jul 17 18:33:06.245804 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.245741    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:33:06.305289 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.305252    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rbqx\" (UniqueName: \"kubernetes.io/projected/3f271d64-18b9-4762-9ceb-e31c07a7a470-kube-api-access-6rbqx\") pod \"maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd\" (UID: \"3f271d64-18b9-4762-9ceb-e31c07a7a470\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd"
Jul 17 18:33:06.305289 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.305293    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f271d64-18b9-4762-9ceb-e31c07a7a470-openshift-service-ca\") pod \"maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd\" (UID: \"3f271d64-18b9-4762-9ceb-e31c07a7a470\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd"
Jul 17 18:33:06.305541 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.305380    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f271d64-18b9-4762-9ceb-e31c07a7a470-maas-api-tls\") pod \"maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd\" (UID: \"3f271d64-18b9-4762-9ceb-e31c07a7a470\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd"
Jul 17 18:33:06.405908 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.405810    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rbqx\" (UniqueName: \"kubernetes.io/projected/3f271d64-18b9-4762-9ceb-e31c07a7a470-kube-api-access-6rbqx\") pod \"maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd\" (UID: \"3f271d64-18b9-4762-9ceb-e31c07a7a470\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd"
Jul 17 18:33:06.405908 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.405852    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f271d64-18b9-4762-9ceb-e31c07a7a470-openshift-service-ca\") pod \"maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd\" (UID: \"3f271d64-18b9-4762-9ceb-e31c07a7a470\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd"
Jul 17 18:33:06.406152 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.405942    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f271d64-18b9-4762-9ceb-e31c07a7a470-maas-api-tls\") pod \"maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd\" (UID: \"3f271d64-18b9-4762-9ceb-e31c07a7a470\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd"
Jul 17 18:33:06.406555 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.406528    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f271d64-18b9-4762-9ceb-e31c07a7a470-openshift-service-ca\") pod \"maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd\" (UID: \"3f271d64-18b9-4762-9ceb-e31c07a7a470\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd"
Jul 17 18:33:06.408513 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.408493    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f271d64-18b9-4762-9ceb-e31c07a7a470-maas-api-tls\") pod \"maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd\" (UID: \"3f271d64-18b9-4762-9ceb-e31c07a7a470\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd"
Jul 17 18:33:06.414251 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.414229    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rbqx\" (UniqueName: \"kubernetes.io/projected/3f271d64-18b9-4762-9ceb-e31c07a7a470-kube-api-access-6rbqx\") pod \"maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd\" (UID: \"3f271d64-18b9-4762-9ceb-e31c07a7a470\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd"
Jul 17 18:33:06.431669 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.431643    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:33:06.486681 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.486648    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd"
Jul 17 18:33:06.498041 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.497992    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:06.500129 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.500104    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:06.636630 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.636599    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd"]
Jul 17 18:33:06.638630 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:33:06.638597    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f271d64_18b9_4762_9ceb_e31c07a7a470.slice/crio-edf681eb8d01be673759edc732845aa38c2ea32fb9bbf3cf49c87888de2e9541 WatchSource:0}: Error finding container edf681eb8d01be673759edc732845aa38c2ea32fb9bbf3cf49c87888de2e9541: Status 404 returned error can't find the container with id edf681eb8d01be673759edc732845aa38c2ea32fb9bbf3cf49c87888de2e9541
Jul 17 18:33:06.639947 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.639931    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 18:33:06.760332 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.760290    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:33:06.852709 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:06.852674    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:33:07.503311 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:07.503279    2572 generic.go:356] "Generic (PLEG): container finished" podID="3f271d64-18b9-4762-9ceb-e31c07a7a470" containerID="cc2d9276a0cf2cacfc363f68d6a02360b7653e0bdbdd527b611d11903b7248c3" exitCode=1
Jul 17 18:33:07.503689 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:07.503359    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd" event={"ID":"3f271d64-18b9-4762-9ceb-e31c07a7a470","Type":"ContainerDied","Data":"cc2d9276a0cf2cacfc363f68d6a02360b7653e0bdbdd527b611d11903b7248c3"}
Jul 17 18:33:07.503689 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:07.503410    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd" event={"ID":"3f271d64-18b9-4762-9ceb-e31c07a7a470","Type":"ContainerStarted","Data":"edf681eb8d01be673759edc732845aa38c2ea32fb9bbf3cf49c87888de2e9541"}
Jul 17 18:33:07.503689 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:07.503569    2572 scope.go:117] "RemoveContainer" containerID="cc2d9276a0cf2cacfc363f68d6a02360b7653e0bdbdd527b611d11903b7248c3"
Jul 17 18:33:08.514122 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:08.514088    2572 generic.go:356] "Generic (PLEG): container finished" podID="3f271d64-18b9-4762-9ceb-e31c07a7a470" containerID="f75a1a4a9c5888068e33d0a8d538b3ea25deba1f5d15f8a74f68aea067992e6f" exitCode=1
Jul 17 18:33:08.514581 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:08.514121    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd" event={"ID":"3f271d64-18b9-4762-9ceb-e31c07a7a470","Type":"ContainerDied","Data":"f75a1a4a9c5888068e33d0a8d538b3ea25deba1f5d15f8a74f68aea067992e6f"}
Jul 17 18:33:08.514581 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:08.514182    2572 scope.go:117] "RemoveContainer" containerID="cc2d9276a0cf2cacfc363f68d6a02360b7653e0bdbdd527b611d11903b7248c3"
Jul 17 18:33:08.514581 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:08.514444    2572 scope.go:117] "RemoveContainer" containerID="f75a1a4a9c5888068e33d0a8d538b3ea25deba1f5d15f8a74f68aea067992e6f"
Jul 17 18:33:08.514708 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:33:08.514663    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd_odh-ai-gateway-infra(3f271d64-18b9-4762-9ceb-e31c07a7a470)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470"
Jul 17 18:33:09.519022 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:09.518977    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:33:09.520334 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:09.520313    2572 scope.go:117] "RemoveContainer" containerID="f75a1a4a9c5888068e33d0a8d538b3ea25deba1f5d15f8a74f68aea067992e6f"
Jul 17 18:33:09.520554 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:33:09.520532    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd_odh-ai-gateway-infra(3f271d64-18b9-4762-9ceb-e31c07a7a470)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470"
Jul 17 18:33:09.590723 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:09.589771    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:33:11.487441 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:11.487400    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd"
Jul 17 18:33:11.488573 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:11.488546    2572 scope.go:117] "RemoveContainer" containerID="f75a1a4a9c5888068e33d0a8d538b3ea25deba1f5d15f8a74f68aea067992e6f"
Jul 17 18:33:11.488805 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:33:11.488781    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd_odh-ai-gateway-infra(3f271d64-18b9-4762-9ceb-e31c07a7a470)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470"
Jul 17 18:33:13.018776 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:13.018736    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-nx54j"]
Jul 17 18:33:13.019214 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:13.019201    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7a3f452-fa0c-4763-8469-effe6c26b42e" containerName="maas-api"
Jul 17 18:33:13.023709 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:13.023689    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-nx54j"
Jul 17 18:33:13.026522 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:13.026496    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:33:13.028561 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:13.028533    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-nx54j"]
Jul 17 18:33:13.156901 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:13.156868    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:33:13.180715 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:13.180491    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa1d08f4-50c7-4b9c-90b9-a943df154769-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a5b144da-nx54j\" (UID: \"fa1d08f4-50c7-4b9c-90b9-a943df154769\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-nx54j"
Jul 17 18:33:13.282598 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:13.281516    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa1d08f4-50c7-4b9c-90b9-a943df154769-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a5b144da-nx54j\" (UID: \"fa1d08f4-50c7-4b9c-90b9-a943df154769\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-nx54j"
Jul 17 18:33:13.282598 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:13.282481    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa1d08f4-50c7-4b9c-90b9-a943df154769-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a5b144da-nx54j\" (UID: \"fa1d08f4-50c7-4b9c-90b9-a943df154769\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-nx54j"
Jul 17 18:33:13.338229 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:13.338191    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:33:13.346332 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:13.346308    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-nx54j"
Jul 17 18:33:13.540637 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:13.540613    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-nx54j"]
Jul 17 18:33:13.542960 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:33:13.542926    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa1d08f4_50c7_4b9c_90b9_a943df154769.slice/crio-66965dae5faae44f99649bb645905d1045535fef8958c9a671e3d0caf242c8d2 WatchSource:0}: Error finding container 66965dae5faae44f99649bb645905d1045535fef8958c9a671e3d0caf242c8d2: Status 404 returned error can't find the container with id 66965dae5faae44f99649bb645905d1045535fef8958c9a671e3d0caf242c8d2
Jul 17 18:33:14.545804 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:14.545772    2572 generic.go:356] "Generic (PLEG): container finished" podID="fa1d08f4-50c7-4b9c-90b9-a943df154769" containerID="4f0825bfe7f980427f7ec40d177449cd68f00c5b6815c493b4ead84b9e201139" exitCode=6
Jul 17 18:33:14.546225 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:14.545842    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-nx54j" event={"ID":"fa1d08f4-50c7-4b9c-90b9-a943df154769","Type":"ContainerDied","Data":"4f0825bfe7f980427f7ec40d177449cd68f00c5b6815c493b4ead84b9e201139"}
Jul 17 18:33:14.546225 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:14.545880    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-nx54j" event={"ID":"fa1d08f4-50c7-4b9c-90b9-a943df154769","Type":"ContainerStarted","Data":"66965dae5faae44f99649bb645905d1045535fef8958c9a671e3d0caf242c8d2"}
Jul 17 18:33:14.546225 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:14.546083    2572 scope.go:117] "RemoveContainer" containerID="4f0825bfe7f980427f7ec40d177449cd68f00c5b6815c493b4ead84b9e201139"
Jul 17 18:33:15.552734 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:15.552651    2572 generic.go:356] "Generic (PLEG): container finished" podID="fa1d08f4-50c7-4b9c-90b9-a943df154769" containerID="a3067083f82899052c30c06d922bd80ebbcff1c8a2e936fddd89c3918ed4257f" exitCode=6
Jul 17 18:33:15.552734 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:15.552717    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-nx54j" event={"ID":"fa1d08f4-50c7-4b9c-90b9-a943df154769","Type":"ContainerDied","Data":"a3067083f82899052c30c06d922bd80ebbcff1c8a2e936fddd89c3918ed4257f"}
Jul 17 18:33:15.553225 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:15.552779    2572 scope.go:117] "RemoveContainer" containerID="4f0825bfe7f980427f7ec40d177449cd68f00c5b6815c493b4ead84b9e201139"
Jul 17 18:33:15.553225 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:15.552980    2572 scope.go:117] "RemoveContainer" containerID="a3067083f82899052c30c06d922bd80ebbcff1c8a2e936fddd89c3918ed4257f"
Jul 17 18:33:15.553303 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:33:15.553237    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a5b144da-nx54j_odh-ai-gateway-infra(fa1d08f4-50c7-4b9c-90b9-a943df154769)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-nx54j" podUID="fa1d08f4-50c7-4b9c-90b9-a943df154769"
Jul 17 18:33:16.487518 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:16.487482    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd"
Jul 17 18:33:16.487944 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:16.487925    2572 scope.go:117] "RemoveContainer" containerID="f75a1a4a9c5888068e33d0a8d538b3ea25deba1f5d15f8a74f68aea067992e6f"
Jul 17 18:33:16.488183 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:33:16.488161    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=maas-api pod=maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd_odh-ai-gateway-infra(3f271d64-18b9-4762-9ceb-e31c07a7a470)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470"
Jul 17 18:33:16.559656 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:16.559627    2572 scope.go:117] "RemoveContainer" containerID="a3067083f82899052c30c06d922bd80ebbcff1c8a2e936fddd89c3918ed4257f"
Jul 17 18:33:16.560061 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:33:16.559819    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a5b144da-nx54j_odh-ai-gateway-infra(fa1d08f4-50c7-4b9c-90b9-a943df154769)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-nx54j" podUID="fa1d08f4-50c7-4b9c-90b9-a943df154769"
Jul 17 18:33:17.565432 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:17.565400    2572 generic.go:356] "Generic (PLEG): container finished" podID="1aba6a3d-1419-4dc9-8e50-52461343204e" containerID="76c3e750e4a33b52b946c169e3db59220320f67a6203d31697c8fc2dba5f5ad2" exitCode=0
Jul 17 18:33:17.566032 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:17.565474    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9" event={"ID":"1aba6a3d-1419-4dc9-8e50-52461343204e","Type":"ContainerDied","Data":"76c3e750e4a33b52b946c169e3db59220320f67a6203d31697c8fc2dba5f5ad2"}
Jul 17 18:33:17.566132 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:17.565988    2572 scope.go:117] "RemoveContainer" containerID="76c3e750e4a33b52b946c169e3db59220320f67a6203d31697c8fc2dba5f5ad2"
Jul 17 18:33:17.567198 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:17.567172    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:33:17.567285 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:17.567251    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:33:17.567330 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:17.567294    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:33:18.575485 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:18.575437    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9" event={"ID":"1aba6a3d-1419-4dc9-8e50-52461343204e","Type":"ContainerStarted","Data":"d9684953913dd6d93c01860f4d227b3c3015a235620fb2907045402a615ef57b"}
Jul 17 18:33:19.137795 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:19.137756    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:19.139208 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:19.139177    2572 patch_prober.go:28] interesting pod/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 17 18:33:19.139343 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:19.139230    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9" podUID="1aba6a3d-1419-4dc9-8e50-52461343204e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 17 18:33:20.138594 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:20.138559    2572 patch_prober.go:28] interesting pod/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 17 18:33:20.139023 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:20.138615    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9" podUID="1aba6a3d-1419-4dc9-8e50-52461343204e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 17 18:33:21.137926 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:21.137891    2572 patch_prober.go:28] interesting pod/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 17 18:33:21.138135 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:21.137949    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9" podUID="1aba6a3d-1419-4dc9-8e50-52461343204e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 17 18:33:21.498154 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:21.498096    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:22.137938 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:22.137900    2572 patch_prober.go:28] interesting pod/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Jul 17 18:33:22.138135 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:22.137960    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9" podUID="1aba6a3d-1419-4dc9-8e50-52461343204e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Jul 17 18:33:23.142730 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:23.142695    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:23.143742 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:23.143722    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:33:27.466503 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:27.466465    2572 scope.go:117] "RemoveContainer" containerID="a3067083f82899052c30c06d922bd80ebbcff1c8a2e936fddd89c3918ed4257f"
Jul 17 18:33:28.631389 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:28.631357    2572 generic.go:356] "Generic (PLEG): container finished" podID="fa1d08f4-50c7-4b9c-90b9-a943df154769" containerID="ac8c9bf1a59755e2f10a37891a84a0d463766281157e5bb0cfe9317ff7fea0cd" exitCode=6
Jul 17 18:33:28.631751 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:28.631390    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-nx54j" event={"ID":"fa1d08f4-50c7-4b9c-90b9-a943df154769","Type":"ContainerDied","Data":"ac8c9bf1a59755e2f10a37891a84a0d463766281157e5bb0cfe9317ff7fea0cd"}
Jul 17 18:33:28.632176 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:28.631450    2572 scope.go:117] "RemoveContainer" containerID="a3067083f82899052c30c06d922bd80ebbcff1c8a2e936fddd89c3918ed4257f"
Jul 17 18:33:28.632252 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:28.632241    2572 scope.go:117] "RemoveContainer" containerID="ac8c9bf1a59755e2f10a37891a84a0d463766281157e5bb0cfe9317ff7fea0cd"
Jul 17 18:33:28.632499 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:33:28.632477    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a5b144da-nx54j_odh-ai-gateway-infra(fa1d08f4-50c7-4b9c-90b9-a943df154769)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-nx54j" podUID="fa1d08f4-50c7-4b9c-90b9-a943df154769"
Jul 17 18:33:29.657971 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:29.657936    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-nx54j"]
Jul 17 18:33:29.794103 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:29.794072    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-nx54j"
Jul 17 18:33:29.848172 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:29.848128    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa1d08f4-50c7-4b9c-90b9-a943df154769-maas-api-service-ca\") pod \"fa1d08f4-50c7-4b9c-90b9-a943df154769\" (UID: \"fa1d08f4-50c7-4b9c-90b9-a943df154769\") "
Jul 17 18:33:29.848483 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:29.848461    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa1d08f4-50c7-4b9c-90b9-a943df154769-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fa1d08f4-50c7-4b9c-90b9-a943df154769" (UID: "fa1d08f4-50c7-4b9c-90b9-a943df154769"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:33:29.949868 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:29.949836    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa1d08f4-50c7-4b9c-90b9-a943df154769-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:33:30.643498 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:30.643466    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-nx54j"
Jul 17 18:33:30.643721 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:30.643502    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-nx54j" event={"ID":"fa1d08f4-50c7-4b9c-90b9-a943df154769","Type":"ContainerDied","Data":"66965dae5faae44f99649bb645905d1045535fef8958c9a671e3d0caf242c8d2"}
Jul 17 18:33:30.643721 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:30.643574    2572 scope.go:117] "RemoveContainer" containerID="ac8c9bf1a59755e2f10a37891a84a0d463766281157e5bb0cfe9317ff7fea0cd"
Jul 17 18:33:30.663602 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:30.663577    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-nx54j"]
Jul 17 18:33:30.667800 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:30.667777    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-nx54j"]
Jul 17 18:33:31.466170 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:31.466136    2572 scope.go:117] "RemoveContainer" containerID="f75a1a4a9c5888068e33d0a8d538b3ea25deba1f5d15f8a74f68aea067992e6f"
Jul 17 18:33:31.471822 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:31.471796    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa1d08f4-50c7-4b9c-90b9-a943df154769" path="/var/lib/kubelet/pods/fa1d08f4-50c7-4b9c-90b9-a943df154769/volumes"
Jul 17 18:33:32.656806 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:32.656774    2572 generic.go:356] "Generic (PLEG): container finished" podID="3f271d64-18b9-4762-9ceb-e31c07a7a470" containerID="032af1d02c5bead882f0774af0a828e4e4f1671589da26121bd6e0c6668c0dad" exitCode=1
Jul 17 18:33:32.657243 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:32.656841    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd" event={"ID":"3f271d64-18b9-4762-9ceb-e31c07a7a470","Type":"ContainerDied","Data":"032af1d02c5bead882f0774af0a828e4e4f1671589da26121bd6e0c6668c0dad"}
Jul 17 18:33:32.657243 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:32.656911    2572 scope.go:117] "RemoveContainer" containerID="f75a1a4a9c5888068e33d0a8d538b3ea25deba1f5d15f8a74f68aea067992e6f"
Jul 17 18:33:32.657333 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:32.657275    2572 scope.go:117] "RemoveContainer" containerID="032af1d02c5bead882f0774af0a828e4e4f1671589da26121bd6e0c6668c0dad"
Jul 17 18:33:32.657497 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:33:32.657475    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd_odh-ai-gateway-infra(3f271d64-18b9-4762-9ceb-e31c07a7a470)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470"
Jul 17 18:33:34.873622 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:34.873587    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-kvqnx"]
Jul 17 18:33:34.874059 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:34.874043    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa1d08f4-50c7-4b9c-90b9-a943df154769" containerName="revoke-keys"
Jul 17 18:33:34.874059 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:34.874059    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa1d08f4-50c7-4b9c-90b9-a943df154769" containerName="revoke-keys"
Jul 17 18:33:34.874141 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:34.874075    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa1d08f4-50c7-4b9c-90b9-a943df154769" containerName="revoke-keys"
Jul 17 18:33:34.874141 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:34.874080    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa1d08f4-50c7-4b9c-90b9-a943df154769" containerName="revoke-keys"
Jul 17 18:33:34.874141 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:34.874090    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa1d08f4-50c7-4b9c-90b9-a943df154769" containerName="revoke-keys"
Jul 17 18:33:34.874141 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:34.874098    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa1d08f4-50c7-4b9c-90b9-a943df154769" containerName="revoke-keys"
Jul 17 18:33:34.874278 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:34.874189    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa1d08f4-50c7-4b9c-90b9-a943df154769" containerName="revoke-keys"
Jul 17 18:33:34.874278 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:34.874199    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa1d08f4-50c7-4b9c-90b9-a943df154769" containerName="revoke-keys"
Jul 17 18:33:34.874278 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:34.874206    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa1d08f4-50c7-4b9c-90b9-a943df154769" containerName="revoke-keys"
Jul 17 18:33:34.878478 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:34.878460    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-kvqnx"
Jul 17 18:33:34.881624 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:34.881389    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:33:34.884527 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:34.884498    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-kvqnx"]
Jul 17 18:33:34.996625 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:34.996579    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93a5eeea-4a89-4bb0-96e4-635d746afaa2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35dc36c4-kvqnx\" (UID: \"93a5eeea-4a89-4bb0-96e4-635d746afaa2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-kvqnx"
Jul 17 18:33:35.097522 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:35.097479    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93a5eeea-4a89-4bb0-96e4-635d746afaa2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35dc36c4-kvqnx\" (UID: \"93a5eeea-4a89-4bb0-96e4-635d746afaa2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-kvqnx"
Jul 17 18:33:35.098150 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:35.098131    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93a5eeea-4a89-4bb0-96e4-635d746afaa2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35dc36c4-kvqnx\" (UID: \"93a5eeea-4a89-4bb0-96e4-635d746afaa2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-kvqnx"
Jul 17 18:33:35.191845 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:35.191813    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-kvqnx"
Jul 17 18:33:35.325699 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:35.325663    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-kvqnx"]
Jul 17 18:33:35.327163 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:33:35.327134    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93a5eeea_4a89_4bb0_96e4_635d746afaa2.slice/crio-a53dfe5e7a8163c62e29a1f7766513fd4bda34700f4df153b7c2dfd05ab1bdce WatchSource:0}: Error finding container a53dfe5e7a8163c62e29a1f7766513fd4bda34700f4df153b7c2dfd05ab1bdce: Status 404 returned error can't find the container with id a53dfe5e7a8163c62e29a1f7766513fd4bda34700f4df153b7c2dfd05ab1bdce
Jul 17 18:33:35.675060 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:35.675021    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-kvqnx" event={"ID":"93a5eeea-4a89-4bb0-96e4-635d746afaa2","Type":"ContainerStarted","Data":"4ff69929a1744b9b72aac51fb165370810d6a8f34e799e5c41d66f77f1903eb4"}
Jul 17 18:33:35.675325 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:35.675076    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-kvqnx" event={"ID":"93a5eeea-4a89-4bb0-96e4-635d746afaa2","Type":"ContainerStarted","Data":"a53dfe5e7a8163c62e29a1f7766513fd4bda34700f4df153b7c2dfd05ab1bdce"}
Jul 17 18:33:35.693133 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:35.693075    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-kvqnx" podStartSLOduration=1.693061288 podStartE2EDuration="1.693061288s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:33:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:33:35.690145111 +0000 UTC m=+2242.915374420" watchObservedRunningTime="2026-07-17 18:33:35.693061288 +0000 UTC m=+2242.918290595"
Jul 17 18:33:36.487023 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:36.486956    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd"
Jul 17 18:33:36.487410 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:36.487062    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd"
Jul 17 18:33:36.487410 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:36.487403    2572 scope.go:117] "RemoveContainer" containerID="032af1d02c5bead882f0774af0a828e4e4f1671589da26121bd6e0c6668c0dad"
Jul 17 18:33:36.487599 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:33:36.487580    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd_odh-ai-gateway-infra(3f271d64-18b9-4762-9ceb-e31c07a7a470)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470"
Jul 17 18:33:36.682223 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:36.682192    2572 generic.go:356] "Generic (PLEG): container finished" podID="93a5eeea-4a89-4bb0-96e4-635d746afaa2" containerID="4ff69929a1744b9b72aac51fb165370810d6a8f34e799e5c41d66f77f1903eb4" exitCode=6
Jul 17 18:33:36.682401 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:36.682275    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-kvqnx" event={"ID":"93a5eeea-4a89-4bb0-96e4-635d746afaa2","Type":"ContainerDied","Data":"4ff69929a1744b9b72aac51fb165370810d6a8f34e799e5c41d66f77f1903eb4"}
Jul 17 18:33:36.682474 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:36.682460    2572 scope.go:117] "RemoveContainer" containerID="4ff69929a1744b9b72aac51fb165370810d6a8f34e799e5c41d66f77f1903eb4"
Jul 17 18:33:37.688740 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:37.688713    2572 generic.go:356] "Generic (PLEG): container finished" podID="93a5eeea-4a89-4bb0-96e4-635d746afaa2" containerID="1b2e05ab6cb5903cc8c1e8e6fce2985043e9e273ff7fe3c8dd167211af9fd8e1" exitCode=6
Jul 17 18:33:37.689187 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:37.688797    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-kvqnx" event={"ID":"93a5eeea-4a89-4bb0-96e4-635d746afaa2","Type":"ContainerDied","Data":"1b2e05ab6cb5903cc8c1e8e6fce2985043e9e273ff7fe3c8dd167211af9fd8e1"}
Jul 17 18:33:37.689187 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:37.688864    2572 scope.go:117] "RemoveContainer" containerID="4ff69929a1744b9b72aac51fb165370810d6a8f34e799e5c41d66f77f1903eb4"
Jul 17 18:33:37.689187 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:37.689089    2572 scope.go:117] "RemoveContainer" containerID="1b2e05ab6cb5903cc8c1e8e6fce2985043e9e273ff7fe3c8dd167211af9fd8e1"
Jul 17 18:33:37.689343 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:33:37.689326    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-35dc36c4-kvqnx_odh-ai-gateway-infra(93a5eeea-4a89-4bb0-96e4-635d746afaa2)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-kvqnx" podUID="93a5eeea-4a89-4bb0-96e4-635d746afaa2"
Jul 17 18:33:38.695239 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:38.695211    2572 scope.go:117] "RemoveContainer" containerID="1b2e05ab6cb5903cc8c1e8e6fce2985043e9e273ff7fe3c8dd167211af9fd8e1"
Jul 17 18:33:38.695653 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:33:38.695410    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-35dc36c4-kvqnx_odh-ai-gateway-infra(93a5eeea-4a89-4bb0-96e4-635d746afaa2)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-kvqnx" podUID="93a5eeea-4a89-4bb0-96e4-635d746afaa2"
Jul 17 18:33:49.466218 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:49.466181    2572 scope.go:117] "RemoveContainer" containerID="032af1d02c5bead882f0774af0a828e4e4f1671589da26121bd6e0c6668c0dad"
Jul 17 18:33:49.466651 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:33:49.466389    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 20s restarting failed container=maas-api pod=maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd_odh-ai-gateway-infra(3f271d64-18b9-4762-9ceb-e31c07a7a470)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470"
Jul 17 18:33:52.465830 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:52.465794    2572 scope.go:117] "RemoveContainer" containerID="1b2e05ab6cb5903cc8c1e8e6fce2985043e9e273ff7fe3c8dd167211af9fd8e1"
Jul 17 18:33:52.770875 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:52.770788    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-kvqnx" event={"ID":"93a5eeea-4a89-4bb0-96e4-635d746afaa2","Type":"ContainerStarted","Data":"7346650cdf728ade24c279ffb477ff9406ea4ffebff28687ae1bcb8f64f19b51"}
Jul 17 18:33:53.776959 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:53.776923    2572 generic.go:356] "Generic (PLEG): container finished" podID="93a5eeea-4a89-4bb0-96e4-635d746afaa2" containerID="7346650cdf728ade24c279ffb477ff9406ea4ffebff28687ae1bcb8f64f19b51" exitCode=6
Jul 17 18:33:53.777474 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:53.777019    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-kvqnx" event={"ID":"93a5eeea-4a89-4bb0-96e4-635d746afaa2","Type":"ContainerDied","Data":"7346650cdf728ade24c279ffb477ff9406ea4ffebff28687ae1bcb8f64f19b51"}
Jul 17 18:33:53.777474 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:53.777091    2572 scope.go:117] "RemoveContainer" containerID="1b2e05ab6cb5903cc8c1e8e6fce2985043e9e273ff7fe3c8dd167211af9fd8e1"
Jul 17 18:33:53.777474 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:53.777389    2572 scope.go:117] "RemoveContainer" containerID="7346650cdf728ade24c279ffb477ff9406ea4ffebff28687ae1bcb8f64f19b51"
Jul 17 18:33:53.777684 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:33:53.777661    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-35dc36c4-kvqnx_odh-ai-gateway-infra(93a5eeea-4a89-4bb0-96e4-635d746afaa2)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-kvqnx" podUID="93a5eeea-4a89-4bb0-96e4-635d746afaa2"
Jul 17 18:33:53.800353 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:53.800321    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-kvqnx"]
Jul 17 18:33:54.920535 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:54.920504    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-kvqnx"
Jul 17 18:33:55.089382 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:55.089268    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93a5eeea-4a89-4bb0-96e4-635d746afaa2-maas-api-service-ca\") pod \"93a5eeea-4a89-4bb0-96e4-635d746afaa2\" (UID: \"93a5eeea-4a89-4bb0-96e4-635d746afaa2\") "
Jul 17 18:33:55.089633 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:55.089608    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93a5eeea-4a89-4bb0-96e4-635d746afaa2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "93a5eeea-4a89-4bb0-96e4-635d746afaa2" (UID: "93a5eeea-4a89-4bb0-96e4-635d746afaa2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:33:55.190928 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:55.190875    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93a5eeea-4a89-4bb0-96e4-635d746afaa2-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:33:55.790140 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:55.790048    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-kvqnx"
Jul 17 18:33:55.790140 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:55.790049    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-kvqnx" event={"ID":"93a5eeea-4a89-4bb0-96e4-635d746afaa2","Type":"ContainerDied","Data":"a53dfe5e7a8163c62e29a1f7766513fd4bda34700f4df153b7c2dfd05ab1bdce"}
Jul 17 18:33:55.790373 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:55.790181    2572 scope.go:117] "RemoveContainer" containerID="7346650cdf728ade24c279ffb477ff9406ea4ffebff28687ae1bcb8f64f19b51"
Jul 17 18:33:55.806380 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:55.806355    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-kvqnx"]
Jul 17 18:33:55.812659 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:55.812638    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-kvqnx"]
Jul 17 18:33:57.471884 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:33:57.471851    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93a5eeea-4a89-4bb0-96e4-635d746afaa2" path="/var/lib/kubelet/pods/93a5eeea-4a89-4bb0-96e4-635d746afaa2/volumes"
Jul 17 18:34:03.059716 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:03.059672    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-fvb87"]
Jul 17 18:34:03.060302 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:03.060084    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93a5eeea-4a89-4bb0-96e4-635d746afaa2" containerName="revoke-keys"
Jul 17 18:34:03.060302 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:03.060096    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="93a5eeea-4a89-4bb0-96e4-635d746afaa2" containerName="revoke-keys"
Jul 17 18:34:03.060302 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:03.060107    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93a5eeea-4a89-4bb0-96e4-635d746afaa2" containerName="revoke-keys"
Jul 17 18:34:03.060302 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:03.060113    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="93a5eeea-4a89-4bb0-96e4-635d746afaa2" containerName="revoke-keys"
Jul 17 18:34:03.060302 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:03.060200    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="93a5eeea-4a89-4bb0-96e4-635d746afaa2" containerName="revoke-keys"
Jul 17 18:34:03.060302 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:03.060211    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="93a5eeea-4a89-4bb0-96e4-635d746afaa2" containerName="revoke-keys"
Jul 17 18:34:03.064779 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:03.064759    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-fvb87"
Jul 17 18:34:03.067966 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:03.067935    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:34:03.070872 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:03.070846    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-fvb87"]
Jul 17 18:34:03.260427 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:03.260387    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a5b144da-fvb87\" (UID: \"cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-fvb87"
Jul 17 18:34:03.362044 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:03.361914    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a5b144da-fvb87\" (UID: \"cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-fvb87"
Jul 17 18:34:03.362582 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:03.362561    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a5b144da-fvb87\" (UID: \"cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-fvb87"
Jul 17 18:34:03.378878 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:03.378847    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-fvb87"
Jul 17 18:34:03.517412 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:03.517385    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-fvb87"]
Jul 17 18:34:03.519429 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:34:03.519397    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb6f6c2d_2c42_4cb3_8b57_a3b30fb91127.slice/crio-af94b9f2c141eefeab58dc4a3bde0bac2d89bf2f1a147dde1eefb243537a8816 WatchSource:0}: Error finding container af94b9f2c141eefeab58dc4a3bde0bac2d89bf2f1a147dde1eefb243537a8816: Status 404 returned error can't find the container with id af94b9f2c141eefeab58dc4a3bde0bac2d89bf2f1a147dde1eefb243537a8816
Jul 17 18:34:03.838061 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:03.837982    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-fvb87" event={"ID":"cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127","Type":"ContainerStarted","Data":"f96e652c4995414230396a77616b843861fce65e58449cc969d1dcdf7d097926"}
Jul 17 18:34:03.838219 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:03.838083    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-fvb87" event={"ID":"cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127","Type":"ContainerStarted","Data":"af94b9f2c141eefeab58dc4a3bde0bac2d89bf2f1a147dde1eefb243537a8816"}
Jul 17 18:34:03.854498 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:03.854447    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-fvb87" podStartSLOduration=0.854431447 podStartE2EDuration="854.431447ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:34:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:34:03.853333745 +0000 UTC m=+2271.078563052" watchObservedRunningTime="2026-07-17 18:34:03.854431447 +0000 UTC m=+2271.079660805"
Jul 17 18:34:04.466016 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:04.465967    2572 scope.go:117] "RemoveContainer" containerID="032af1d02c5bead882f0774af0a828e4e4f1671589da26121bd6e0c6668c0dad"
Jul 17 18:34:04.844529 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:04.844427    2572 generic.go:356] "Generic (PLEG): container finished" podID="cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127" containerID="f96e652c4995414230396a77616b843861fce65e58449cc969d1dcdf7d097926" exitCode=6
Jul 17 18:34:04.844709 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:04.844598    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-fvb87" event={"ID":"cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127","Type":"ContainerDied","Data":"f96e652c4995414230396a77616b843861fce65e58449cc969d1dcdf7d097926"}
Jul 17 18:34:04.844782 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:04.844734    2572 scope.go:117] "RemoveContainer" containerID="f96e652c4995414230396a77616b843861fce65e58449cc969d1dcdf7d097926"
Jul 17 18:34:05.851623 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:05.851539    2572 generic.go:356] "Generic (PLEG): container finished" podID="3f271d64-18b9-4762-9ceb-e31c07a7a470" containerID="87b43f5481e24e18ce98ab73caf321206d47cdb7f5a5779828c4dce32c1d93a4" exitCode=1
Jul 17 18:34:05.851623 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:05.851609    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd" event={"ID":"3f271d64-18b9-4762-9ceb-e31c07a7a470","Type":"ContainerDied","Data":"87b43f5481e24e18ce98ab73caf321206d47cdb7f5a5779828c4dce32c1d93a4"}
Jul 17 18:34:05.852144 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:05.851675    2572 scope.go:117] "RemoveContainer" containerID="032af1d02c5bead882f0774af0a828e4e4f1671589da26121bd6e0c6668c0dad"
Jul 17 18:34:05.852144 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:05.852078    2572 scope.go:117] "RemoveContainer" containerID="87b43f5481e24e18ce98ab73caf321206d47cdb7f5a5779828c4dce32c1d93a4"
Jul 17 18:34:05.852320 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:34:05.852293    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd_odh-ai-gateway-infra(3f271d64-18b9-4762-9ceb-e31c07a7a470)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470"
Jul 17 18:34:05.853598 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:05.853580    2572 generic.go:356] "Generic (PLEG): container finished" podID="cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127" containerID="dd05ac1a4b4d4cdcc9b3b4cea461b5bcfbe726495e0ea33f7a4d6a02cbd7e94e" exitCode=6
Jul 17 18:34:05.853687 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:05.853665    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-fvb87" event={"ID":"cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127","Type":"ContainerDied","Data":"dd05ac1a4b4d4cdcc9b3b4cea461b5bcfbe726495e0ea33f7a4d6a02cbd7e94e"}
Jul 17 18:34:05.853835 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:05.853824    2572 scope.go:117] "RemoveContainer" containerID="dd05ac1a4b4d4cdcc9b3b4cea461b5bcfbe726495e0ea33f7a4d6a02cbd7e94e"
Jul 17 18:34:05.854034 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:34:05.854017    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a5b144da-fvb87_odh-ai-gateway-infra(cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-fvb87" podUID="cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127"
Jul 17 18:34:05.863089 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:05.863064    2572 scope.go:117] "RemoveContainer" containerID="f96e652c4995414230396a77616b843861fce65e58449cc969d1dcdf7d097926"
Jul 17 18:34:06.486765 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:06.486733    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd"
Jul 17 18:34:06.487050 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:06.486796    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd"
Jul 17 18:34:06.861286 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:06.861209    2572 scope.go:117] "RemoveContainer" containerID="87b43f5481e24e18ce98ab73caf321206d47cdb7f5a5779828c4dce32c1d93a4"
Jul 17 18:34:06.861685 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:34:06.861432    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd_odh-ai-gateway-infra(3f271d64-18b9-4762-9ceb-e31c07a7a470)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470"
Jul 17 18:34:06.862672 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:06.862655    2572 scope.go:117] "RemoveContainer" containerID="dd05ac1a4b4d4cdcc9b3b4cea461b5bcfbe726495e0ea33f7a4d6a02cbd7e94e"
Jul 17 18:34:06.862822 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:34:06.862804    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a5b144da-fvb87_odh-ai-gateway-infra(cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-fvb87" podUID="cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127"
Jul 17 18:34:21.465944 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:21.465904    2572 scope.go:117] "RemoveContainer" containerID="87b43f5481e24e18ce98ab73caf321206d47cdb7f5a5779828c4dce32c1d93a4"
Jul 17 18:34:21.466508 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:34:21.466170    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd_odh-ai-gateway-infra(3f271d64-18b9-4762-9ceb-e31c07a7a470)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470"
Jul 17 18:34:22.465561 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:22.465529    2572 scope.go:117] "RemoveContainer" containerID="dd05ac1a4b4d4cdcc9b3b4cea461b5bcfbe726495e0ea33f7a4d6a02cbd7e94e"
Jul 17 18:34:22.949106 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:22.949073    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-fvb87" event={"ID":"cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127","Type":"ContainerStarted","Data":"f0a0a01960ba3af9f4fe1c2a281538e99f17e85e3dea092a0a7b5d943e0a5db1"}
Jul 17 18:34:23.956468 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:23.956432    2572 generic.go:356] "Generic (PLEG): container finished" podID="cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127" containerID="f0a0a01960ba3af9f4fe1c2a281538e99f17e85e3dea092a0a7b5d943e0a5db1" exitCode=6
Jul 17 18:34:23.956981 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:23.956508    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-fvb87" event={"ID":"cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127","Type":"ContainerDied","Data":"f0a0a01960ba3af9f4fe1c2a281538e99f17e85e3dea092a0a7b5d943e0a5db1"}
Jul 17 18:34:23.956981 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:23.956586    2572 scope.go:117] "RemoveContainer" containerID="dd05ac1a4b4d4cdcc9b3b4cea461b5bcfbe726495e0ea33f7a4d6a02cbd7e94e"
Jul 17 18:34:23.956981 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:23.956931    2572 scope.go:117] "RemoveContainer" containerID="f0a0a01960ba3af9f4fe1c2a281538e99f17e85e3dea092a0a7b5d943e0a5db1"
Jul 17 18:34:23.957184 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:34:23.957143    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a5b144da-fvb87_odh-ai-gateway-infra(cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-fvb87" podUID="cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127"
Jul 17 18:34:23.977628 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:23.977600    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-fvb87"]
Jul 17 18:34:25.104659 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:25.104630    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-fvb87"
Jul 17 18:34:25.161697 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:25.161661    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127-maas-api-service-ca\") pod \"cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127\" (UID: \"cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127\") "
Jul 17 18:34:25.162033 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:25.162010    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127" (UID: "cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:34:25.262869 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:25.262777    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:34:25.969132 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:25.969097    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-fvb87"
Jul 17 18:34:25.969346 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:25.969136    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-fvb87" event={"ID":"cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127","Type":"ContainerDied","Data":"af94b9f2c141eefeab58dc4a3bde0bac2d89bf2f1a147dde1eefb243537a8816"}
Jul 17 18:34:25.969346 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:25.969198    2572 scope.go:117] "RemoveContainer" containerID="f0a0a01960ba3af9f4fe1c2a281538e99f17e85e3dea092a0a7b5d943e0a5db1"
Jul 17 18:34:25.985619 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:25.985588    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-fvb87"]
Jul 17 18:34:25.991179 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:25.991157    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-fvb87"]
Jul 17 18:34:27.471279 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:27.471248    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127" path="/var/lib/kubelet/pods/cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127/volumes"
Jul 17 18:34:34.915607 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:34.915571    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-jnmbq"]
Jul 17 18:34:34.916030 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:34.915950    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127" containerName="revoke-keys"
Jul 17 18:34:34.916030 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:34.915961    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127" containerName="revoke-keys"
Jul 17 18:34:34.916030 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:34.915976    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127" containerName="revoke-keys"
Jul 17 18:34:34.916030 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:34.915982    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127" containerName="revoke-keys"
Jul 17 18:34:34.916030 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:34.915989    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93a5eeea-4a89-4bb0-96e4-635d746afaa2" containerName="revoke-keys"
Jul 17 18:34:34.916030 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:34.915994    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="93a5eeea-4a89-4bb0-96e4-635d746afaa2" containerName="revoke-keys"
Jul 17 18:34:34.916233 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:34.916073    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127" containerName="revoke-keys"
Jul 17 18:34:34.916233 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:34.916081    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127" containerName="revoke-keys"
Jul 17 18:34:34.916233 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:34.916090    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="93a5eeea-4a89-4bb0-96e4-635d746afaa2" containerName="revoke-keys"
Jul 17 18:34:34.920468 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:34.920450    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-jnmbq"
Jul 17 18:34:34.923427 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:34.923403    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:34:34.926855 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:34.926820    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-jnmbq"]
Jul 17 18:34:35.046781 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:35.046740    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8909f297-6281-4f9f-bdec-7b1a6bb81547-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35dc36c4-jnmbq\" (UID: \"8909f297-6281-4f9f-bdec-7b1a6bb81547\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-jnmbq"
Jul 17 18:34:35.148346 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:35.148308    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8909f297-6281-4f9f-bdec-7b1a6bb81547-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35dc36c4-jnmbq\" (UID: \"8909f297-6281-4f9f-bdec-7b1a6bb81547\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-jnmbq"
Jul 17 18:34:35.148956 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:35.148933    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8909f297-6281-4f9f-bdec-7b1a6bb81547-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35dc36c4-jnmbq\" (UID: \"8909f297-6281-4f9f-bdec-7b1a6bb81547\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-jnmbq"
Jul 17 18:34:35.241815 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:35.241761    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-jnmbq"
Jul 17 18:34:35.379705 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:35.379670    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-jnmbq"]
Jul 17 18:34:35.380846 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:34:35.380818    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8909f297_6281_4f9f_bdec_7b1a6bb81547.slice/crio-361fc613ab9a1bb39924f75a54e62197999a4e773e9d6f1acd26c525da9e2d65 WatchSource:0}: Error finding container 361fc613ab9a1bb39924f75a54e62197999a4e773e9d6f1acd26c525da9e2d65: Status 404 returned error can't find the container with id 361fc613ab9a1bb39924f75a54e62197999a4e773e9d6f1acd26c525da9e2d65
Jul 17 18:34:36.018499 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:36.018465    2572 generic.go:356] "Generic (PLEG): container finished" podID="8909f297-6281-4f9f-bdec-7b1a6bb81547" containerID="4a2841022220082e007b0516261954d935f5e88e6b7ffb706935dbb5324abe7a" exitCode=6
Jul 17 18:34:36.018878 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:36.018500    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-jnmbq" event={"ID":"8909f297-6281-4f9f-bdec-7b1a6bb81547","Type":"ContainerDied","Data":"4a2841022220082e007b0516261954d935f5e88e6b7ffb706935dbb5324abe7a"}
Jul 17 18:34:36.018878 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:36.018551    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-jnmbq" event={"ID":"8909f297-6281-4f9f-bdec-7b1a6bb81547","Type":"ContainerStarted","Data":"361fc613ab9a1bb39924f75a54e62197999a4e773e9d6f1acd26c525da9e2d65"}
Jul 17 18:34:36.018878 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:36.018743    2572 scope.go:117] "RemoveContainer" containerID="4a2841022220082e007b0516261954d935f5e88e6b7ffb706935dbb5324abe7a"
Jul 17 18:34:36.466091 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:36.466064    2572 scope.go:117] "RemoveContainer" containerID="87b43f5481e24e18ce98ab73caf321206d47cdb7f5a5779828c4dce32c1d93a4"
Jul 17 18:34:36.466283 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:34:36.466254    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 40s restarting failed container=maas-api pod=maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd_odh-ai-gateway-infra(3f271d64-18b9-4762-9ceb-e31c07a7a470)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470"
Jul 17 18:34:37.026235 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:37.026197    2572 generic.go:356] "Generic (PLEG): container finished" podID="8909f297-6281-4f9f-bdec-7b1a6bb81547" containerID="9b86d8f31234eeeedd1c61414cb80b54c922987323378901c33a8a57b2fc98e3" exitCode=6
Jul 17 18:34:37.026686 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:37.026249    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-jnmbq" event={"ID":"8909f297-6281-4f9f-bdec-7b1a6bb81547","Type":"ContainerDied","Data":"9b86d8f31234eeeedd1c61414cb80b54c922987323378901c33a8a57b2fc98e3"}
Jul 17 18:34:37.026686 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:37.026309    2572 scope.go:117] "RemoveContainer" containerID="4a2841022220082e007b0516261954d935f5e88e6b7ffb706935dbb5324abe7a"
Jul 17 18:34:37.026686 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:37.026523    2572 scope.go:117] "RemoveContainer" containerID="9b86d8f31234eeeedd1c61414cb80b54c922987323378901c33a8a57b2fc98e3"
Jul 17 18:34:37.026830 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:34:37.026746    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-35dc36c4-jnmbq_odh-ai-gateway-infra(8909f297-6281-4f9f-bdec-7b1a6bb81547)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-jnmbq" podUID="8909f297-6281-4f9f-bdec-7b1a6bb81547"
Jul 17 18:34:38.032458 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:38.032427    2572 scope.go:117] "RemoveContainer" containerID="9b86d8f31234eeeedd1c61414cb80b54c922987323378901c33a8a57b2fc98e3"
Jul 17 18:34:38.032956 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:34:38.032619    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-35dc36c4-jnmbq_odh-ai-gateway-infra(8909f297-6281-4f9f-bdec-7b1a6bb81547)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-jnmbq" podUID="8909f297-6281-4f9f-bdec-7b1a6bb81547"
Jul 17 18:34:50.466248 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:50.466212    2572 scope.go:117] "RemoveContainer" containerID="9b86d8f31234eeeedd1c61414cb80b54c922987323378901c33a8a57b2fc98e3"
Jul 17 18:34:51.099406 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:51.099375    2572 generic.go:356] "Generic (PLEG): container finished" podID="8909f297-6281-4f9f-bdec-7b1a6bb81547" containerID="9126b45babdfa81fee1abdb629dec32c2ec234f33788bff052784467b7e687f8" exitCode=6
Jul 17 18:34:51.099566 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:51.099449    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-jnmbq" event={"ID":"8909f297-6281-4f9f-bdec-7b1a6bb81547","Type":"ContainerDied","Data":"9126b45babdfa81fee1abdb629dec32c2ec234f33788bff052784467b7e687f8"}
Jul 17 18:34:51.099566 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:51.099512    2572 scope.go:117] "RemoveContainer" containerID="9b86d8f31234eeeedd1c61414cb80b54c922987323378901c33a8a57b2fc98e3"
Jul 17 18:34:51.099889 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:51.099871    2572 scope.go:117] "RemoveContainer" containerID="9126b45babdfa81fee1abdb629dec32c2ec234f33788bff052784467b7e687f8"
Jul 17 18:34:51.100177 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:34:51.100152    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-35dc36c4-jnmbq_odh-ai-gateway-infra(8909f297-6281-4f9f-bdec-7b1a6bb81547)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-jnmbq" podUID="8909f297-6281-4f9f-bdec-7b1a6bb81547"
Jul 17 18:34:51.465893 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:51.465861    2572 scope.go:117] "RemoveContainer" containerID="87b43f5481e24e18ce98ab73caf321206d47cdb7f5a5779828c4dce32c1d93a4"
Jul 17 18:34:52.108867 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:52.108834    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd" event={"ID":"3f271d64-18b9-4762-9ceb-e31c07a7a470","Type":"ContainerStarted","Data":"20c5ef47e519ba9d4d24d0217f84ea86502aa127282c77771b361fbbdc22ac69"}
Jul 17 18:34:52.109285 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:52.109051    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd"
Jul 17 18:34:52.124657 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:52.124619    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-jnmbq"]
Jul 17 18:34:52.130820 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:52.130759    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd" podStartSLOduration=104.069780247 podStartE2EDuration="1m46.13073776s" totalImagesPullingTime="2.060957513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:33:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:34:52.127875173 +0000 UTC m=+2319.353104481" watchObservedRunningTime="2026-07-17 18:34:52.13073776 +0000 UTC m=+2319.355967069"
Jul 17 18:34:52.270282 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:52.270256    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-jnmbq"
Jul 17 18:34:52.301711 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:52.301686    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8909f297-6281-4f9f-bdec-7b1a6bb81547-maas-api-service-ca\") pod \"8909f297-6281-4f9f-bdec-7b1a6bb81547\" (UID: \"8909f297-6281-4f9f-bdec-7b1a6bb81547\") "
Jul 17 18:34:52.302026 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:52.301982    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8909f297-6281-4f9f-bdec-7b1a6bb81547-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8909f297-6281-4f9f-bdec-7b1a6bb81547" (UID: "8909f297-6281-4f9f-bdec-7b1a6bb81547"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:34:52.403079 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:52.402989    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8909f297-6281-4f9f-bdec-7b1a6bb81547-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:34:53.114952 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:53.114919    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-jnmbq"
Jul 17 18:34:53.114952 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:53.114927    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-jnmbq" event={"ID":"8909f297-6281-4f9f-bdec-7b1a6bb81547","Type":"ContainerDied","Data":"361fc613ab9a1bb39924f75a54e62197999a4e773e9d6f1acd26c525da9e2d65"}
Jul 17 18:34:53.115511 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:53.114989    2572 scope.go:117] "RemoveContainer" containerID="9126b45babdfa81fee1abdb629dec32c2ec234f33788bff052784467b7e687f8"
Jul 17 18:34:53.116947 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:53.116919    2572 generic.go:356] "Generic (PLEG): container finished" podID="3f271d64-18b9-4762-9ceb-e31c07a7a470" containerID="20c5ef47e519ba9d4d24d0217f84ea86502aa127282c77771b361fbbdc22ac69" exitCode=1
Jul 17 18:34:53.117080 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:53.116947    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd" event={"ID":"3f271d64-18b9-4762-9ceb-e31c07a7a470","Type":"ContainerDied","Data":"20c5ef47e519ba9d4d24d0217f84ea86502aa127282c77771b361fbbdc22ac69"}
Jul 17 18:34:53.117273 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:53.117258    2572 scope.go:117] "RemoveContainer" containerID="20c5ef47e519ba9d4d24d0217f84ea86502aa127282c77771b361fbbdc22ac69"
Jul 17 18:34:53.117454 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:34:53.117437    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd_odh-ai-gateway-infra(3f271d64-18b9-4762-9ceb-e31c07a7a470)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470"
Jul 17 18:34:53.124299 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:53.124277    2572 scope.go:117] "RemoveContainer" containerID="87b43f5481e24e18ce98ab73caf321206d47cdb7f5a5779828c4dce32c1d93a4"
Jul 17 18:34:53.147928 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:53.147900    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-jnmbq"]
Jul 17 18:34:53.151533 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:53.151511    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-jnmbq"]
Jul 17 18:34:53.472050 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:53.472020    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8909f297-6281-4f9f-bdec-7b1a6bb81547" path="/var/lib/kubelet/pods/8909f297-6281-4f9f-bdec-7b1a6bb81547/volumes"
Jul 17 18:34:54.124300 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:54.124272    2572 scope.go:117] "RemoveContainer" containerID="20c5ef47e519ba9d4d24d0217f84ea86502aa127282c77771b361fbbdc22ac69"
Jul 17 18:34:54.124752 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:34:54.124531    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd_odh-ai-gateway-infra(3f271d64-18b9-4762-9ceb-e31c07a7a470)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470"
Jul 17 18:34:56.487013 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:56.486974    2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd"
Jul 17 18:34:56.487435 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:34:56.487416    2572 scope.go:117] "RemoveContainer" containerID="20c5ef47e519ba9d4d24d0217f84ea86502aa127282c77771b361fbbdc22ac69"
Jul 17 18:34:56.487622 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:34:56.487602    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd_odh-ai-gateway-infra(3f271d64-18b9-4762-9ceb-e31c07a7a470)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470"
Jul 17 18:35:09.465679 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:09.465648    2572 scope.go:117] "RemoveContainer" containerID="20c5ef47e519ba9d4d24d0217f84ea86502aa127282c77771b361fbbdc22ac69"
Jul 17 18:35:09.466207 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:35:09.465825    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd_odh-ai-gateway-infra(3f271d64-18b9-4762-9ceb-e31c07a7a470)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470"
Jul 17 18:35:10.573269 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:10.573235    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-zb6m9"]
Jul 17 18:35:10.573654 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:10.573588    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8909f297-6281-4f9f-bdec-7b1a6bb81547" containerName="revoke-keys"
Jul 17 18:35:10.573654 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:10.573599    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8909f297-6281-4f9f-bdec-7b1a6bb81547" containerName="revoke-keys"
Jul 17 18:35:10.573654 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:10.573606    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8909f297-6281-4f9f-bdec-7b1a6bb81547" containerName="revoke-keys"
Jul 17 18:35:10.573654 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:10.573613    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8909f297-6281-4f9f-bdec-7b1a6bb81547" containerName="revoke-keys"
Jul 17 18:35:10.573654 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:10.573632    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8909f297-6281-4f9f-bdec-7b1a6bb81547" containerName="revoke-keys"
Jul 17 18:35:10.573654 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:10.573639    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8909f297-6281-4f9f-bdec-7b1a6bb81547" containerName="revoke-keys"
Jul 17 18:35:10.573654 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:10.573652    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127" containerName="revoke-keys"
Jul 17 18:35:10.573654 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:10.573658    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127" containerName="revoke-keys"
Jul 17 18:35:10.573945 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:10.573718    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8909f297-6281-4f9f-bdec-7b1a6bb81547" containerName="revoke-keys"
Jul 17 18:35:10.573945 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:10.573729    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb6f6c2d-2c42-4cb3-8b57-a3b30fb91127" containerName="revoke-keys"
Jul 17 18:35:10.573945 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:10.573738    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8909f297-6281-4f9f-bdec-7b1a6bb81547" containerName="revoke-keys"
Jul 17 18:35:10.573945 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:10.573747    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8909f297-6281-4f9f-bdec-7b1a6bb81547" containerName="revoke-keys"
Jul 17 18:35:10.577859 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:10.577840    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-zb6m9"
Jul 17 18:35:10.580289 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:10.580270    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:35:10.583449 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:10.583383    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-zb6m9"]
Jul 17 18:35:10.670181 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:10.670143    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f38c2e1-7429-48b4-bb1e-4f641c10a4eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-df78e9c5-zb6m9\" (UID: \"8f38c2e1-7429-48b4-bb1e-4f641c10a4eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-zb6m9"
Jul 17 18:35:10.771637 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:10.771599    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f38c2e1-7429-48b4-bb1e-4f641c10a4eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-df78e9c5-zb6m9\" (UID: \"8f38c2e1-7429-48b4-bb1e-4f641c10a4eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-zb6m9"
Jul 17 18:35:10.772259 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:10.772238    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f38c2e1-7429-48b4-bb1e-4f641c10a4eb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-df78e9c5-zb6m9\" (UID: \"8f38c2e1-7429-48b4-bb1e-4f641c10a4eb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-zb6m9"
Jul 17 18:35:10.892557 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:10.892466    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-zb6m9"
Jul 17 18:35:11.032709 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:11.032680    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-zb6m9"]
Jul 17 18:35:11.034333 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:35:11.034301    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f38c2e1_7429_48b4_bb1e_4f641c10a4eb.slice/crio-7e7c0757f6cd23be10191aa992502e7bf7503ba172c1e2b3136dfa6db9007730 WatchSource:0}: Error finding container 7e7c0757f6cd23be10191aa992502e7bf7503ba172c1e2b3136dfa6db9007730: Status 404 returned error can't find the container with id 7e7c0757f6cd23be10191aa992502e7bf7503ba172c1e2b3136dfa6db9007730
Jul 17 18:35:11.209043 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:11.208978    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-zb6m9" event={"ID":"8f38c2e1-7429-48b4-bb1e-4f641c10a4eb","Type":"ContainerStarted","Data":"7e7c0757f6cd23be10191aa992502e7bf7503ba172c1e2b3136dfa6db9007730"}
Jul 17 18:35:12.215079 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:12.215041    2572 generic.go:356] "Generic (PLEG): container finished" podID="8f38c2e1-7429-48b4-bb1e-4f641c10a4eb" containerID="3c35b2eaaa6eb4dfc89bcd0af6c6ca4f68c76b9df0fe3d6d776ed7ab0753efd8" exitCode=7
Jul 17 18:35:12.215457 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:12.215125    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-zb6m9" event={"ID":"8f38c2e1-7429-48b4-bb1e-4f641c10a4eb","Type":"ContainerDied","Data":"3c35b2eaaa6eb4dfc89bcd0af6c6ca4f68c76b9df0fe3d6d776ed7ab0753efd8"}
Jul 17 18:35:12.215457 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:12.215272    2572 scope.go:117] "RemoveContainer" containerID="3c35b2eaaa6eb4dfc89bcd0af6c6ca4f68c76b9df0fe3d6d776ed7ab0753efd8"
Jul 17 18:35:13.221954 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:13.221924    2572 generic.go:356] "Generic (PLEG): container finished" podID="8f38c2e1-7429-48b4-bb1e-4f641c10a4eb" containerID="ee517fec25e9d9a2dd8c0f9f7d65320c20f7d9bc553a4202ce7ec47603cc5461" exitCode=7
Jul 17 18:35:13.222437 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:13.222024    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-zb6m9" event={"ID":"8f38c2e1-7429-48b4-bb1e-4f641c10a4eb","Type":"ContainerDied","Data":"ee517fec25e9d9a2dd8c0f9f7d65320c20f7d9bc553a4202ce7ec47603cc5461"}
Jul 17 18:35:13.222437 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:13.222082    2572 scope.go:117] "RemoveContainer" containerID="3c35b2eaaa6eb4dfc89bcd0af6c6ca4f68c76b9df0fe3d6d776ed7ab0753efd8"
Jul 17 18:35:13.222437 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:13.222360    2572 scope.go:117] "RemoveContainer" containerID="ee517fec25e9d9a2dd8c0f9f7d65320c20f7d9bc553a4202ce7ec47603cc5461"
Jul 17 18:35:13.222621 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:35:13.222595    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-df78e9c5-zb6m9_odh-ai-gateway-infra(8f38c2e1-7429-48b4-bb1e-4f641c10a4eb)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-zb6m9" podUID="8f38c2e1-7429-48b4-bb1e-4f641c10a4eb"
Jul 17 18:35:14.231824 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:14.231797    2572 scope.go:117] "RemoveContainer" containerID="ee517fec25e9d9a2dd8c0f9f7d65320c20f7d9bc553a4202ce7ec47603cc5461"
Jul 17 18:35:14.232248 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:35:14.231990    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-df78e9c5-zb6m9_odh-ai-gateway-infra(8f38c2e1-7429-48b4-bb1e-4f641c10a4eb)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-zb6m9" podUID="8f38c2e1-7429-48b4-bb1e-4f641c10a4eb"
Jul 17 18:35:17.552790 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:17.552750    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:35:17.639991 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:17.639957    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:35:23.468440 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:23.468411    2572 scope.go:117] "RemoveContainer" containerID="20c5ef47e519ba9d4d24d0217f84ea86502aa127282c77771b361fbbdc22ac69"
Jul 17 18:35:23.468870 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:35:23.468629    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd_odh-ai-gateway-infra(3f271d64-18b9-4762-9ceb-e31c07a7a470)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470"
Jul 17 18:35:28.466351 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:28.466319    2572 scope.go:117] "RemoveContainer" containerID="ee517fec25e9d9a2dd8c0f9f7d65320c20f7d9bc553a4202ce7ec47603cc5461"
Jul 17 18:35:29.315881 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:29.315846    2572 generic.go:356] "Generic (PLEG): container finished" podID="8f38c2e1-7429-48b4-bb1e-4f641c10a4eb" containerID="b32e623b2ad2afdd643656fbf473690d2c4fe5f4b63780ec32eb79c8c532f218" exitCode=7
Jul 17 18:35:29.316118 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:29.315920    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-zb6m9" event={"ID":"8f38c2e1-7429-48b4-bb1e-4f641c10a4eb","Type":"ContainerDied","Data":"b32e623b2ad2afdd643656fbf473690d2c4fe5f4b63780ec32eb79c8c532f218"}
Jul 17 18:35:29.316118 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:29.315994    2572 scope.go:117] "RemoveContainer" containerID="ee517fec25e9d9a2dd8c0f9f7d65320c20f7d9bc553a4202ce7ec47603cc5461"
Jul 17 18:35:29.316362 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:29.316343    2572 scope.go:117] "RemoveContainer" containerID="b32e623b2ad2afdd643656fbf473690d2c4fe5f4b63780ec32eb79c8c532f218"
Jul 17 18:35:29.316581 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:35:29.316557    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-df78e9c5-zb6m9_odh-ai-gateway-infra(8f38c2e1-7429-48b4-bb1e-4f641c10a4eb)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-zb6m9" podUID="8f38c2e1-7429-48b4-bb1e-4f641c10a4eb"
Jul 17 18:35:30.202853 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:30.202811    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:35:30.340135 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:30.340100    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-zb6m9"]
Jul 17 18:35:30.494731 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:30.494706    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-zb6m9"
Jul 17 18:35:30.658685 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:30.658650    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f38c2e1-7429-48b4-bb1e-4f641c10a4eb-maas-api-service-ca\") pod \"8f38c2e1-7429-48b4-bb1e-4f641c10a4eb\" (UID: \"8f38c2e1-7429-48b4-bb1e-4f641c10a4eb\") "
Jul 17 18:35:30.659045 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:30.659021    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f38c2e1-7429-48b4-bb1e-4f641c10a4eb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8f38c2e1-7429-48b4-bb1e-4f641c10a4eb" (UID: "8f38c2e1-7429-48b4-bb1e-4f641c10a4eb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:35:30.760354 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:30.760269    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8f38c2e1-7429-48b4-bb1e-4f641c10a4eb-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:35:31.315084 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:31.315020    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:35:31.328364 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:31.328328    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-zb6m9" event={"ID":"8f38c2e1-7429-48b4-bb1e-4f641c10a4eb","Type":"ContainerDied","Data":"7e7c0757f6cd23be10191aa992502e7bf7503ba172c1e2b3136dfa6db9007730"}
Jul 17 18:35:31.328364 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:31.328340    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-zb6m9"
Jul 17 18:35:31.328584 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:31.328394    2572 scope.go:117] "RemoveContainer" containerID="b32e623b2ad2afdd643656fbf473690d2c4fe5f4b63780ec32eb79c8c532f218"
Jul 17 18:35:31.353888 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:31.353858    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-zb6m9"]
Jul 17 18:35:31.359497 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:31.359466    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-zb6m9"]
Jul 17 18:35:31.471914 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:31.471879    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f38c2e1-7429-48b4-bb1e-4f641c10a4eb" path="/var/lib/kubelet/pods/8f38c2e1-7429-48b4-bb1e-4f641c10a4eb/volumes"
Jul 17 18:35:36.466505 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:36.466474    2572 scope.go:117] "RemoveContainer" containerID="20c5ef47e519ba9d4d24d0217f84ea86502aa127282c77771b361fbbdc22ac69"
Jul 17 18:35:36.467018 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:35:36.466731    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd_odh-ai-gateway-infra(3f271d64-18b9-4762-9ceb-e31c07a7a470)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470"
Jul 17 18:35:37.092508 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:37.092470    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qvg8p"]
Jul 17 18:35:37.092860 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:37.092848    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f38c2e1-7429-48b4-bb1e-4f641c10a4eb" containerName="revoke-keys"
Jul 17 18:35:37.092928 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:37.092861    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f38c2e1-7429-48b4-bb1e-4f641c10a4eb" containerName="revoke-keys"
Jul 17 18:35:37.092928 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:37.092876    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f38c2e1-7429-48b4-bb1e-4f641c10a4eb" containerName="revoke-keys"
Jul 17 18:35:37.092928 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:37.092881    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f38c2e1-7429-48b4-bb1e-4f641c10a4eb" containerName="revoke-keys"
Jul 17 18:35:37.092928 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:37.092888    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f38c2e1-7429-48b4-bb1e-4f641c10a4eb" containerName="revoke-keys"
Jul 17 18:35:37.092928 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:37.092894    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f38c2e1-7429-48b4-bb1e-4f641c10a4eb" containerName="revoke-keys"
Jul 17 18:35:37.093122 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:37.092962    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f38c2e1-7429-48b4-bb1e-4f641c10a4eb" containerName="revoke-keys"
Jul 17 18:35:37.093122 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:37.092975    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f38c2e1-7429-48b4-bb1e-4f641c10a4eb" containerName="revoke-keys"
Jul 17 18:35:37.097338 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:37.097318    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qvg8p"
Jul 17 18:35:37.100333 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:37.100305    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:35:37.103032 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:37.102992    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qvg8p"]
Jul 17 18:35:37.120338 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:37.120304    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b39a042-c2aa-43d6-a06d-341f4cfd0359-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-qvg8p\" (UID: \"1b39a042-c2aa-43d6-a06d-341f4cfd0359\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qvg8p"
Jul 17 18:35:37.221183 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:37.221129    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b39a042-c2aa-43d6-a06d-341f4cfd0359-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-qvg8p\" (UID: \"1b39a042-c2aa-43d6-a06d-341f4cfd0359\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qvg8p"
Jul 17 18:35:37.221777 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:37.221756    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b39a042-c2aa-43d6-a06d-341f4cfd0359-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-qvg8p\" (UID: \"1b39a042-c2aa-43d6-a06d-341f4cfd0359\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qvg8p"
Jul 17 18:35:37.410170 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:37.410074    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qvg8p"
Jul 17 18:35:37.549678 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:37.549647    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qvg8p"]
Jul 17 18:35:37.551554 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:35:37.551518    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b39a042_c2aa_43d6_a06d_341f4cfd0359.slice/crio-ccd9880d75c938d0f001b89fd5c6a33704b06bd77499b6577ffad49186a7d3f4 WatchSource:0}: Error finding container ccd9880d75c938d0f001b89fd5c6a33704b06bd77499b6577ffad49186a7d3f4: Status 404 returned error can't find the container with id ccd9880d75c938d0f001b89fd5c6a33704b06bd77499b6577ffad49186a7d3f4
Jul 17 18:35:38.366084 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:38.366049    2572 generic.go:356] "Generic (PLEG): container finished" podID="1b39a042-c2aa-43d6-a06d-341f4cfd0359" containerID="30f01663cd32d586e1e38b44d970ca3ee96ad0cf0065764b9c8502cd9b2ab26f" exitCode=6
Jul 17 18:35:38.366281 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:38.366106    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qvg8p" event={"ID":"1b39a042-c2aa-43d6-a06d-341f4cfd0359","Type":"ContainerDied","Data":"30f01663cd32d586e1e38b44d970ca3ee96ad0cf0065764b9c8502cd9b2ab26f"}
Jul 17 18:35:38.366281 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:38.366152    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qvg8p" event={"ID":"1b39a042-c2aa-43d6-a06d-341f4cfd0359","Type":"ContainerStarted","Data":"ccd9880d75c938d0f001b89fd5c6a33704b06bd77499b6577ffad49186a7d3f4"}
Jul 17 18:35:38.366379 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:38.366323    2572 scope.go:117] "RemoveContainer" containerID="30f01663cd32d586e1e38b44d970ca3ee96ad0cf0065764b9c8502cd9b2ab26f"
Jul 17 18:35:39.372457 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:39.372358    2572 generic.go:356] "Generic (PLEG): container finished" podID="1b39a042-c2aa-43d6-a06d-341f4cfd0359" containerID="360d36c1217703eb43ec061fe3c5645e7fd9b4c80ffebe69d02bc70042962174" exitCode=6
Jul 17 18:35:39.372457 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:39.372447    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qvg8p" event={"ID":"1b39a042-c2aa-43d6-a06d-341f4cfd0359","Type":"ContainerDied","Data":"360d36c1217703eb43ec061fe3c5645e7fd9b4c80ffebe69d02bc70042962174"}
Jul 17 18:35:39.372937 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:39.372501    2572 scope.go:117] "RemoveContainer" containerID="30f01663cd32d586e1e38b44d970ca3ee96ad0cf0065764b9c8502cd9b2ab26f"
Jul 17 18:35:39.372937 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:39.372593    2572 scope.go:117] "RemoveContainer" containerID="360d36c1217703eb43ec061fe3c5645e7fd9b4c80ffebe69d02bc70042962174"
Jul 17 18:35:39.372937 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:35:39.372813    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-qvg8p_odh-ai-gateway-infra(1b39a042-c2aa-43d6-a06d-341f4cfd0359)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qvg8p" podUID="1b39a042-c2aa-43d6-a06d-341f4cfd0359"
Jul 17 18:35:40.379502 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:40.379473    2572 scope.go:117] "RemoveContainer" containerID="360d36c1217703eb43ec061fe3c5645e7fd9b4c80ffebe69d02bc70042962174"
Jul 17 18:35:40.379920 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:35:40.379676    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-qvg8p_odh-ai-gateway-infra(1b39a042-c2aa-43d6-a06d-341f4cfd0359)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qvg8p" podUID="1b39a042-c2aa-43d6-a06d-341f4cfd0359"
Jul 17 18:35:48.466362 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:48.466322    2572 scope.go:117] "RemoveContainer" containerID="20c5ef47e519ba9d4d24d0217f84ea86502aa127282c77771b361fbbdc22ac69"
Jul 17 18:35:48.466951 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:35:48.466578    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd_odh-ai-gateway-infra(3f271d64-18b9-4762-9ceb-e31c07a7a470)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470"
Jul 17 18:35:55.465525 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:55.465486    2572 scope.go:117] "RemoveContainer" containerID="360d36c1217703eb43ec061fe3c5645e7fd9b4c80ffebe69d02bc70042962174"
Jul 17 18:35:56.461685 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:56.461642    2572 generic.go:356] "Generic (PLEG): container finished" podID="1b39a042-c2aa-43d6-a06d-341f4cfd0359" containerID="fa6804b0cb180dff84f95cf190ecc9f4e3a11aa5e58e8ffaa9671cec82dc4aa6" exitCode=6
Jul 17 18:35:56.461859 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:56.461715    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qvg8p" event={"ID":"1b39a042-c2aa-43d6-a06d-341f4cfd0359","Type":"ContainerDied","Data":"fa6804b0cb180dff84f95cf190ecc9f4e3a11aa5e58e8ffaa9671cec82dc4aa6"}
Jul 17 18:35:56.461859 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:56.461773    2572 scope.go:117] "RemoveContainer" containerID="360d36c1217703eb43ec061fe3c5645e7fd9b4c80ffebe69d02bc70042962174"
Jul 17 18:35:56.462172 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:56.462154    2572 scope.go:117] "RemoveContainer" containerID="fa6804b0cb180dff84f95cf190ecc9f4e3a11aa5e58e8ffaa9671cec82dc4aa6"
Jul 17 18:35:56.462382 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:35:56.462362    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-qvg8p_odh-ai-gateway-infra(1b39a042-c2aa-43d6-a06d-341f4cfd0359)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qvg8p" podUID="1b39a042-c2aa-43d6-a06d-341f4cfd0359"
Jul 17 18:35:57.488210 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:57.488175    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qvg8p"]
Jul 17 18:35:57.631839 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:57.631810    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qvg8p"
Jul 17 18:35:57.703177 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:57.703132    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b39a042-c2aa-43d6-a06d-341f4cfd0359-maas-api-service-ca\") pod \"1b39a042-c2aa-43d6-a06d-341f4cfd0359\" (UID: \"1b39a042-c2aa-43d6-a06d-341f4cfd0359\") "
Jul 17 18:35:57.703514 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:57.703485    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b39a042-c2aa-43d6-a06d-341f4cfd0359-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1b39a042-c2aa-43d6-a06d-341f4cfd0359" (UID: "1b39a042-c2aa-43d6-a06d-341f4cfd0359"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:35:57.804247 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:57.804160    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1b39a042-c2aa-43d6-a06d-341f4cfd0359-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:35:58.473368 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:58.473330    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qvg8p" event={"ID":"1b39a042-c2aa-43d6-a06d-341f4cfd0359","Type":"ContainerDied","Data":"ccd9880d75c938d0f001b89fd5c6a33704b06bd77499b6577ffad49186a7d3f4"}
Jul 17 18:35:58.473559 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:58.473392    2572 scope.go:117] "RemoveContainer" containerID="fa6804b0cb180dff84f95cf190ecc9f4e3a11aa5e58e8ffaa9671cec82dc4aa6"
Jul 17 18:35:58.473559 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:58.473350    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qvg8p"
Jul 17 18:35:58.494034 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:58.494008    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qvg8p"]
Jul 17 18:35:58.499865 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:58.499836    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qvg8p"]
Jul 17 18:35:59.472035 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:35:59.471989    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b39a042-c2aa-43d6-a06d-341f4cfd0359" path="/var/lib/kubelet/pods/1b39a042-c2aa-43d6-a06d-341f4cfd0359/volumes"
Jul 17 18:36:00.465770 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:00.465741    2572 scope.go:117] "RemoveContainer" containerID="20c5ef47e519ba9d4d24d0217f84ea86502aa127282c77771b361fbbdc22ac69"
Jul 17 18:36:00.466191 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:36:00.465908    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd_odh-ai-gateway-infra(3f271d64-18b9-4762-9ceb-e31c07a7a470)\"" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470"
Jul 17 18:36:10.615707 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:10.615662    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"]
Jul 17 18:36:10.616165 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:10.615937    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9" podUID="1aba6a3d-1419-4dc9-8e50-52461343204e" containerName="istio-proxy" containerID="cri-o://d9684953913dd6d93c01860f4d227b3c3015a235620fb2907045402a615ef57b" gracePeriod=30
Jul 17 18:36:10.639673 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:10.639627    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:36:10.744720 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:10.744677    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:36:13.594163 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:13.594136    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tp9qm_6c101a17-a051-4e9d-a9dd-f72c67ba2a8a/console-operator/2.log"
Jul 17 18:36:13.600682 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:13.600658    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5mdx_2e3bd369-576e-4df1-8a76-aebd537cde58/ovn-acl-logging/0.log"
Jul 17 18:36:13.629243 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:13.629206    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tp9qm_6c101a17-a051-4e9d-a9dd-f72c67ba2a8a/console-operator/2.log"
Jul 17 18:36:13.635633 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:13.635610    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5mdx_2e3bd369-576e-4df1-8a76-aebd537cde58/ovn-acl-logging/0.log"
Jul 17 18:36:15.465625 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:15.465597    2572 scope.go:117] "RemoveContainer" containerID="20c5ef47e519ba9d4d24d0217f84ea86502aa127282c77771b361fbbdc22ac69"
Jul 17 18:36:15.819826 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:15.819791    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd"]
Jul 17 18:36:15.842270 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:15.842232    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:36:15.885407 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:15.885384    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:36:15.971799 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:15.971769    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1aba6a3d-1419-4dc9-8e50-52461343204e-istio-podinfo\") pod \"1aba6a3d-1419-4dc9-8e50-52461343204e\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") "
Jul 17 18:36:15.971953 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:15.971828    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aba6a3d-1419-4dc9-8e50-52461343204e-credential-socket\") pod \"1aba6a3d-1419-4dc9-8e50-52461343204e\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") "
Jul 17 18:36:15.971953 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:15.971867    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1aba6a3d-1419-4dc9-8e50-52461343204e-istio-envoy\") pod \"1aba6a3d-1419-4dc9-8e50-52461343204e\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") "
Jul 17 18:36:15.971953 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:15.971895    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aba6a3d-1419-4dc9-8e50-52461343204e-workload-socket\") pod \"1aba6a3d-1419-4dc9-8e50-52461343204e\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") "
Jul 17 18:36:15.971953 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:15.971944    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1aba6a3d-1419-4dc9-8e50-52461343204e-istiod-ca-cert\") pod \"1aba6a3d-1419-4dc9-8e50-52461343204e\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") "
Jul 17 18:36:15.972202 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:15.971972    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1aba6a3d-1419-4dc9-8e50-52461343204e-istio-data\") pod \"1aba6a3d-1419-4dc9-8e50-52461343204e\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") "
Jul 17 18:36:15.972202 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:15.972020    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1aba6a3d-1419-4dc9-8e50-52461343204e-istio-token\") pod \"1aba6a3d-1419-4dc9-8e50-52461343204e\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") "
Jul 17 18:36:15.972202 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:15.972071    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1aba6a3d-1419-4dc9-8e50-52461343204e-workload-certs\") pod \"1aba6a3d-1419-4dc9-8e50-52461343204e\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") "
Jul 17 18:36:15.972202 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:15.972115    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-854mm\" (UniqueName: \"kubernetes.io/projected/1aba6a3d-1419-4dc9-8e50-52461343204e-kube-api-access-854mm\") pod \"1aba6a3d-1419-4dc9-8e50-52461343204e\" (UID: \"1aba6a3d-1419-4dc9-8e50-52461343204e\") "
Jul 17 18:36:15.972413 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:15.972217    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1aba6a3d-1419-4dc9-8e50-52461343204e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1aba6a3d-1419-4dc9-8e50-52461343204e" (UID: "1aba6a3d-1419-4dc9-8e50-52461343204e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:36:15.972473 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:15.972449    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aba6a3d-1419-4dc9-8e50-52461343204e-workload-socket\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:36:15.972529 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:15.972504    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1aba6a3d-1419-4dc9-8e50-52461343204e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1aba6a3d-1419-4dc9-8e50-52461343204e" (UID: "1aba6a3d-1419-4dc9-8e50-52461343204e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:36:15.972710 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:15.972678    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1aba6a3d-1419-4dc9-8e50-52461343204e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1aba6a3d-1419-4dc9-8e50-52461343204e" (UID: "1aba6a3d-1419-4dc9-8e50-52461343204e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:36:15.972835 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:15.972687    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1aba6a3d-1419-4dc9-8e50-52461343204e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1aba6a3d-1419-4dc9-8e50-52461343204e" (UID: "1aba6a3d-1419-4dc9-8e50-52461343204e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:36:15.973384 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:15.973349    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1aba6a3d-1419-4dc9-8e50-52461343204e-istio-data" (OuterVolumeSpecName: "istio-data") pod "1aba6a3d-1419-4dc9-8e50-52461343204e" (UID: "1aba6a3d-1419-4dc9-8e50-52461343204e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:36:15.974398 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:15.974371    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1aba6a3d-1419-4dc9-8e50-52461343204e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1aba6a3d-1419-4dc9-8e50-52461343204e" (UID: "1aba6a3d-1419-4dc9-8e50-52461343204e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 18:36:15.974632 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:15.974609    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1aba6a3d-1419-4dc9-8e50-52461343204e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1aba6a3d-1419-4dc9-8e50-52461343204e" (UID: "1aba6a3d-1419-4dc9-8e50-52461343204e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:36:15.974962 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:15.974931    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1aba6a3d-1419-4dc9-8e50-52461343204e-istio-token" (OuterVolumeSpecName: "istio-token") pod "1aba6a3d-1419-4dc9-8e50-52461343204e" (UID: "1aba6a3d-1419-4dc9-8e50-52461343204e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:36:15.975211 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:15.975186    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1aba6a3d-1419-4dc9-8e50-52461343204e-kube-api-access-854mm" (OuterVolumeSpecName: "kube-api-access-854mm") pod "1aba6a3d-1419-4dc9-8e50-52461343204e" (UID: "1aba6a3d-1419-4dc9-8e50-52461343204e"). InnerVolumeSpecName "kube-api-access-854mm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:36:16.073695 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:16.073612    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1aba6a3d-1419-4dc9-8e50-52461343204e-istio-podinfo\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:36:16.073695 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:16.073639    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aba6a3d-1419-4dc9-8e50-52461343204e-credential-socket\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:36:16.073695 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:16.073649    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1aba6a3d-1419-4dc9-8e50-52461343204e-istio-envoy\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:36:16.073695 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:16.073658    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1aba6a3d-1419-4dc9-8e50-52461343204e-istiod-ca-cert\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:36:16.073695 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:16.073666    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1aba6a3d-1419-4dc9-8e50-52461343204e-istio-data\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:36:16.073695 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:16.073673    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1aba6a3d-1419-4dc9-8e50-52461343204e-istio-token\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:36:16.073695 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:16.073680    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1aba6a3d-1419-4dc9-8e50-52461343204e-workload-certs\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:36:16.073695 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:16.073687    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-854mm\" (UniqueName: \"kubernetes.io/projected/1aba6a3d-1419-4dc9-8e50-52461343204e-kube-api-access-854mm\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:36:16.563977 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:16.563939    2572 generic.go:356] "Generic (PLEG): container finished" podID="1aba6a3d-1419-4dc9-8e50-52461343204e" containerID="d9684953913dd6d93c01860f4d227b3c3015a235620fb2907045402a615ef57b" exitCode=0
Jul 17 18:36:16.564433 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:16.564019    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"
Jul 17 18:36:16.564433 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:16.564038    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9" event={"ID":"1aba6a3d-1419-4dc9-8e50-52461343204e","Type":"ContainerDied","Data":"d9684953913dd6d93c01860f4d227b3c3015a235620fb2907045402a615ef57b"}
Jul 17 18:36:16.564433 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:16.564102    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9" event={"ID":"1aba6a3d-1419-4dc9-8e50-52461343204e","Type":"ContainerDied","Data":"3842d9cd5af28e1453a7267b90d2877c1c5b540481300a4a91383b3f8fb150f5"}
Jul 17 18:36:16.564433 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:16.564124    2572 scope.go:117] "RemoveContainer" containerID="d9684953913dd6d93c01860f4d227b3c3015a235620fb2907045402a615ef57b"
Jul 17 18:36:16.566253 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:16.566227    2572 generic.go:356] "Generic (PLEG): container finished" podID="3f271d64-18b9-4762-9ceb-e31c07a7a470" containerID="bc9a9a3b876bf89bb1fdb8626cefeda9a7998798a7f35a234bf989a6fce13287" exitCode=1
Jul 17 18:36:16.566365 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:16.566280    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd" event={"ID":"3f271d64-18b9-4762-9ceb-e31c07a7a470","Type":"ContainerDied","Data":"bc9a9a3b876bf89bb1fdb8626cefeda9a7998798a7f35a234bf989a6fce13287"}
Jul 17 18:36:16.575384 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:16.575365    2572 scope.go:117] "RemoveContainer" containerID="76c3e750e4a33b52b946c169e3db59220320f67a6203d31697c8fc2dba5f5ad2"
Jul 17 18:36:16.585298 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:16.585270    2572 scope.go:117] "RemoveContainer" containerID="d9684953913dd6d93c01860f4d227b3c3015a235620fb2907045402a615ef57b"
Jul 17 18:36:16.585605 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:36:16.585585    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9684953913dd6d93c01860f4d227b3c3015a235620fb2907045402a615ef57b\": container with ID starting with d9684953913dd6d93c01860f4d227b3c3015a235620fb2907045402a615ef57b not found: ID does not exist" containerID="d9684953913dd6d93c01860f4d227b3c3015a235620fb2907045402a615ef57b"
Jul 17 18:36:16.585716 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:16.585611    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9684953913dd6d93c01860f4d227b3c3015a235620fb2907045402a615ef57b"} err="failed to get container status \"d9684953913dd6d93c01860f4d227b3c3015a235620fb2907045402a615ef57b\": rpc error: code = NotFound desc = could not find container \"d9684953913dd6d93c01860f4d227b3c3015a235620fb2907045402a615ef57b\": container with ID starting with d9684953913dd6d93c01860f4d227b3c3015a235620fb2907045402a615ef57b not found: ID does not exist"
Jul 17 18:36:16.585716 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:16.585631    2572 scope.go:117] "RemoveContainer" containerID="76c3e750e4a33b52b946c169e3db59220320f67a6203d31697c8fc2dba5f5ad2"
Jul 17 18:36:16.585906 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:36:16.585886    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76c3e750e4a33b52b946c169e3db59220320f67a6203d31697c8fc2dba5f5ad2\": container with ID starting with 76c3e750e4a33b52b946c169e3db59220320f67a6203d31697c8fc2dba5f5ad2 not found: ID does not exist" containerID="76c3e750e4a33b52b946c169e3db59220320f67a6203d31697c8fc2dba5f5ad2"
Jul 17 18:36:16.586019 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:16.585906    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76c3e750e4a33b52b946c169e3db59220320f67a6203d31697c8fc2dba5f5ad2"} err="failed to get container status \"76c3e750e4a33b52b946c169e3db59220320f67a6203d31697c8fc2dba5f5ad2\": rpc error: code = NotFound desc = could not find container \"76c3e750e4a33b52b946c169e3db59220320f67a6203d31697c8fc2dba5f5ad2\": container with ID starting with 76c3e750e4a33b52b946c169e3db59220320f67a6203d31697c8fc2dba5f5ad2 not found: ID does not exist"
Jul 17 18:36:16.586019 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:16.585919    2572 scope.go:117] "RemoveContainer" containerID="20c5ef47e519ba9d4d24d0217f84ea86502aa127282c77771b361fbbdc22ac69"
Jul 17 18:36:16.603308 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:16.603277    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"]
Jul 17 18:36:16.608805 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:16.608776    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-df78e9c5-openshift-default-86bf94699-lxkq9"]
Jul 17 18:36:16.707855 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:16.707830    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd"
Jul 17 18:36:16.881742 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:16.881650    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rbqx\" (UniqueName: \"kubernetes.io/projected/3f271d64-18b9-4762-9ceb-e31c07a7a470-kube-api-access-6rbqx\") pod \"3f271d64-18b9-4762-9ceb-e31c07a7a470\" (UID: \"3f271d64-18b9-4762-9ceb-e31c07a7a470\") "
Jul 17 18:36:16.881742 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:16.881718    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f271d64-18b9-4762-9ceb-e31c07a7a470-openshift-service-ca\") pod \"3f271d64-18b9-4762-9ceb-e31c07a7a470\" (UID: \"3f271d64-18b9-4762-9ceb-e31c07a7a470\") "
Jul 17 18:36:16.881944 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:16.881763    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f271d64-18b9-4762-9ceb-e31c07a7a470-maas-api-tls\") pod \"3f271d64-18b9-4762-9ceb-e31c07a7a470\" (UID: \"3f271d64-18b9-4762-9ceb-e31c07a7a470\") "
Jul 17 18:36:16.882134 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:16.882109    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f271d64-18b9-4762-9ceb-e31c07a7a470-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3f271d64-18b9-4762-9ceb-e31c07a7a470" (UID: "3f271d64-18b9-4762-9ceb-e31c07a7a470"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:36:16.883903 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:16.883881    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f271d64-18b9-4762-9ceb-e31c07a7a470-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3f271d64-18b9-4762-9ceb-e31c07a7a470" (UID: "3f271d64-18b9-4762-9ceb-e31c07a7a470"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 18:36:16.884022 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:16.883887    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f271d64-18b9-4762-9ceb-e31c07a7a470-kube-api-access-6rbqx" (OuterVolumeSpecName: "kube-api-access-6rbqx") pod "3f271d64-18b9-4762-9ceb-e31c07a7a470" (UID: "3f271d64-18b9-4762-9ceb-e31c07a7a470"). InnerVolumeSpecName "kube-api-access-6rbqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:36:16.907455 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:16.907423    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:36:16.983111 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:16.983073    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f271d64-18b9-4762-9ceb-e31c07a7a470-openshift-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:36:16.983111 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:16.983106    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3f271d64-18b9-4762-9ceb-e31c07a7a470-maas-api-tls\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:36:16.983111 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:16.983117    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rbqx\" (UniqueName: \"kubernetes.io/projected/3f271d64-18b9-4762-9ceb-e31c07a7a470-kube-api-access-6rbqx\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:36:17.472227 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:17.472198    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1aba6a3d-1419-4dc9-8e50-52461343204e" path="/var/lib/kubelet/pods/1aba6a3d-1419-4dc9-8e50-52461343204e/volumes"
Jul 17 18:36:17.572144 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:17.572104    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd" event={"ID":"3f271d64-18b9-4762-9ceb-e31c07a7a470","Type":"ContainerDied","Data":"edf681eb8d01be673759edc732845aa38c2ea32fb9bbf3cf49c87888de2e9541"}
Jul 17 18:36:17.572144 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:17.572123    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd"
Jul 17 18:36:17.572662 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:17.572175    2572 scope.go:117] "RemoveContainer" containerID="bc9a9a3b876bf89bb1fdb8626cefeda9a7998798a7f35a234bf989a6fce13287"
Jul 17 18:36:17.588602 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:17.588580    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd"]
Jul 17 18:36:17.590765 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:17.590742    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-df78e9c5-54bb7647bd-9twdd"]
Jul 17 18:36:19.475226 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:19.473188    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470" path="/var/lib/kubelet/pods/3f271d64-18b9-4762-9ceb-e31c07a7a470/volumes"
Jul 17 18:36:22.683421 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:22.683379    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:36:22.783933 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:22.783899    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:36:23.194592 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:23.194553    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:36:23.290049 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:23.289990    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:36:23.352263 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:23.352222    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:36:24.927051 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:24.926975    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:36:24.999979 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:24.999944    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-fh2ph"]
Jul 17 18:36:25.000362 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.000348    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470" containerName="maas-api"
Jul 17 18:36:25.000417 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.000363    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470" containerName="maas-api"
Jul 17 18:36:25.000417 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.000372    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b39a042-c2aa-43d6-a06d-341f4cfd0359" containerName="revoke-keys"
Jul 17 18:36:25.000417 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.000379    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b39a042-c2aa-43d6-a06d-341f4cfd0359" containerName="revoke-keys"
Jul 17 18:36:25.000417 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.000395    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470" containerName="maas-api"
Jul 17 18:36:25.000417 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.000400    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470" containerName="maas-api"
Jul 17 18:36:25.000417 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.000412    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470" containerName="maas-api"
Jul 17 18:36:25.000417 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.000417    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470" containerName="maas-api"
Jul 17 18:36:25.000645 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.000424    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aba6a3d-1419-4dc9-8e50-52461343204e" containerName="istio-proxy"
Jul 17 18:36:25.000645 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.000429    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aba6a3d-1419-4dc9-8e50-52461343204e" containerName="istio-proxy"
Jul 17 18:36:25.000645 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.000435    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aba6a3d-1419-4dc9-8e50-52461343204e" containerName="istio-proxy"
Jul 17 18:36:25.000645 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.000442    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aba6a3d-1419-4dc9-8e50-52461343204e" containerName="istio-proxy"
Jul 17 18:36:25.000645 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.000450    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470" containerName="maas-api"
Jul 17 18:36:25.000645 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.000455    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470" containerName="maas-api"
Jul 17 18:36:25.000645 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.000462    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470" containerName="maas-api"
Jul 17 18:36:25.000645 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.000467    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470" containerName="maas-api"
Jul 17 18:36:25.000645 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.000472    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b39a042-c2aa-43d6-a06d-341f4cfd0359" containerName="revoke-keys"
Jul 17 18:36:25.000645 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.000477    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b39a042-c2aa-43d6-a06d-341f4cfd0359" containerName="revoke-keys"
Jul 17 18:36:25.000645 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.000531    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470" containerName="maas-api"
Jul 17 18:36:25.000645 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.000538    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b39a042-c2aa-43d6-a06d-341f4cfd0359" containerName="revoke-keys"
Jul 17 18:36:25.000645 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.000543    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470" containerName="maas-api"
Jul 17 18:36:25.000645 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.000548    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f38c2e1-7429-48b4-bb1e-4f641c10a4eb" containerName="revoke-keys"
Jul 17 18:36:25.000645 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.000554    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b39a042-c2aa-43d6-a06d-341f4cfd0359" containerName="revoke-keys"
Jul 17 18:36:25.000645 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.000561    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1aba6a3d-1419-4dc9-8e50-52461343204e" containerName="istio-proxy"
Jul 17 18:36:25.000645 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.000567    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1aba6a3d-1419-4dc9-8e50-52461343204e" containerName="istio-proxy"
Jul 17 18:36:25.000645 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.000573    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b39a042-c2aa-43d6-a06d-341f4cfd0359" containerName="revoke-keys"
Jul 17 18:36:25.000645 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.000579    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470" containerName="maas-api"
Jul 17 18:36:25.000645 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.000583    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470" containerName="maas-api"
Jul 17 18:36:25.000645 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.000588    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470" containerName="maas-api"
Jul 17 18:36:25.003579 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.003562    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-fh2ph"
Jul 17 18:36:25.006383 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.006359    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:36:25.010089 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.010064    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-fh2ph"]
Jul 17 18:36:25.056209 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.056171    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6ef64bb-7fd2-4a87-9aba-4774625c3f62-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35dc36c4-fh2ph\" (UID: \"b6ef64bb-7fd2-4a87-9aba-4774625c3f62\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-fh2ph"
Jul 17 18:36:25.156985 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.156939    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6ef64bb-7fd2-4a87-9aba-4774625c3f62-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35dc36c4-fh2ph\" (UID: \"b6ef64bb-7fd2-4a87-9aba-4774625c3f62\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-fh2ph"
Jul 17 18:36:25.157587 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.157567    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6ef64bb-7fd2-4a87-9aba-4774625c3f62-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35dc36c4-fh2ph\" (UID: \"b6ef64bb-7fd2-4a87-9aba-4774625c3f62\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-fh2ph"
Jul 17 18:36:25.315907 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.315864    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-fh2ph"
Jul 17 18:36:25.453567 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.453504    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-fh2ph"]
Jul 17 18:36:25.455887 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:36:25.455858    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6ef64bb_7fd2_4a87_9aba_4774625c3f62.slice/crio-3cc581c4338f9de18f05f6eaf429e7c09a747fa212ab9d7f37dd257045f4afbd WatchSource:0}: Error finding container 3cc581c4338f9de18f05f6eaf429e7c09a747fa212ab9d7f37dd257045f4afbd: Status 404 returned error can't find the container with id 3cc581c4338f9de18f05f6eaf429e7c09a747fa212ab9d7f37dd257045f4afbd
Jul 17 18:36:25.612352 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:25.612250    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-fh2ph" event={"ID":"b6ef64bb-7fd2-4a87-9aba-4774625c3f62","Type":"ContainerStarted","Data":"3cc581c4338f9de18f05f6eaf429e7c09a747fa212ab9d7f37dd257045f4afbd"}
Jul 17 18:36:26.619510 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:26.619474    2572 generic.go:356] "Generic (PLEG): container finished" podID="b6ef64bb-7fd2-4a87-9aba-4774625c3f62" containerID="17b9882248e336897b2f087b20b1f23efec6cea37fe1c4621f12ae65858aaa3a" exitCode=6
Jul 17 18:36:26.619911 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:26.619517    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-fh2ph" event={"ID":"b6ef64bb-7fd2-4a87-9aba-4774625c3f62","Type":"ContainerDied","Data":"17b9882248e336897b2f087b20b1f23efec6cea37fe1c4621f12ae65858aaa3a"}
Jul 17 18:36:26.619911 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:26.619774    2572 scope.go:117] "RemoveContainer" containerID="17b9882248e336897b2f087b20b1f23efec6cea37fe1c4621f12ae65858aaa3a"
Jul 17 18:36:27.337068 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:27.337029    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:36:27.626196 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:27.626166    2572 generic.go:356] "Generic (PLEG): container finished" podID="b6ef64bb-7fd2-4a87-9aba-4774625c3f62" containerID="aaa18257a04883f411990b2352871b679ce452d4ae13a9ee3e66289c290ef09c" exitCode=6
Jul 17 18:36:27.626633 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:27.626260    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-fh2ph" event={"ID":"b6ef64bb-7fd2-4a87-9aba-4774625c3f62","Type":"ContainerDied","Data":"aaa18257a04883f411990b2352871b679ce452d4ae13a9ee3e66289c290ef09c"}
Jul 17 18:36:27.626633 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:27.626325    2572 scope.go:117] "RemoveContainer" containerID="17b9882248e336897b2f087b20b1f23efec6cea37fe1c4621f12ae65858aaa3a"
Jul 17 18:36:27.626633 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:27.626487    2572 scope.go:117] "RemoveContainer" containerID="aaa18257a04883f411990b2352871b679ce452d4ae13a9ee3e66289c290ef09c"
Jul 17 18:36:27.626760 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:36:27.626716    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-35dc36c4-fh2ph_odh-ai-gateway-infra(b6ef64bb-7fd2-4a87-9aba-4774625c3f62)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-fh2ph" podUID="b6ef64bb-7fd2-4a87-9aba-4774625c3f62"
Jul 17 18:36:28.633918 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:28.633890    2572 scope.go:117] "RemoveContainer" containerID="aaa18257a04883f411990b2352871b679ce452d4ae13a9ee3e66289c290ef09c"
Jul 17 18:36:28.634339 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:36:28.634127    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-35dc36c4-fh2ph_odh-ai-gateway-infra(b6ef64bb-7fd2-4a87-9aba-4774625c3f62)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-fh2ph" podUID="b6ef64bb-7fd2-4a87-9aba-4774625c3f62"
Jul 17 18:36:30.638227 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:30.638192    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:36:30.744557 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:30.744526    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:36:30.839233 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:30.839202    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:36:30.938727 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:30.938699    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:36:31.336746 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:31.336655    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:36:43.187784 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:43.187682    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lt5v7"]
Jul 17 18:36:43.188537 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:43.188513    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470" containerName="maas-api"
Jul 17 18:36:43.188537 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:43.188537    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470" containerName="maas-api"
Jul 17 18:36:43.188695 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:43.188557    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b39a042-c2aa-43d6-a06d-341f4cfd0359" containerName="revoke-keys"
Jul 17 18:36:43.188695 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:43.188566    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b39a042-c2aa-43d6-a06d-341f4cfd0359" containerName="revoke-keys"
Jul 17 18:36:43.188779 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:43.188723    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f271d64-18b9-4762-9ceb-e31c07a7a470" containerName="maas-api"
Jul 17 18:36:43.193869 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:43.193840    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lt5v7"
Jul 17 18:36:43.196155 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:43.196128    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lt5v7"]
Jul 17 18:36:43.319406 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:43.319353    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2234c283-4c60-4e28-84a5-89725d5230d1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a5b144da-lt5v7\" (UID: \"2234c283-4c60-4e28-84a5-89725d5230d1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lt5v7"
Jul 17 18:36:43.420666 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:43.420625    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2234c283-4c60-4e28-84a5-89725d5230d1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a5b144da-lt5v7\" (UID: \"2234c283-4c60-4e28-84a5-89725d5230d1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lt5v7"
Jul 17 18:36:43.421325 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:43.421305    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2234c283-4c60-4e28-84a5-89725d5230d1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a5b144da-lt5v7\" (UID: \"2234c283-4c60-4e28-84a5-89725d5230d1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lt5v7"
Jul 17 18:36:43.467696 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:43.467668    2572 scope.go:117] "RemoveContainer" containerID="aaa18257a04883f411990b2352871b679ce452d4ae13a9ee3e66289c290ef09c"
Jul 17 18:36:43.506186 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:43.506161    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lt5v7"
Jul 17 18:36:43.850042 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:43.849989    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lt5v7"]
Jul 17 18:36:43.851801 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:36:43.851772    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2234c283_4c60_4e28_84a5_89725d5230d1.slice/crio-bb454b845541973d18d8aa5e26815538efb019fbe2a83779ee7c54109c20540c WatchSource:0}: Error finding container bb454b845541973d18d8aa5e26815538efb019fbe2a83779ee7c54109c20540c: Status 404 returned error can't find the container with id bb454b845541973d18d8aa5e26815538efb019fbe2a83779ee7c54109c20540c
Jul 17 18:36:44.710301 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:44.710263    2572 generic.go:356] "Generic (PLEG): container finished" podID="2234c283-4c60-4e28-84a5-89725d5230d1" containerID="e1df0c771819566bb728c50585142f529fa0b5c86c1ed0b0660bb7398f652a9d" exitCode=6
Jul 17 18:36:44.710757 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:44.710308    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lt5v7" event={"ID":"2234c283-4c60-4e28-84a5-89725d5230d1","Type":"ContainerDied","Data":"e1df0c771819566bb728c50585142f529fa0b5c86c1ed0b0660bb7398f652a9d"}
Jul 17 18:36:44.710757 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:44.710370    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lt5v7" event={"ID":"2234c283-4c60-4e28-84a5-89725d5230d1","Type":"ContainerStarted","Data":"bb454b845541973d18d8aa5e26815538efb019fbe2a83779ee7c54109c20540c"}
Jul 17 18:36:44.710757 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:44.710563    2572 scope.go:117] "RemoveContainer" containerID="e1df0c771819566bb728c50585142f529fa0b5c86c1ed0b0660bb7398f652a9d"
Jul 17 18:36:44.712422 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:44.712399    2572 generic.go:356] "Generic (PLEG): container finished" podID="b6ef64bb-7fd2-4a87-9aba-4774625c3f62" containerID="3a4ff6afc878922439d0f61044b0e596508c51effa0a4b3bce12385e51d68113" exitCode=6
Jul 17 18:36:44.712523 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:44.712428    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-fh2ph" event={"ID":"b6ef64bb-7fd2-4a87-9aba-4774625c3f62","Type":"ContainerDied","Data":"3a4ff6afc878922439d0f61044b0e596508c51effa0a4b3bce12385e51d68113"}
Jul 17 18:36:44.712523 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:44.712511    2572 scope.go:117] "RemoveContainer" containerID="aaa18257a04883f411990b2352871b679ce452d4ae13a9ee3e66289c290ef09c"
Jul 17 18:36:44.712774 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:44.712745    2572 scope.go:117] "RemoveContainer" containerID="3a4ff6afc878922439d0f61044b0e596508c51effa0a4b3bce12385e51d68113"
Jul 17 18:36:44.712989 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:36:44.712971    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-35dc36c4-fh2ph_odh-ai-gateway-infra(b6ef64bb-7fd2-4a87-9aba-4774625c3f62)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-fh2ph" podUID="b6ef64bb-7fd2-4a87-9aba-4774625c3f62"
Jul 17 18:36:45.719285 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:45.719252    2572 generic.go:356] "Generic (PLEG): container finished" podID="2234c283-4c60-4e28-84a5-89725d5230d1" containerID="694cd9f9dd3d5e2f2cbaab79c6fecf651281f83a2c754c8a0ea54fa6f64e3fd0" exitCode=6
Jul 17 18:36:45.719711 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:45.719340    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lt5v7" event={"ID":"2234c283-4c60-4e28-84a5-89725d5230d1","Type":"ContainerDied","Data":"694cd9f9dd3d5e2f2cbaab79c6fecf651281f83a2c754c8a0ea54fa6f64e3fd0"}
Jul 17 18:36:45.719711 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:45.719396    2572 scope.go:117] "RemoveContainer" containerID="e1df0c771819566bb728c50585142f529fa0b5c86c1ed0b0660bb7398f652a9d"
Jul 17 18:36:45.719711 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:45.719569    2572 scope.go:117] "RemoveContainer" containerID="694cd9f9dd3d5e2f2cbaab79c6fecf651281f83a2c754c8a0ea54fa6f64e3fd0"
Jul 17 18:36:45.719880 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:36:45.719808    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a5b144da-lt5v7_odh-ai-gateway-infra(2234c283-4c60-4e28-84a5-89725d5230d1)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lt5v7" podUID="2234c283-4c60-4e28-84a5-89725d5230d1"
Jul 17 18:36:45.752012 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:45.751964    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-fh2ph"]
Jul 17 18:36:45.896387 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:45.896358    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-fh2ph"
Jul 17 18:36:45.946106 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:45.946072    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6ef64bb-7fd2-4a87-9aba-4774625c3f62-maas-api-service-ca\") pod \"b6ef64bb-7fd2-4a87-9aba-4774625c3f62\" (UID: \"b6ef64bb-7fd2-4a87-9aba-4774625c3f62\") "
Jul 17 18:36:45.946432 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:45.946410    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6ef64bb-7fd2-4a87-9aba-4774625c3f62-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b6ef64bb-7fd2-4a87-9aba-4774625c3f62" (UID: "b6ef64bb-7fd2-4a87-9aba-4774625c3f62"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:36:46.047648 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:46.047541    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b6ef64bb-7fd2-4a87-9aba-4774625c3f62-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:36:46.728080 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:46.728047    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-fh2ph"
Jul 17 18:36:46.728080 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:46.728061    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-fh2ph" event={"ID":"b6ef64bb-7fd2-4a87-9aba-4774625c3f62","Type":"ContainerDied","Data":"3cc581c4338f9de18f05f6eaf429e7c09a747fa212ab9d7f37dd257045f4afbd"}
Jul 17 18:36:46.728605 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:46.728128    2572 scope.go:117] "RemoveContainer" containerID="3a4ff6afc878922439d0f61044b0e596508c51effa0a4b3bce12385e51d68113"
Jul 17 18:36:46.729993 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:46.729977    2572 scope.go:117] "RemoveContainer" containerID="694cd9f9dd3d5e2f2cbaab79c6fecf651281f83a2c754c8a0ea54fa6f64e3fd0"
Jul 17 18:36:46.730216 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:36:46.730196    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a5b144da-lt5v7_odh-ai-gateway-infra(2234c283-4c60-4e28-84a5-89725d5230d1)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lt5v7" podUID="2234c283-4c60-4e28-84a5-89725d5230d1"
Jul 17 18:36:46.759831 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:46.759797    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-fh2ph"]
Jul 17 18:36:46.765329 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:46.765306    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-fh2ph"]
Jul 17 18:36:47.471975 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:47.471941    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6ef64bb-7fd2-4a87-9aba-4774625c3f62" path="/var/lib/kubelet/pods/b6ef64bb-7fd2-4a87-9aba-4774625c3f62/volumes"
Jul 17 18:36:48.300422 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:48.300368    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:36:57.336088 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:57.336041    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:36:57.471671 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:57.471628    2572 scope.go:117] "RemoveContainer" containerID="694cd9f9dd3d5e2f2cbaab79c6fecf651281f83a2c754c8a0ea54fa6f64e3fd0"
Jul 17 18:36:57.791640 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:57.791610    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lt5v7" event={"ID":"2234c283-4c60-4e28-84a5-89725d5230d1","Type":"ContainerStarted","Data":"3955060e87de1119f900486843e9a992b8948f3c5012dd98dc25dee9f0e9887a"}
Jul 17 18:36:57.807809 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:57.807745    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lt5v7" podStartSLOduration=14.807726603999999 podStartE2EDuration="14.807726604s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:36:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:36:57.807409962 +0000 UTC m=+2445.032639271" watchObservedRunningTime="2026-07-17 18:36:57.807726604 +0000 UTC m=+2445.032955913"
Jul 17 18:36:58.798399 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:58.798358    2572 generic.go:356] "Generic (PLEG): container finished" podID="2234c283-4c60-4e28-84a5-89725d5230d1" containerID="3955060e87de1119f900486843e9a992b8948f3c5012dd98dc25dee9f0e9887a" exitCode=6
Jul 17 18:36:58.798850 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:58.798426    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lt5v7" event={"ID":"2234c283-4c60-4e28-84a5-89725d5230d1","Type":"ContainerDied","Data":"3955060e87de1119f900486843e9a992b8948f3c5012dd98dc25dee9f0e9887a"}
Jul 17 18:36:58.798850 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:58.798484    2572 scope.go:117] "RemoveContainer" containerID="694cd9f9dd3d5e2f2cbaab79c6fecf651281f83a2c754c8a0ea54fa6f64e3fd0"
Jul 17 18:36:58.798850 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:58.798774    2572 scope.go:117] "RemoveContainer" containerID="3955060e87de1119f900486843e9a992b8948f3c5012dd98dc25dee9f0e9887a"
Jul 17 18:36:58.799049 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:36:58.798987    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a5b144da-lt5v7_odh-ai-gateway-infra(2234c283-4c60-4e28-84a5-89725d5230d1)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lt5v7" podUID="2234c283-4c60-4e28-84a5-89725d5230d1"
Jul 17 18:36:58.824251 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:58.824219    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lt5v7"]
Jul 17 18:36:59.942798 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:36:59.942767    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lt5v7"
Jul 17 18:37:00.024104 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:00.024066    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:37:00.077071 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:00.076965    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2234c283-4c60-4e28-84a5-89725d5230d1-maas-api-service-ca\") pod \"2234c283-4c60-4e28-84a5-89725d5230d1\" (UID: \"2234c283-4c60-4e28-84a5-89725d5230d1\") "
Jul 17 18:37:00.077323 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:00.077300    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2234c283-4c60-4e28-84a5-89725d5230d1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2234c283-4c60-4e28-84a5-89725d5230d1" (UID: "2234c283-4c60-4e28-84a5-89725d5230d1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:37:00.177708 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:00.177677    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2234c283-4c60-4e28-84a5-89725d5230d1-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:37:00.663429 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:00.663390    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-b6gvx"]
Jul 17 18:37:00.663823 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:00.663808    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2234c283-4c60-4e28-84a5-89725d5230d1" containerName="revoke-keys"
Jul 17 18:37:00.663882 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:00.663825    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2234c283-4c60-4e28-84a5-89725d5230d1" containerName="revoke-keys"
Jul 17 18:37:00.663882 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:00.663846    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6ef64bb-7fd2-4a87-9aba-4774625c3f62" containerName="revoke-keys"
Jul 17 18:37:00.663882 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:00.663851    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6ef64bb-7fd2-4a87-9aba-4774625c3f62" containerName="revoke-keys"
Jul 17 18:37:00.663882 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:00.663858    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6ef64bb-7fd2-4a87-9aba-4774625c3f62" containerName="revoke-keys"
Jul 17 18:37:00.663882 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:00.663864    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6ef64bb-7fd2-4a87-9aba-4774625c3f62" containerName="revoke-keys"
Jul 17 18:37:00.663882 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:00.663875    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2234c283-4c60-4e28-84a5-89725d5230d1" containerName="revoke-keys"
Jul 17 18:37:00.663882 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:00.663880    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2234c283-4c60-4e28-84a5-89725d5230d1" containerName="revoke-keys"
Jul 17 18:37:00.664162 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:00.663936    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2234c283-4c60-4e28-84a5-89725d5230d1" containerName="revoke-keys"
Jul 17 18:37:00.664162 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:00.663943    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2234c283-4c60-4e28-84a5-89725d5230d1" containerName="revoke-keys"
Jul 17 18:37:00.664162 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:00.663952    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6ef64bb-7fd2-4a87-9aba-4774625c3f62" containerName="revoke-keys"
Jul 17 18:37:00.664162 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:00.663957    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6ef64bb-7fd2-4a87-9aba-4774625c3f62" containerName="revoke-keys"
Jul 17 18:37:00.664162 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:00.663963    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6ef64bb-7fd2-4a87-9aba-4774625c3f62" containerName="revoke-keys"
Jul 17 18:37:00.666971 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:00.666954    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-b6gvx"
Jul 17 18:37:00.675023 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:00.674968    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-b6gvx"]
Jul 17 18:37:00.783488 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:00.783444    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f330532f-0a89-402a-bd2c-256b63f4ae37-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-df78e9c5-b6gvx\" (UID: \"f330532f-0a89-402a-bd2c-256b63f4ae37\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-b6gvx"
Jul 17 18:37:00.810943 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:00.810908    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lt5v7"
Jul 17 18:37:00.811147 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:00.810910    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lt5v7" event={"ID":"2234c283-4c60-4e28-84a5-89725d5230d1","Type":"ContainerDied","Data":"bb454b845541973d18d8aa5e26815538efb019fbe2a83779ee7c54109c20540c"}
Jul 17 18:37:00.811147 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:00.811065    2572 scope.go:117] "RemoveContainer" containerID="3955060e87de1119f900486843e9a992b8948f3c5012dd98dc25dee9f0e9887a"
Jul 17 18:37:00.831709 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:00.831669    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lt5v7"]
Jul 17 18:37:00.842230 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:00.842198    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lt5v7"]
Jul 17 18:37:00.884343 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:00.884307    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f330532f-0a89-402a-bd2c-256b63f4ae37-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-df78e9c5-b6gvx\" (UID: \"f330532f-0a89-402a-bd2c-256b63f4ae37\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-b6gvx"
Jul 17 18:37:00.885024 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:00.884977    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f330532f-0a89-402a-bd2c-256b63f4ae37-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-df78e9c5-b6gvx\" (UID: \"f330532f-0a89-402a-bd2c-256b63f4ae37\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-b6gvx"
Jul 17 18:37:00.981383 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:00.981350    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-b6gvx"
Jul 17 18:37:01.129011 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:01.128974    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-b6gvx"]
Jul 17 18:37:01.130993 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:37:01.130964    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf330532f_0a89_402a_bd2c_256b63f4ae37.slice/crio-43d390abe983fb1963adb6d31c458745cc6d5af1895a84257e043fdfffc67abf WatchSource:0}: Error finding container 43d390abe983fb1963adb6d31c458745cc6d5af1895a84257e043fdfffc67abf: Status 404 returned error can't find the container with id 43d390abe983fb1963adb6d31c458745cc6d5af1895a84257e043fdfffc67abf
Jul 17 18:37:01.472425 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:01.472344    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2234c283-4c60-4e28-84a5-89725d5230d1" path="/var/lib/kubelet/pods/2234c283-4c60-4e28-84a5-89725d5230d1/volumes"
Jul 17 18:37:01.817796 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:01.817762    2572 generic.go:356] "Generic (PLEG): container finished" podID="f330532f-0a89-402a-bd2c-256b63f4ae37" containerID="2cd2b1354d8d4daa4432ab45a619fe9d49cd343aea2a912ade81ab40f819b795" exitCode=6
Jul 17 18:37:01.818042 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:01.817842    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-b6gvx" event={"ID":"f330532f-0a89-402a-bd2c-256b63f4ae37","Type":"ContainerDied","Data":"2cd2b1354d8d4daa4432ab45a619fe9d49cd343aea2a912ade81ab40f819b795"}
Jul 17 18:37:01.818042 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:01.817901    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-b6gvx" event={"ID":"f330532f-0a89-402a-bd2c-256b63f4ae37","Type":"ContainerStarted","Data":"43d390abe983fb1963adb6d31c458745cc6d5af1895a84257e043fdfffc67abf"}
Jul 17 18:37:01.818170 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:01.818055    2572 scope.go:117] "RemoveContainer" containerID="2cd2b1354d8d4daa4432ab45a619fe9d49cd343aea2a912ade81ab40f819b795"
Jul 17 18:37:02.828070 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:02.828036    2572 generic.go:356] "Generic (PLEG): container finished" podID="f330532f-0a89-402a-bd2c-256b63f4ae37" containerID="f464fdcff0816ab5e993f44166ec9ba2945f690454773e8826b51728833b4472" exitCode=6
Jul 17 18:37:02.828551 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:02.828090    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-b6gvx" event={"ID":"f330532f-0a89-402a-bd2c-256b63f4ae37","Type":"ContainerDied","Data":"f464fdcff0816ab5e993f44166ec9ba2945f690454773e8826b51728833b4472"}
Jul 17 18:37:02.828551 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:02.828140    2572 scope.go:117] "RemoveContainer" containerID="2cd2b1354d8d4daa4432ab45a619fe9d49cd343aea2a912ade81ab40f819b795"
Jul 17 18:37:02.828551 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:02.828388    2572 scope.go:117] "RemoveContainer" containerID="f464fdcff0816ab5e993f44166ec9ba2945f690454773e8826b51728833b4472"
Jul 17 18:37:02.828718 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:37:02.828628    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-df78e9c5-b6gvx_odh-ai-gateway-infra(f330532f-0a89-402a-bd2c-256b63f4ae37)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-b6gvx" podUID="f330532f-0a89-402a-bd2c-256b63f4ae37"
Jul 17 18:37:03.528645 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:03.528600    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:37:03.625300 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:03.625265    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:37:03.834737 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:03.834655    2572 scope.go:117] "RemoveContainer" containerID="f464fdcff0816ab5e993f44166ec9ba2945f690454773e8826b51728833b4472"
Jul 17 18:37:03.835144 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:37:03.834889    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-df78e9c5-b6gvx_odh-ai-gateway-infra(f330532f-0a89-402a-bd2c-256b63f4ae37)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-b6gvx" podUID="f330532f-0a89-402a-bd2c-256b63f4ae37"
Jul 17 18:37:15.465555 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:15.465517    2572 scope.go:117] "RemoveContainer" containerID="f464fdcff0816ab5e993f44166ec9ba2945f690454773e8826b51728833b4472"
Jul 17 18:37:15.893187 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:15.893151    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-b6gvx" event={"ID":"f330532f-0a89-402a-bd2c-256b63f4ae37","Type":"ContainerStarted","Data":"c541b95200732923a2863a472d437e5ffed437c151cd0b97d2ced34226bafc3c"}
Jul 17 18:37:15.910369 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:15.910301    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-b6gvx" podStartSLOduration=15.910286923 podStartE2EDuration="15.910286923s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:37:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:37:15.909106953 +0000 UTC m=+2463.134336261" watchObservedRunningTime="2026-07-17 18:37:15.910286923 +0000 UTC m=+2463.135516231"
Jul 17 18:37:16.899272 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:16.899237    2572 generic.go:356] "Generic (PLEG): container finished" podID="f330532f-0a89-402a-bd2c-256b63f4ae37" containerID="c541b95200732923a2863a472d437e5ffed437c151cd0b97d2ced34226bafc3c" exitCode=6
Jul 17 18:37:16.899701 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:16.899305    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-b6gvx" event={"ID":"f330532f-0a89-402a-bd2c-256b63f4ae37","Type":"ContainerDied","Data":"c541b95200732923a2863a472d437e5ffed437c151cd0b97d2ced34226bafc3c"}
Jul 17 18:37:16.899701 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:16.899368    2572 scope.go:117] "RemoveContainer" containerID="f464fdcff0816ab5e993f44166ec9ba2945f690454773e8826b51728833b4472"
Jul 17 18:37:16.899701 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:16.899661    2572 scope.go:117] "RemoveContainer" containerID="c541b95200732923a2863a472d437e5ffed437c151cd0b97d2ced34226bafc3c"
Jul 17 18:37:16.899920 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:37:16.899898    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-df78e9c5-b6gvx_odh-ai-gateway-infra(f330532f-0a89-402a-bd2c-256b63f4ae37)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-b6gvx" podUID="f330532f-0a89-402a-bd2c-256b63f4ae37"
Jul 17 18:37:16.924574 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:16.924536    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-b6gvx"]
Jul 17 18:37:18.043697 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:18.043673    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-b6gvx"
Jul 17 18:37:18.131422 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:18.131388    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f330532f-0a89-402a-bd2c-256b63f4ae37-maas-api-service-ca\") pod \"f330532f-0a89-402a-bd2c-256b63f4ae37\" (UID: \"f330532f-0a89-402a-bd2c-256b63f4ae37\") "
Jul 17 18:37:18.131780 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:18.131755    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f330532f-0a89-402a-bd2c-256b63f4ae37-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f330532f-0a89-402a-bd2c-256b63f4ae37" (UID: "f330532f-0a89-402a-bd2c-256b63f4ae37"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:37:18.232431 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:18.232389    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f330532f-0a89-402a-bd2c-256b63f4ae37-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:37:18.911526 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:18.911492    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-b6gvx"
Jul 17 18:37:18.911712 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:18.911537    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-b6gvx" event={"ID":"f330532f-0a89-402a-bd2c-256b63f4ae37","Type":"ContainerDied","Data":"43d390abe983fb1963adb6d31c458745cc6d5af1895a84257e043fdfffc67abf"}
Jul 17 18:37:18.911712 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:18.911641    2572 scope.go:117] "RemoveContainer" containerID="c541b95200732923a2863a472d437e5ffed437c151cd0b97d2ced34226bafc3c"
Jul 17 18:37:18.935074 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:18.935046    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-b6gvx"]
Jul 17 18:37:18.942798 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:18.942772    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-b6gvx"]
Jul 17 18:37:19.471312 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:19.471279    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f330532f-0a89-402a-bd2c-256b63f4ae37" path="/var/lib/kubelet/pods/f330532f-0a89-402a-bd2c-256b63f4ae37/volumes"
Jul 17 18:37:19.501317 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:19.501282    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:37:25.043581 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:25.043537    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-ptpzg"]
Jul 17 18:37:25.043988 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:25.043917    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6ef64bb-7fd2-4a87-9aba-4774625c3f62" containerName="revoke-keys"
Jul 17 18:37:25.043988 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:25.043928    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6ef64bb-7fd2-4a87-9aba-4774625c3f62" containerName="revoke-keys"
Jul 17 18:37:25.043988 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:25.043938    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f330532f-0a89-402a-bd2c-256b63f4ae37" containerName="revoke-keys"
Jul 17 18:37:25.043988 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:25.043944    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f330532f-0a89-402a-bd2c-256b63f4ae37" containerName="revoke-keys"
Jul 17 18:37:25.043988 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:25.043959    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f330532f-0a89-402a-bd2c-256b63f4ae37" containerName="revoke-keys"
Jul 17 18:37:25.043988 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:25.043965    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f330532f-0a89-402a-bd2c-256b63f4ae37" containerName="revoke-keys"
Jul 17 18:37:25.043988 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:25.043977    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2234c283-4c60-4e28-84a5-89725d5230d1" containerName="revoke-keys"
Jul 17 18:37:25.043988 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:25.043984    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2234c283-4c60-4e28-84a5-89725d5230d1" containerName="revoke-keys"
Jul 17 18:37:25.044360 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:25.044067    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f330532f-0a89-402a-bd2c-256b63f4ae37" containerName="revoke-keys"
Jul 17 18:37:25.044360 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:25.044077    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2234c283-4c60-4e28-84a5-89725d5230d1" containerName="revoke-keys"
Jul 17 18:37:25.044360 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:25.044083    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f330532f-0a89-402a-bd2c-256b63f4ae37" containerName="revoke-keys"
Jul 17 18:37:25.047075 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:25.047054    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-ptpzg"
Jul 17 18:37:25.049501 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:25.049482    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:37:25.054099 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:25.054070    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-ptpzg"]
Jul 17 18:37:25.102675 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:25.102632    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63ca583a-fb18-450a-a315-3f022beb6dc5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35dc36c4-ptpzg\" (UID: \"63ca583a-fb18-450a-a315-3f022beb6dc5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-ptpzg"
Jul 17 18:37:25.204210 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:25.204170    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63ca583a-fb18-450a-a315-3f022beb6dc5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35dc36c4-ptpzg\" (UID: \"63ca583a-fb18-450a-a315-3f022beb6dc5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-ptpzg"
Jul 17 18:37:25.204782 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:25.204763    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63ca583a-fb18-450a-a315-3f022beb6dc5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35dc36c4-ptpzg\" (UID: \"63ca583a-fb18-450a-a315-3f022beb6dc5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-ptpzg"
Jul 17 18:37:25.358723 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:25.358629    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-ptpzg"
Jul 17 18:37:25.415901 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:25.415854    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:37:25.483145 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:25.483098    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:37:25.699125 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:25.699100    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-ptpzg"]
Jul 17 18:37:25.700856 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:37:25.700830    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63ca583a_fb18_450a_a315_3f022beb6dc5.slice/crio-3d4f3075746bd35178fa17bd03c5fd0e966a15b3e04b514f0947d980fc9d47b6 WatchSource:0}: Error finding container 3d4f3075746bd35178fa17bd03c5fd0e966a15b3e04b514f0947d980fc9d47b6: Status 404 returned error can't find the container with id 3d4f3075746bd35178fa17bd03c5fd0e966a15b3e04b514f0947d980fc9d47b6
Jul 17 18:37:25.834316 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:25.834275    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:37:25.927488 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:25.927452    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:37:25.946688 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:25.946659    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-ptpzg" event={"ID":"63ca583a-fb18-450a-a315-3f022beb6dc5","Type":"ContainerStarted","Data":"3d4f3075746bd35178fa17bd03c5fd0e966a15b3e04b514f0947d980fc9d47b6"}
Jul 17 18:37:26.953086 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:26.953040    2572 generic.go:356] "Generic (PLEG): container finished" podID="63ca583a-fb18-450a-a315-3f022beb6dc5" containerID="cf0ff6e1480bfa61e1e0a609fc964654857d884d064d71914ed77e3df0978ff4" exitCode=6
Jul 17 18:37:26.953505 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:26.953133    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-ptpzg" event={"ID":"63ca583a-fb18-450a-a315-3f022beb6dc5","Type":"ContainerDied","Data":"cf0ff6e1480bfa61e1e0a609fc964654857d884d064d71914ed77e3df0978ff4"}
Jul 17 18:37:26.953505 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:26.953326    2572 scope.go:117] "RemoveContainer" containerID="cf0ff6e1480bfa61e1e0a609fc964654857d884d064d71914ed77e3df0978ff4"
Jul 17 18:37:27.187612 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:27.187584    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-xrz2m"]
Jul 17 18:37:27.187963 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:27.187951    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f330532f-0a89-402a-bd2c-256b63f4ae37" containerName="revoke-keys"
Jul 17 18:37:27.188029 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:27.187965    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f330532f-0a89-402a-bd2c-256b63f4ae37" containerName="revoke-keys"
Jul 17 18:37:27.188078 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:27.188046    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f330532f-0a89-402a-bd2c-256b63f4ae37" containerName="revoke-keys"
Jul 17 18:37:27.191118 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:27.191096    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-xrz2m"
Jul 17 18:37:27.198778 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:27.198753    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-xrz2m"]
Jul 17 18:37:27.324490 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:27.324405    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c15f993a-ff71-4380-9c66-1a23ac608f7f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-xrz2m\" (UID: \"c15f993a-ff71-4380-9c66-1a23ac608f7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-xrz2m"
Jul 17 18:37:27.424906 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:27.424868    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c15f993a-ff71-4380-9c66-1a23ac608f7f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-xrz2m\" (UID: \"c15f993a-ff71-4380-9c66-1a23ac608f7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-xrz2m"
Jul 17 18:37:27.425548 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:27.425528    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c15f993a-ff71-4380-9c66-1a23ac608f7f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-xrz2m\" (UID: \"c15f993a-ff71-4380-9c66-1a23ac608f7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-xrz2m"
Jul 17 18:37:27.503194 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:27.503157    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-xrz2m"
Jul 17 18:37:27.639853 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:27.639752    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-xrz2m"]
Jul 17 18:37:27.642011 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:37:27.641975    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc15f993a_ff71_4380_9c66_1a23ac608f7f.slice/crio-1cb459a31c6c51aabe283274c13d83a3553b2ce08fce87ed22c07cf2bb21430e WatchSource:0}: Error finding container 1cb459a31c6c51aabe283274c13d83a3553b2ce08fce87ed22c07cf2bb21430e: Status 404 returned error can't find the container with id 1cb459a31c6c51aabe283274c13d83a3553b2ce08fce87ed22c07cf2bb21430e
Jul 17 18:37:27.959750 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:27.959715    2572 generic.go:356] "Generic (PLEG): container finished" podID="63ca583a-fb18-450a-a315-3f022beb6dc5" containerID="1b6096b0dbf3dc67bf0ba3dead9076d4560abcce30636de2e5f41f190b69c0ad" exitCode=6
Jul 17 18:37:27.960212 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:27.959772    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-ptpzg" event={"ID":"63ca583a-fb18-450a-a315-3f022beb6dc5","Type":"ContainerDied","Data":"1b6096b0dbf3dc67bf0ba3dead9076d4560abcce30636de2e5f41f190b69c0ad"}
Jul 17 18:37:27.960212 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:27.959840    2572 scope.go:117] "RemoveContainer" containerID="cf0ff6e1480bfa61e1e0a609fc964654857d884d064d71914ed77e3df0978ff4"
Jul 17 18:37:27.960212 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:27.960049    2572 scope.go:117] "RemoveContainer" containerID="1b6096b0dbf3dc67bf0ba3dead9076d4560abcce30636de2e5f41f190b69c0ad"
Jul 17 18:37:27.960351 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:37:27.960250    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-35dc36c4-ptpzg_odh-ai-gateway-infra(63ca583a-fb18-450a-a315-3f022beb6dc5)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-ptpzg" podUID="63ca583a-fb18-450a-a315-3f022beb6dc5"
Jul 17 18:37:27.961265 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:27.961146    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-xrz2m" event={"ID":"c15f993a-ff71-4380-9c66-1a23ac608f7f","Type":"ContainerStarted","Data":"1cb459a31c6c51aabe283274c13d83a3553b2ce08fce87ed22c07cf2bb21430e"}
Jul 17 18:37:28.967916 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:28.967880    2572 generic.go:356] "Generic (PLEG): container finished" podID="c15f993a-ff71-4380-9c66-1a23ac608f7f" containerID="5fdfbdf5849d33121c9eb59d8d97dd27512592ca12c28a3cb7e707222b2815d3" exitCode=6
Jul 17 18:37:28.968494 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:28.967972    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-xrz2m" event={"ID":"c15f993a-ff71-4380-9c66-1a23ac608f7f","Type":"ContainerDied","Data":"5fdfbdf5849d33121c9eb59d8d97dd27512592ca12c28a3cb7e707222b2815d3"}
Jul 17 18:37:28.968494 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:28.968166    2572 scope.go:117] "RemoveContainer" containerID="5fdfbdf5849d33121c9eb59d8d97dd27512592ca12c28a3cb7e707222b2815d3"
Jul 17 18:37:28.969941 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:28.969843    2572 scope.go:117] "RemoveContainer" containerID="1b6096b0dbf3dc67bf0ba3dead9076d4560abcce30636de2e5f41f190b69c0ad"
Jul 17 18:37:28.970058 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:37:28.970035    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-35dc36c4-ptpzg_odh-ai-gateway-infra(63ca583a-fb18-450a-a315-3f022beb6dc5)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-ptpzg" podUID="63ca583a-fb18-450a-a315-3f022beb6dc5"
Jul 17 18:37:29.976517 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:29.976479    2572 generic.go:356] "Generic (PLEG): container finished" podID="c15f993a-ff71-4380-9c66-1a23ac608f7f" containerID="e506acf901b0a3aef63e840f6b42730ad4670cb6466c95e468926d6d30716886" exitCode=6
Jul 17 18:37:29.976987 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:29.976561    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-xrz2m" event={"ID":"c15f993a-ff71-4380-9c66-1a23ac608f7f","Type":"ContainerDied","Data":"e506acf901b0a3aef63e840f6b42730ad4670cb6466c95e468926d6d30716886"}
Jul 17 18:37:29.976987 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:29.976619    2572 scope.go:117] "RemoveContainer" containerID="5fdfbdf5849d33121c9eb59d8d97dd27512592ca12c28a3cb7e707222b2815d3"
Jul 17 18:37:29.976987 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:29.976840    2572 scope.go:117] "RemoveContainer" containerID="e506acf901b0a3aef63e840f6b42730ad4670cb6466c95e468926d6d30716886"
Jul 17 18:37:29.977153 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:37:29.977129    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-xrz2m_odh-ai-gateway-infra(c15f993a-ff71-4380-9c66-1a23ac608f7f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-xrz2m" podUID="c15f993a-ff71-4380-9c66-1a23ac608f7f"
Jul 17 18:37:30.982960 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:30.982928    2572 scope.go:117] "RemoveContainer" containerID="e506acf901b0a3aef63e840f6b42730ad4670cb6466c95e468926d6d30716886"
Jul 17 18:37:30.983440 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:37:30.983154    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-xrz2m_odh-ai-gateway-infra(c15f993a-ff71-4380-9c66-1a23ac608f7f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-xrz2m" podUID="c15f993a-ff71-4380-9c66-1a23ac608f7f"
Jul 17 18:37:33.231365 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:33.231331    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-7zp2g"]
Jul 17 18:37:33.236105 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:33.236083    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-7zp2g"
Jul 17 18:37:33.241517 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:33.241483    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-7zp2g"]
Jul 17 18:37:33.382049 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:33.381981    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85b593b9-23ba-4ad8-88cd-dcb3372014e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a5b144da-7zp2g\" (UID: \"85b593b9-23ba-4ad8-88cd-dcb3372014e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-7zp2g"
Jul 17 18:37:33.483469 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:33.483378    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85b593b9-23ba-4ad8-88cd-dcb3372014e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a5b144da-7zp2g\" (UID: \"85b593b9-23ba-4ad8-88cd-dcb3372014e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-7zp2g"
Jul 17 18:37:33.484060 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:33.484032    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85b593b9-23ba-4ad8-88cd-dcb3372014e4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a5b144da-7zp2g\" (UID: \"85b593b9-23ba-4ad8-88cd-dcb3372014e4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-7zp2g"
Jul 17 18:37:33.547777 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:33.547732    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-7zp2g"
Jul 17 18:37:33.690960 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:33.690907    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-7zp2g"]
Jul 17 18:37:33.693809 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:37:33.693777    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85b593b9_23ba_4ad8_88cd_dcb3372014e4.slice/crio-8d27fc730df63da998825f8797082f0c003e4b488a2dd8ef87440e68f0255877 WatchSource:0}: Error finding container 8d27fc730df63da998825f8797082f0c003e4b488a2dd8ef87440e68f0255877: Status 404 returned error can't find the container with id 8d27fc730df63da998825f8797082f0c003e4b488a2dd8ef87440e68f0255877
Jul 17 18:37:33.998219 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:33.998187    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-7zp2g" event={"ID":"85b593b9-23ba-4ad8-88cd-dcb3372014e4","Type":"ContainerStarted","Data":"76048f2922776a1fb07be6e12ca4eff83b208cf3d0093cabf666632b0d3d33b3"}
Jul 17 18:37:33.998401 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:33.998243    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-7zp2g" event={"ID":"85b593b9-23ba-4ad8-88cd-dcb3372014e4","Type":"ContainerStarted","Data":"8d27fc730df63da998825f8797082f0c003e4b488a2dd8ef87440e68f0255877"}
Jul 17 18:37:34.017414 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:34.017358    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-7zp2g" podStartSLOduration=1.017341405 podStartE2EDuration="1.017341405s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:37:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:37:34.016553698 +0000 UTC m=+2481.241783011" watchObservedRunningTime="2026-07-17 18:37:34.017341405 +0000 UTC m=+2481.242570714"
Jul 17 18:37:35.004477 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:35.004443    2572 generic.go:356] "Generic (PLEG): container finished" podID="85b593b9-23ba-4ad8-88cd-dcb3372014e4" containerID="76048f2922776a1fb07be6e12ca4eff83b208cf3d0093cabf666632b0d3d33b3" exitCode=6
Jul 17 18:37:35.004913 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:35.004494    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-7zp2g" event={"ID":"85b593b9-23ba-4ad8-88cd-dcb3372014e4","Type":"ContainerDied","Data":"76048f2922776a1fb07be6e12ca4eff83b208cf3d0093cabf666632b0d3d33b3"}
Jul 17 18:37:35.004913 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:35.004697    2572 scope.go:117] "RemoveContainer" containerID="76048f2922776a1fb07be6e12ca4eff83b208cf3d0093cabf666632b0d3d33b3"
Jul 17 18:37:35.930561 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:35.930474    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:37:36.010528 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:36.010498    2572 generic.go:356] "Generic (PLEG): container finished" podID="85b593b9-23ba-4ad8-88cd-dcb3372014e4" containerID="500213dca6e8d2e2e1040626b7494f60f705c88b3325713405c35c249ab78903" exitCode=6
Jul 17 18:37:36.010987 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:36.010591    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-7zp2g" event={"ID":"85b593b9-23ba-4ad8-88cd-dcb3372014e4","Type":"ContainerDied","Data":"500213dca6e8d2e2e1040626b7494f60f705c88b3325713405c35c249ab78903"}
Jul 17 18:37:36.010987 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:36.010652    2572 scope.go:117] "RemoveContainer" containerID="76048f2922776a1fb07be6e12ca4eff83b208cf3d0093cabf666632b0d3d33b3"
Jul 17 18:37:36.010987 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:36.010748    2572 scope.go:117] "RemoveContainer" containerID="500213dca6e8d2e2e1040626b7494f60f705c88b3325713405c35c249ab78903"
Jul 17 18:37:36.010987 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:37:36.010972    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a5b144da-7zp2g_odh-ai-gateway-infra(85b593b9-23ba-4ad8-88cd-dcb3372014e4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-7zp2g" podUID="85b593b9-23ba-4ad8-88cd-dcb3372014e4"
Jul 17 18:37:36.184444 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:36.184349    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:37:37.017478 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:37.017449    2572 scope.go:117] "RemoveContainer" containerID="500213dca6e8d2e2e1040626b7494f60f705c88b3325713405c35c249ab78903"
Jul 17 18:37:37.017874 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:37:37.017622    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a5b144da-7zp2g_odh-ai-gateway-infra(85b593b9-23ba-4ad8-88cd-dcb3372014e4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-7zp2g" podUID="85b593b9-23ba-4ad8-88cd-dcb3372014e4"
Jul 17 18:37:37.036603 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:37.036571    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:37:42.466105 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:42.466072    2572 scope.go:117] "RemoveContainer" containerID="1b6096b0dbf3dc67bf0ba3dead9076d4560abcce30636de2e5f41f190b69c0ad"
Jul 17 18:37:43.004326 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:43.004294    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:37:43.047962 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:43.047871    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-ptpzg" event={"ID":"63ca583a-fb18-450a-a315-3f022beb6dc5","Type":"ContainerStarted","Data":"238bf2e91889979dc1ef79866f528a6671696877ac39ce91b23d6d57a50876d4"}
Jul 17 18:37:43.070757 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:43.070702    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-ptpzg" podStartSLOduration=18.070685152 podStartE2EDuration="18.070685152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:37:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:37:43.068698263 +0000 UTC m=+2490.293927572" watchObservedRunningTime="2026-07-17 18:37:43.070685152 +0000 UTC m=+2490.295914477"
Jul 17 18:37:43.085261 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:43.085218    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:37:43.163605 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:43.163556    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:37:43.263344 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:43.263315    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:37:43.362821 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:43.362721    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:37:43.469592 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:43.469550    2572 scope.go:117] "RemoveContainer" containerID="e506acf901b0a3aef63e840f6b42730ad4670cb6466c95e468926d6d30716886"
Jul 17 18:37:44.054777 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:44.054740    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-xrz2m" event={"ID":"c15f993a-ff71-4380-9c66-1a23ac608f7f","Type":"ContainerStarted","Data":"26a2086d9421898ecffa8b69599de0a88b7b682dbf877d8cc170f76d4d9858c0"}
Jul 17 18:37:44.056345 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:44.056318    2572 generic.go:356] "Generic (PLEG): container finished" podID="63ca583a-fb18-450a-a315-3f022beb6dc5" containerID="238bf2e91889979dc1ef79866f528a6671696877ac39ce91b23d6d57a50876d4" exitCode=6
Jul 17 18:37:44.056484 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:44.056384    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-ptpzg" event={"ID":"63ca583a-fb18-450a-a315-3f022beb6dc5","Type":"ContainerDied","Data":"238bf2e91889979dc1ef79866f528a6671696877ac39ce91b23d6d57a50876d4"}
Jul 17 18:37:44.056484 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:44.056437    2572 scope.go:117] "RemoveContainer" containerID="1b6096b0dbf3dc67bf0ba3dead9076d4560abcce30636de2e5f41f190b69c0ad"
Jul 17 18:37:44.056688 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:44.056670    2572 scope.go:117] "RemoveContainer" containerID="238bf2e91889979dc1ef79866f528a6671696877ac39ce91b23d6d57a50876d4"
Jul 17 18:37:44.056917 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:37:44.056888    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-35dc36c4-ptpzg_odh-ai-gateway-infra(63ca583a-fb18-450a-a315-3f022beb6dc5)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-ptpzg" podUID="63ca583a-fb18-450a-a315-3f022beb6dc5"
Jul 17 18:37:44.079334 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:44.079304    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-ptpzg"]
Jul 17 18:37:44.083897 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:44.083851    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-xrz2m" podStartSLOduration=17.083837027 podStartE2EDuration="17.083837027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:37:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:37:44.081589247 +0000 UTC m=+2491.306818555" watchObservedRunningTime="2026-07-17 18:37:44.083837027 +0000 UTC m=+2491.309066360"
Jul 17 18:37:44.158832 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:44.158799    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:37:44.264527 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:44.264492    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:37:45.065513 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:45.065485    2572 generic.go:356] "Generic (PLEG): container finished" podID="c15f993a-ff71-4380-9c66-1a23ac608f7f" containerID="26a2086d9421898ecffa8b69599de0a88b7b682dbf877d8cc170f76d4d9858c0" exitCode=6
Jul 17 18:37:45.065912 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:45.065531    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-xrz2m" event={"ID":"c15f993a-ff71-4380-9c66-1a23ac608f7f","Type":"ContainerDied","Data":"26a2086d9421898ecffa8b69599de0a88b7b682dbf877d8cc170f76d4d9858c0"}
Jul 17 18:37:45.065912 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:45.065577    2572 scope.go:117] "RemoveContainer" containerID="e506acf901b0a3aef63e840f6b42730ad4670cb6466c95e468926d6d30716886"
Jul 17 18:37:45.065912 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:45.065897    2572 scope.go:117] "RemoveContainer" containerID="26a2086d9421898ecffa8b69599de0a88b7b682dbf877d8cc170f76d4d9858c0"
Jul 17 18:37:45.066220 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:37:45.066192    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-xrz2m_odh-ai-gateway-infra(c15f993a-ff71-4380-9c66-1a23ac608f7f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-xrz2m" podUID="c15f993a-ff71-4380-9c66-1a23ac608f7f"
Jul 17 18:37:45.103432 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:45.103393    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-xrz2m"]
Jul 17 18:37:45.199469 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:45.199435    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-ptpzg"
Jul 17 18:37:45.289180 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:45.289148    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63ca583a-fb18-450a-a315-3f022beb6dc5-maas-api-service-ca\") pod \"63ca583a-fb18-450a-a315-3f022beb6dc5\" (UID: \"63ca583a-fb18-450a-a315-3f022beb6dc5\") "
Jul 17 18:37:45.289533 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:45.289507    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63ca583a-fb18-450a-a315-3f022beb6dc5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "63ca583a-fb18-450a-a315-3f022beb6dc5" (UID: "63ca583a-fb18-450a-a315-3f022beb6dc5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:37:45.390526 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:45.390442    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/63ca583a-fb18-450a-a315-3f022beb6dc5-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:37:45.990343 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:45.990301    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:37:46.071184 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:46.071154    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-ptpzg"
Jul 17 18:37:46.071630 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:46.071199    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-ptpzg" event={"ID":"63ca583a-fb18-450a-a315-3f022beb6dc5","Type":"ContainerDied","Data":"3d4f3075746bd35178fa17bd03c5fd0e966a15b3e04b514f0947d980fc9d47b6"}
Jul 17 18:37:46.071630 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:46.071269    2572 scope.go:117] "RemoveContainer" containerID="238bf2e91889979dc1ef79866f528a6671696877ac39ce91b23d6d57a50876d4"
Jul 17 18:37:46.105993 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:46.105955    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-ptpzg"]
Jul 17 18:37:46.107874 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:46.107849    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-ptpzg"]
Jul 17 18:37:46.210753 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:46.210726    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-xrz2m"
Jul 17 18:37:46.299171 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:46.299069    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c15f993a-ff71-4380-9c66-1a23ac608f7f-maas-api-service-ca\") pod \"c15f993a-ff71-4380-9c66-1a23ac608f7f\" (UID: \"c15f993a-ff71-4380-9c66-1a23ac608f7f\") "
Jul 17 18:37:46.299556 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:46.299527    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c15f993a-ff71-4380-9c66-1a23ac608f7f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c15f993a-ff71-4380-9c66-1a23ac608f7f" (UID: "c15f993a-ff71-4380-9c66-1a23ac608f7f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:37:46.400886 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:46.400852    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c15f993a-ff71-4380-9c66-1a23ac608f7f-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:37:47.078622 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:47.078593    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-xrz2m"
Jul 17 18:37:47.078622 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:47.078610    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-xrz2m" event={"ID":"c15f993a-ff71-4380-9c66-1a23ac608f7f","Type":"ContainerDied","Data":"1cb459a31c6c51aabe283274c13d83a3553b2ce08fce87ed22c07cf2bb21430e"}
Jul 17 18:37:47.079180 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:47.078671    2572 scope.go:117] "RemoveContainer" containerID="26a2086d9421898ecffa8b69599de0a88b7b682dbf877d8cc170f76d4d9858c0"
Jul 17 18:37:47.099829 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:47.099802    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-xrz2m"]
Jul 17 18:37:47.104359 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:47.104336    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-xrz2m"]
Jul 17 18:37:47.466361 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:47.466330    2572 scope.go:117] "RemoveContainer" containerID="500213dca6e8d2e2e1040626b7494f60f705c88b3325713405c35c249ab78903"
Jul 17 18:37:47.472042 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:47.472014    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63ca583a-fb18-450a-a315-3f022beb6dc5" path="/var/lib/kubelet/pods/63ca583a-fb18-450a-a315-3f022beb6dc5/volumes"
Jul 17 18:37:47.472405 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:47.472379    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c15f993a-ff71-4380-9c66-1a23ac608f7f" path="/var/lib/kubelet/pods/c15f993a-ff71-4380-9c66-1a23ac608f7f/volumes"
Jul 17 18:37:48.092094 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:48.092063    2572 generic.go:356] "Generic (PLEG): container finished" podID="85b593b9-23ba-4ad8-88cd-dcb3372014e4" containerID="c5b7301d12ee96bd85c2affdc03a5f68337afd7f549144ea574fd75279ad0511" exitCode=6
Jul 17 18:37:48.092550 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:48.092132    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-7zp2g" event={"ID":"85b593b9-23ba-4ad8-88cd-dcb3372014e4","Type":"ContainerDied","Data":"c5b7301d12ee96bd85c2affdc03a5f68337afd7f549144ea574fd75279ad0511"}
Jul 17 18:37:48.092550 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:48.092217    2572 scope.go:117] "RemoveContainer" containerID="500213dca6e8d2e2e1040626b7494f60f705c88b3325713405c35c249ab78903"
Jul 17 18:37:48.092550 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:48.092518    2572 scope.go:117] "RemoveContainer" containerID="c5b7301d12ee96bd85c2affdc03a5f68337afd7f549144ea574fd75279ad0511"
Jul 17 18:37:48.092771 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:37:48.092746    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a5b144da-7zp2g_odh-ai-gateway-infra(85b593b9-23ba-4ad8-88cd-dcb3372014e4)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-7zp2g" podUID="85b593b9-23ba-4ad8-88cd-dcb3372014e4"
Jul 17 18:37:49.119463 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:49.119425    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-7zp2g"]
Jul 17 18:37:49.257514 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:49.257485    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-7zp2g"
Jul 17 18:37:49.433898 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:49.433802    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85b593b9-23ba-4ad8-88cd-dcb3372014e4-maas-api-service-ca\") pod \"85b593b9-23ba-4ad8-88cd-dcb3372014e4\" (UID: \"85b593b9-23ba-4ad8-88cd-dcb3372014e4\") "
Jul 17 18:37:49.434257 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:49.434236    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85b593b9-23ba-4ad8-88cd-dcb3372014e4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "85b593b9-23ba-4ad8-88cd-dcb3372014e4" (UID: "85b593b9-23ba-4ad8-88cd-dcb3372014e4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:37:49.535514 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:49.535476    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85b593b9-23ba-4ad8-88cd-dcb3372014e4-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:37:50.106242 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.106208    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-7zp2g"
Jul 17 18:37:50.106242 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.106228    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-7zp2g" event={"ID":"85b593b9-23ba-4ad8-88cd-dcb3372014e4","Type":"ContainerDied","Data":"8d27fc730df63da998825f8797082f0c003e4b488a2dd8ef87440e68f0255877"}
Jul 17 18:37:50.106531 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.106304    2572 scope.go:117] "RemoveContainer" containerID="c5b7301d12ee96bd85c2affdc03a5f68337afd7f549144ea574fd75279ad0511"
Jul 17 18:37:50.123747 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.123715    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-7zp2g"]
Jul 17 18:37:50.130870 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.130842    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-7zp2g"]
Jul 17 18:37:50.706197 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.706161    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-q2lwl"]
Jul 17 18:37:50.706550 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.706536    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c15f993a-ff71-4380-9c66-1a23ac608f7f" containerName="revoke-keys"
Jul 17 18:37:50.706596 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.706552    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c15f993a-ff71-4380-9c66-1a23ac608f7f" containerName="revoke-keys"
Jul 17 18:37:50.706596 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.706564    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85b593b9-23ba-4ad8-88cd-dcb3372014e4" containerName="revoke-keys"
Jul 17 18:37:50.706596 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.706570    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="85b593b9-23ba-4ad8-88cd-dcb3372014e4" containerName="revoke-keys"
Jul 17 18:37:50.706596 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.706585    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85b593b9-23ba-4ad8-88cd-dcb3372014e4" containerName="revoke-keys"
Jul 17 18:37:50.706596 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.706590    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="85b593b9-23ba-4ad8-88cd-dcb3372014e4" containerName="revoke-keys"
Jul 17 18:37:50.706749 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.706598    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63ca583a-fb18-450a-a315-3f022beb6dc5" containerName="revoke-keys"
Jul 17 18:37:50.706749 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.706604    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="63ca583a-fb18-450a-a315-3f022beb6dc5" containerName="revoke-keys"
Jul 17 18:37:50.706749 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.706611    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c15f993a-ff71-4380-9c66-1a23ac608f7f" containerName="revoke-keys"
Jul 17 18:37:50.706749 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.706616    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c15f993a-ff71-4380-9c66-1a23ac608f7f" containerName="revoke-keys"
Jul 17 18:37:50.706749 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.706623    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85b593b9-23ba-4ad8-88cd-dcb3372014e4" containerName="revoke-keys"
Jul 17 18:37:50.706749 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.706629    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="85b593b9-23ba-4ad8-88cd-dcb3372014e4" containerName="revoke-keys"
Jul 17 18:37:50.706749 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.706637    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63ca583a-fb18-450a-a315-3f022beb6dc5" containerName="revoke-keys"
Jul 17 18:37:50.706749 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.706642    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="63ca583a-fb18-450a-a315-3f022beb6dc5" containerName="revoke-keys"
Jul 17 18:37:50.706749 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.706651    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63ca583a-fb18-450a-a315-3f022beb6dc5" containerName="revoke-keys"
Jul 17 18:37:50.706749 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.706657    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="63ca583a-fb18-450a-a315-3f022beb6dc5" containerName="revoke-keys"
Jul 17 18:37:50.706749 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.706711    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c15f993a-ff71-4380-9c66-1a23ac608f7f" containerName="revoke-keys"
Jul 17 18:37:50.706749 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.706718    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c15f993a-ff71-4380-9c66-1a23ac608f7f" containerName="revoke-keys"
Jul 17 18:37:50.706749 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.706725    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="85b593b9-23ba-4ad8-88cd-dcb3372014e4" containerName="revoke-keys"
Jul 17 18:37:50.706749 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.706731    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="85b593b9-23ba-4ad8-88cd-dcb3372014e4" containerName="revoke-keys"
Jul 17 18:37:50.706749 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.706737    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="63ca583a-fb18-450a-a315-3f022beb6dc5" containerName="revoke-keys"
Jul 17 18:37:50.706749 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.706742    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="63ca583a-fb18-450a-a315-3f022beb6dc5" containerName="revoke-keys"
Jul 17 18:37:50.706749 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.706746    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="85b593b9-23ba-4ad8-88cd-dcb3372014e4" containerName="revoke-keys"
Jul 17 18:37:50.709742 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.709726    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-q2lwl"
Jul 17 18:37:50.712178 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.712148    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:37:50.716653 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.716629    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-q2lwl"]
Jul 17 18:37:50.847064 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.846988    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19203c2f-33c1-4415-af10-6202504e0875-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-df78e9c5-q2lwl\" (UID: \"19203c2f-33c1-4415-af10-6202504e0875\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-q2lwl"
Jul 17 18:37:50.948268 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.948235    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19203c2f-33c1-4415-af10-6202504e0875-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-df78e9c5-q2lwl\" (UID: \"19203c2f-33c1-4415-af10-6202504e0875\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-q2lwl"
Jul 17 18:37:50.948900 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:50.948866    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19203c2f-33c1-4415-af10-6202504e0875-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-df78e9c5-q2lwl\" (UID: \"19203c2f-33c1-4415-af10-6202504e0875\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-q2lwl"
Jul 17 18:37:51.022810 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:51.022719    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-q2lwl"
Jul 17 18:37:51.156020 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:51.155975    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-q2lwl"]
Jul 17 18:37:51.156903 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:37:51.156872    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19203c2f_33c1_4415_af10_6202504e0875.slice/crio-4bb6c27b942db7d20773d5dbd4f9ec6a95c557e2281a8ae1d1923e5415e31e12 WatchSource:0}: Error finding container 4bb6c27b942db7d20773d5dbd4f9ec6a95c557e2281a8ae1d1923e5415e31e12: Status 404 returned error can't find the container with id 4bb6c27b942db7d20773d5dbd4f9ec6a95c557e2281a8ae1d1923e5415e31e12
Jul 17 18:37:51.472408 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:51.472382    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85b593b9-23ba-4ad8-88cd-dcb3372014e4" path="/var/lib/kubelet/pods/85b593b9-23ba-4ad8-88cd-dcb3372014e4/volumes"
Jul 17 18:37:51.815500 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:51.815469    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:37:51.884243 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:51.884207    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:37:52.121911 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:52.121826    2572 generic.go:356] "Generic (PLEG): container finished" podID="19203c2f-33c1-4415-af10-6202504e0875" containerID="2dbb1c6cfcf9f2d6230deac27ff775e449e35083529df457760c11e81e6f68e0" exitCode=6
Jul 17 18:37:52.122076 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:52.121914    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-q2lwl" event={"ID":"19203c2f-33c1-4415-af10-6202504e0875","Type":"ContainerDied","Data":"2dbb1c6cfcf9f2d6230deac27ff775e449e35083529df457760c11e81e6f68e0"}
Jul 17 18:37:52.122076 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:52.121964    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-q2lwl" event={"ID":"19203c2f-33c1-4415-af10-6202504e0875","Type":"ContainerStarted","Data":"4bb6c27b942db7d20773d5dbd4f9ec6a95c557e2281a8ae1d1923e5415e31e12"}
Jul 17 18:37:52.122168 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:52.122105    2572 scope.go:117] "RemoveContainer" containerID="2dbb1c6cfcf9f2d6230deac27ff775e449e35083529df457760c11e81e6f68e0"
Jul 17 18:37:52.511819 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:52.511768    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:37:53.129541 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:53.129503    2572 generic.go:356] "Generic (PLEG): container finished" podID="19203c2f-33c1-4415-af10-6202504e0875" containerID="4274f290f1fa6759e69445c8973eff39a59885614c5075154f3576f1171c4d5e" exitCode=6
Jul 17 18:37:53.129720 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:53.129590    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-q2lwl" event={"ID":"19203c2f-33c1-4415-af10-6202504e0875","Type":"ContainerDied","Data":"4274f290f1fa6759e69445c8973eff39a59885614c5075154f3576f1171c4d5e"}
Jul 17 18:37:53.129720 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:53.129683    2572 scope.go:117] "RemoveContainer" containerID="2dbb1c6cfcf9f2d6230deac27ff775e449e35083529df457760c11e81e6f68e0"
Jul 17 18:37:53.129900 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:53.129877    2572 scope.go:117] "RemoveContainer" containerID="4274f290f1fa6759e69445c8973eff39a59885614c5075154f3576f1171c4d5e"
Jul 17 18:37:53.130159 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:37:53.130137    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-df78e9c5-q2lwl_odh-ai-gateway-infra(19203c2f-33c1-4415-af10-6202504e0875)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-q2lwl" podUID="19203c2f-33c1-4415-af10-6202504e0875"
Jul 17 18:37:54.136643 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:54.136612    2572 scope.go:117] "RemoveContainer" containerID="4274f290f1fa6759e69445c8973eff39a59885614c5075154f3576f1171c4d5e"
Jul 17 18:37:54.137053 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:37:54.136807    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-df78e9c5-q2lwl_odh-ai-gateway-infra(19203c2f-33c1-4415-af10-6202504e0875)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-q2lwl" podUID="19203c2f-33c1-4415-af10-6202504e0875"
Jul 17 18:37:58.299017 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:58.298966    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:37:58.400832 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:58.400796    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:37:58.540609 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:58.540569    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:37:58.830957 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:58.830922    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"]
Jul 17 18:37:58.831539 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:58.831520    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c15f993a-ff71-4380-9c66-1a23ac608f7f" containerName="revoke-keys"
Jul 17 18:37:58.831599 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:58.831544    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c15f993a-ff71-4380-9c66-1a23ac608f7f" containerName="revoke-keys"
Jul 17 18:37:58.831662 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:58.831649    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="63ca583a-fb18-450a-a315-3f022beb6dc5" containerName="revoke-keys"
Jul 17 18:37:58.831729 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:58.831669    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c15f993a-ff71-4380-9c66-1a23ac608f7f" containerName="revoke-keys"
Jul 17 18:37:58.836081 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:58.836059    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:37:58.838870 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:58.838844    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-89d8005f-openshift-default-dockercfg-5qhkn\""
Jul 17 18:37:58.849372 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:58.849343    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"]
Jul 17 18:37:58.868418 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:58.868373    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:37:58.917578 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:58.917541    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18f92954-60cf-4cf3-be11-e01f17f1ef69-workload-certs\") pod \"e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") " pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:37:58.917799 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:58.917596    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18f92954-60cf-4cf3-be11-e01f17f1ef69-workload-socket\") pod \"e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") " pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:37:58.917799 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:58.917645    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18f92954-60cf-4cf3-be11-e01f17f1ef69-credential-socket\") pod \"e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") " pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:37:58.917799 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:58.917677    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18f92954-60cf-4cf3-be11-e01f17f1ef69-istio-token\") pod \"e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") " pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:37:58.917799 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:58.917732    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18f92954-60cf-4cf3-be11-e01f17f1ef69-istio-podinfo\") pod \"e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") " pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:37:58.917799 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:58.917771    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqxqb\" (UniqueName: \"kubernetes.io/projected/18f92954-60cf-4cf3-be11-e01f17f1ef69-kube-api-access-qqxqb\") pod \"e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") " pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:37:58.917799 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:58.917800    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18f92954-60cf-4cf3-be11-e01f17f1ef69-istio-data\") pod \"e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") " pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:37:58.918209 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:58.917911    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18f92954-60cf-4cf3-be11-e01f17f1ef69-istio-envoy\") pod \"e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") " pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:37:58.918209 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:58.917976    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18f92954-60cf-4cf3-be11-e01f17f1ef69-istiod-ca-cert\") pod \"e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") " pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:37:59.018850 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:59.018809    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18f92954-60cf-4cf3-be11-e01f17f1ef69-istiod-ca-cert\") pod \"e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") " pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:37:59.019079 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:59.018876    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18f92954-60cf-4cf3-be11-e01f17f1ef69-workload-certs\") pod \"e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") " pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:37:59.019079 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:59.018916    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18f92954-60cf-4cf3-be11-e01f17f1ef69-workload-socket\") pod \"e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") " pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:37:59.019079 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:59.018939    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18f92954-60cf-4cf3-be11-e01f17f1ef69-credential-socket\") pod \"e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") " pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:37:59.019079 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:59.018962    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18f92954-60cf-4cf3-be11-e01f17f1ef69-istio-token\") pod \"e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") " pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:37:59.019079 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:59.019015    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18f92954-60cf-4cf3-be11-e01f17f1ef69-istio-podinfo\") pod \"e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") " pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:37:59.019079 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:59.019054    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqxqb\" (UniqueName: \"kubernetes.io/projected/18f92954-60cf-4cf3-be11-e01f17f1ef69-kube-api-access-qqxqb\") pod \"e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") " pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:37:59.019079 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:59.019079    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18f92954-60cf-4cf3-be11-e01f17f1ef69-istio-data\") pod \"e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") " pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:37:59.019459 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:59.019146    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18f92954-60cf-4cf3-be11-e01f17f1ef69-istio-envoy\") pod \"e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") " pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:37:59.019459 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:59.019354    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18f92954-60cf-4cf3-be11-e01f17f1ef69-credential-socket\") pod \"e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") " pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:37:59.019566 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:59.019472    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18f92954-60cf-4cf3-be11-e01f17f1ef69-workload-socket\") pod \"e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") " pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:37:59.019683 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:59.019663    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18f92954-60cf-4cf3-be11-e01f17f1ef69-workload-certs\") pod \"e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") " pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:37:59.019748 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:59.019674    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18f92954-60cf-4cf3-be11-e01f17f1ef69-istio-data\") pod \"e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") " pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:37:59.019892 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:59.019874    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18f92954-60cf-4cf3-be11-e01f17f1ef69-istiod-ca-cert\") pod \"e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") " pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:37:59.021416 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:59.021392    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18f92954-60cf-4cf3-be11-e01f17f1ef69-istio-envoy\") pod \"e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") " pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:37:59.021898 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:59.021875    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18f92954-60cf-4cf3-be11-e01f17f1ef69-istio-podinfo\") pod \"e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") " pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:37:59.027509 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:59.027480    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18f92954-60cf-4cf3-be11-e01f17f1ef69-istio-token\") pod \"e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") " pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:37:59.027749 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:59.027728    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqxqb\" (UniqueName: \"kubernetes.io/projected/18f92954-60cf-4cf3-be11-e01f17f1ef69-kube-api-access-qqxqb\") pod \"e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") " pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:37:59.149048 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:59.148926    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:37:59.212030 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:59.211980    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:37:59.295609 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:59.295577    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"]
Jul 17 18:37:59.299497 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:37:59.299458    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18f92954_60cf_4cf3_be11_e01f17f1ef69.slice/crio-101374cfc72defda6c3bdb4bdf5fc3570f13aff0de541181a43fcdc1c098bfbe WatchSource:0}: Error finding container 101374cfc72defda6c3bdb4bdf5fc3570f13aff0de541181a43fcdc1c098bfbe: Status 404 returned error can't find the container with id 101374cfc72defda6c3bdb4bdf5fc3570f13aff0de541181a43fcdc1c098bfbe
Jul 17 18:37:59.301963 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:59.301928    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:37:59.302095 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:59.302034    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:37:59.302095 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:37:59.302079    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:38:00.175212 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:00.175179    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7" event={"ID":"18f92954-60cf-4cf3-be11-e01f17f1ef69","Type":"ContainerStarted","Data":"9966c3c49fc3b58e6e4b8cf15097190dab47e313519b6290231110f18e8afaa4"}
Jul 17 18:38:00.175514 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:00.175236    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7" event={"ID":"18f92954-60cf-4cf3-be11-e01f17f1ef69","Type":"ContainerStarted","Data":"101374cfc72defda6c3bdb4bdf5fc3570f13aff0de541181a43fcdc1c098bfbe"}
Jul 17 18:38:00.198749 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:00.198695    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7" podStartSLOduration=2.198679613 podStartE2EDuration="2.198679613s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:37:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:38:00.19802441 +0000 UTC m=+2507.423253713" watchObservedRunningTime="2026-07-17 18:38:00.198679613 +0000 UTC m=+2507.423908920"
Jul 17 18:38:01.149663 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:01.149632    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:38:01.154675 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:01.154649    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:38:01.180571 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:01.180544    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:38:01.181434 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:01.181402    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:38:02.144072 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:02.144031    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:38:02.222552 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:02.222516    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-89d8005f-769c68b69-84cjj"]
Jul 17 18:38:02.226513 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:02.226487    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89d8005f-769c68b69-84cjj"
Jul 17 18:38:02.229567 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:02.229535    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-89d8005f-serving-cert\""
Jul 17 18:38:02.229822 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:02.229799    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:38:02.238651 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:02.238615    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-89d8005f-769c68b69-84cjj"]
Jul 17 18:38:02.249491 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:02.249452    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28727f55-5212-4748-99dd-a42a6007920a-maas-api-tls\") pod \"maas-api-e2e-mt-89d8005f-769c68b69-84cjj\" (UID: \"28727f55-5212-4748-99dd-a42a6007920a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89d8005f-769c68b69-84cjj"
Jul 17 18:38:02.249668 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:02.249535    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28727f55-5212-4748-99dd-a42a6007920a-openshift-service-ca\") pod \"maas-api-e2e-mt-89d8005f-769c68b69-84cjj\" (UID: \"28727f55-5212-4748-99dd-a42a6007920a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89d8005f-769c68b69-84cjj"
Jul 17 18:38:02.249859 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:02.249830    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2shnf\" (UniqueName: \"kubernetes.io/projected/28727f55-5212-4748-99dd-a42a6007920a-kube-api-access-2shnf\") pod \"maas-api-e2e-mt-89d8005f-769c68b69-84cjj\" (UID: \"28727f55-5212-4748-99dd-a42a6007920a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89d8005f-769c68b69-84cjj"
Jul 17 18:38:02.295600 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:02.295557    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:38:02.350844 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:02.350804    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2shnf\" (UniqueName: \"kubernetes.io/projected/28727f55-5212-4748-99dd-a42a6007920a-kube-api-access-2shnf\") pod \"maas-api-e2e-mt-89d8005f-769c68b69-84cjj\" (UID: \"28727f55-5212-4748-99dd-a42a6007920a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89d8005f-769c68b69-84cjj"
Jul 17 18:38:02.351072 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:02.350869    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28727f55-5212-4748-99dd-a42a6007920a-maas-api-tls\") pod \"maas-api-e2e-mt-89d8005f-769c68b69-84cjj\" (UID: \"28727f55-5212-4748-99dd-a42a6007920a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89d8005f-769c68b69-84cjj"
Jul 17 18:38:02.351072 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:02.350914    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28727f55-5212-4748-99dd-a42a6007920a-openshift-service-ca\") pod \"maas-api-e2e-mt-89d8005f-769c68b69-84cjj\" (UID: \"28727f55-5212-4748-99dd-a42a6007920a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89d8005f-769c68b69-84cjj"
Jul 17 18:38:02.351072 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:38:02.351030    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-89d8005f-serving-cert: secret "maas-api-e2e-mt-89d8005f-serving-cert" not found
Jul 17 18:38:02.351252 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:38:02.351102    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28727f55-5212-4748-99dd-a42a6007920a-maas-api-tls podName:28727f55-5212-4748-99dd-a42a6007920a nodeName:}" failed. No retries permitted until 2026-07-17 18:38:02.851081513 +0000 UTC m=+2510.076310802 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/28727f55-5212-4748-99dd-a42a6007920a-maas-api-tls") pod "maas-api-e2e-mt-89d8005f-769c68b69-84cjj" (UID: "28727f55-5212-4748-99dd-a42a6007920a") : secret "maas-api-e2e-mt-89d8005f-serving-cert" not found
Jul 17 18:38:02.351512 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:02.351495    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28727f55-5212-4748-99dd-a42a6007920a-openshift-service-ca\") pod \"maas-api-e2e-mt-89d8005f-769c68b69-84cjj\" (UID: \"28727f55-5212-4748-99dd-a42a6007920a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89d8005f-769c68b69-84cjj"
Jul 17 18:38:02.361780 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:02.361757    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2shnf\" (UniqueName: \"kubernetes.io/projected/28727f55-5212-4748-99dd-a42a6007920a-kube-api-access-2shnf\") pod \"maas-api-e2e-mt-89d8005f-769c68b69-84cjj\" (UID: \"28727f55-5212-4748-99dd-a42a6007920a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89d8005f-769c68b69-84cjj"
Jul 17 18:38:02.795821 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:02.795783    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:38:02.856578 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:02.856541    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28727f55-5212-4748-99dd-a42a6007920a-maas-api-tls\") pod \"maas-api-e2e-mt-89d8005f-769c68b69-84cjj\" (UID: \"28727f55-5212-4748-99dd-a42a6007920a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89d8005f-769c68b69-84cjj"
Jul 17 18:38:02.856770 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:38:02.856686    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-89d8005f-serving-cert: secret "maas-api-e2e-mt-89d8005f-serving-cert" not found
Jul 17 18:38:02.856770 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:38:02.856749    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28727f55-5212-4748-99dd-a42a6007920a-maas-api-tls podName:28727f55-5212-4748-99dd-a42a6007920a nodeName:}" failed. No retries permitted until 2026-07-17 18:38:03.856734035 +0000 UTC m=+2511.081963321 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/28727f55-5212-4748-99dd-a42a6007920a-maas-api-tls") pod "maas-api-e2e-mt-89d8005f-769c68b69-84cjj" (UID: "28727f55-5212-4748-99dd-a42a6007920a") : secret "maas-api-e2e-mt-89d8005f-serving-cert" not found
Jul 17 18:38:02.893611 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:02.893578    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:38:02.954134 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:02.954083    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:38:03.866481 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:03.866442    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28727f55-5212-4748-99dd-a42a6007920a-maas-api-tls\") pod \"maas-api-e2e-mt-89d8005f-769c68b69-84cjj\" (UID: \"28727f55-5212-4748-99dd-a42a6007920a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89d8005f-769c68b69-84cjj"
Jul 17 18:38:03.868868 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:03.868835    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28727f55-5212-4748-99dd-a42a6007920a-maas-api-tls\") pod \"maas-api-e2e-mt-89d8005f-769c68b69-84cjj\" (UID: \"28727f55-5212-4748-99dd-a42a6007920a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-89d8005f-769c68b69-84cjj"
Jul 17 18:38:04.041189 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:04.041144    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89d8005f-769c68b69-84cjj"
Jul 17 18:38:04.182956 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:04.182932    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-89d8005f-769c68b69-84cjj"]
Jul 17 18:38:04.184908 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:38:04.184873    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28727f55_5212_4748_99dd_a42a6007920a.slice/crio-7783ea55c60fa01785ca1214e58d4458082a77fee00138a332ee0cff2ef8c82a WatchSource:0}: Error finding container 7783ea55c60fa01785ca1214e58d4458082a77fee00138a332ee0cff2ef8c82a: Status 404 returned error can't find the container with id 7783ea55c60fa01785ca1214e58d4458082a77fee00138a332ee0cff2ef8c82a
Jul 17 18:38:04.198153 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:04.198118    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89d8005f-769c68b69-84cjj" event={"ID":"28727f55-5212-4748-99dd-a42a6007920a","Type":"ContainerStarted","Data":"7783ea55c60fa01785ca1214e58d4458082a77fee00138a332ee0cff2ef8c82a"}
Jul 17 18:38:04.737043 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:04.736965    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:38:04.837217 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:04.837181    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:38:05.465591 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:05.465556    2572 scope.go:117] "RemoveContainer" containerID="4274f290f1fa6759e69445c8973eff39a59885614c5075154f3576f1171c4d5e"
Jul 17 18:38:06.210717 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:06.210685    2572 generic.go:356] "Generic (PLEG): container finished" podID="19203c2f-33c1-4415-af10-6202504e0875" containerID="d6d11d43e891a4e9a9914d13f9a9e7e5ca5025f11e411adf9775a4d78913595b" exitCode=6
Jul 17 18:38:06.210926 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:06.210766    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-q2lwl" event={"ID":"19203c2f-33c1-4415-af10-6202504e0875","Type":"ContainerDied","Data":"d6d11d43e891a4e9a9914d13f9a9e7e5ca5025f11e411adf9775a4d78913595b"}
Jul 17 18:38:06.210926 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:06.210839    2572 scope.go:117] "RemoveContainer" containerID="4274f290f1fa6759e69445c8973eff39a59885614c5075154f3576f1171c4d5e"
Jul 17 18:38:06.211333 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:06.211235    2572 scope.go:117] "RemoveContainer" containerID="d6d11d43e891a4e9a9914d13f9a9e7e5ca5025f11e411adf9775a4d78913595b"
Jul 17 18:38:06.211498 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:38:06.211453    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-df78e9c5-q2lwl_odh-ai-gateway-infra(19203c2f-33c1-4415-af10-6202504e0875)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-q2lwl" podUID="19203c2f-33c1-4415-af10-6202504e0875"
Jul 17 18:38:06.212355 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:06.212334    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89d8005f-769c68b69-84cjj" event={"ID":"28727f55-5212-4748-99dd-a42a6007920a","Type":"ContainerStarted","Data":"ac427ee25ba84caec5e6889f523e51cbf432295e26357671c432b2714f25323f"}
Jul 17 18:38:06.212509 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:06.212497    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89d8005f-769c68b69-84cjj"
Jul 17 18:38:06.243313 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:06.243257    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89d8005f-769c68b69-84cjj" podStartSLOduration=3.241259244 podStartE2EDuration="4.243240136s" totalImagesPullingTime="1.001980892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:38:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:38:06.242107447 +0000 UTC m=+2513.467336757" watchObservedRunningTime="2026-07-17 18:38:06.243240136 +0000 UTC m=+2513.468469504"
Jul 17 18:38:06.676936 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:06.676883    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:38:07.235813 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:07.235773    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-q2lwl"]
Jul 17 18:38:07.370713 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:07.370675    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:38:07.383078 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:07.383049    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-q2lwl"
Jul 17 18:38:07.485376 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:07.485344    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:38:07.500434 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:07.500344    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19203c2f-33c1-4415-af10-6202504e0875-maas-api-service-ca\") pod \"19203c2f-33c1-4415-af10-6202504e0875\" (UID: \"19203c2f-33c1-4415-af10-6202504e0875\") "
Jul 17 18:38:07.500745 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:07.500720    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19203c2f-33c1-4415-af10-6202504e0875-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "19203c2f-33c1-4415-af10-6202504e0875" (UID: "19203c2f-33c1-4415-af10-6202504e0875"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:38:07.601769 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:07.601723    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/19203c2f-33c1-4415-af10-6202504e0875-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:38:07.896176 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:07.896044    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:38:08.224466 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:08.224433    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-q2lwl" event={"ID":"19203c2f-33c1-4415-af10-6202504e0875","Type":"ContainerDied","Data":"4bb6c27b942db7d20773d5dbd4f9ec6a95c557e2281a8ae1d1923e5415e31e12"}
Jul 17 18:38:08.224466 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:08.224457    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-q2lwl"
Jul 17 18:38:08.224695 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:08.224524    2572 scope.go:117] "RemoveContainer" containerID="d6d11d43e891a4e9a9914d13f9a9e7e5ca5025f11e411adf9775a4d78913595b"
Jul 17 18:38:08.249856 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:08.249825    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-q2lwl"]
Jul 17 18:38:08.254081 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:08.254053    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-q2lwl"]
Jul 17 18:38:09.475712 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:09.475674    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19203c2f-33c1-4415-af10-6202504e0875" path="/var/lib/kubelet/pods/19203c2f-33c1-4415-af10-6202504e0875/volumes"
Jul 17 18:38:12.224361 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:12.224331    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89d8005f-769c68b69-84cjj"
Jul 17 18:38:13.600538 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:13.600422    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:38:13.663512 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:13.663474    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:38:13.973108 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:13.973066    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89d8005f-ttq7b"]
Jul 17 18:38:13.973663 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:13.973639    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19203c2f-33c1-4415-af10-6202504e0875" containerName="revoke-keys"
Jul 17 18:38:13.973712 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:13.973665    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="19203c2f-33c1-4415-af10-6202504e0875" containerName="revoke-keys"
Jul 17 18:38:13.973712 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:13.973689    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19203c2f-33c1-4415-af10-6202504e0875" containerName="revoke-keys"
Jul 17 18:38:13.973712 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:13.973699    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="19203c2f-33c1-4415-af10-6202504e0875" containerName="revoke-keys"
Jul 17 18:38:13.973818 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:13.973807    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="19203c2f-33c1-4415-af10-6202504e0875" containerName="revoke-keys"
Jul 17 18:38:13.973855 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:13.973827    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="19203c2f-33c1-4415-af10-6202504e0875" containerName="revoke-keys"
Jul 17 18:38:13.978993 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:13.978966    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89d8005f-ttq7b"
Jul 17 18:38:13.982084 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:13.982058    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:38:13.982625 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:13.982603    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89d8005f-ttq7b"]
Jul 17 18:38:14.064152 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:14.064110    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb1d7e03-4955-4dfd-a9bd-cfd52ddf304f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-89d8005f-ttq7b\" (UID: \"bb1d7e03-4955-4dfd-a9bd-cfd52ddf304f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89d8005f-ttq7b"
Jul 17 18:38:14.165345 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:14.165298    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb1d7e03-4955-4dfd-a9bd-cfd52ddf304f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-89d8005f-ttq7b\" (UID: \"bb1d7e03-4955-4dfd-a9bd-cfd52ddf304f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89d8005f-ttq7b"
Jul 17 18:38:14.165972 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:14.165940    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb1d7e03-4955-4dfd-a9bd-cfd52ddf304f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-89d8005f-ttq7b\" (UID: \"bb1d7e03-4955-4dfd-a9bd-cfd52ddf304f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89d8005f-ttq7b"
Jul 17 18:38:14.293794 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:14.293698    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89d8005f-ttq7b"
Jul 17 18:38:14.454117 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:14.454089    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89d8005f-ttq7b"]
Jul 17 18:38:14.456729 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:38:14.456695    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb1d7e03_4955_4dfd_a9bd_cfd52ddf304f.slice/crio-ca594891849ebb0c65d4e467d1e1136352a3bb1611c17042754a735faa4cd021 WatchSource:0}: Error finding container ca594891849ebb0c65d4e467d1e1136352a3bb1611c17042754a735faa4cd021: Status 404 returned error can't find the container with id ca594891849ebb0c65d4e467d1e1136352a3bb1611c17042754a735faa4cd021
Jul 17 18:38:15.263751 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:15.263708    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89d8005f-ttq7b" event={"ID":"bb1d7e03-4955-4dfd-a9bd-cfd52ddf304f","Type":"ContainerStarted","Data":"1547eab8d510c67ac61c036ef3e91cb5a1be8561fdfa6ad3013b8fd5c3fb3434"}
Jul 17 18:38:15.264219 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:15.263779    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89d8005f-ttq7b" event={"ID":"bb1d7e03-4955-4dfd-a9bd-cfd52ddf304f","Type":"ContainerStarted","Data":"ca594891849ebb0c65d4e467d1e1136352a3bb1611c17042754a735faa4cd021"}
Jul 17 18:38:15.278705 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:15.278641    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89d8005f-ttq7b" podStartSLOduration=2.278620709 podStartE2EDuration="2.278620709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:38:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:38:15.27818032 +0000 UTC m=+2522.503409629" watchObservedRunningTime="2026-07-17 18:38:15.278620709 +0000 UTC m=+2522.503850017"
Jul 17 18:38:16.182844 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:16.182807    2572 patch_prober.go:28] interesting pod/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Jul 17 18:38:16.183075 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:16.182868    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7" podUID="18f92954-60cf-4cf3-be11-e01f17f1ef69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Jul 17 18:38:16.270188 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:16.270098    2572 generic.go:356] "Generic (PLEG): container finished" podID="bb1d7e03-4955-4dfd-a9bd-cfd52ddf304f" containerID="1547eab8d510c67ac61c036ef3e91cb5a1be8561fdfa6ad3013b8fd5c3fb3434" exitCode=0
Jul 17 18:38:16.270585 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:16.270188    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89d8005f-ttq7b" event={"ID":"bb1d7e03-4955-4dfd-a9bd-cfd52ddf304f","Type":"ContainerDied","Data":"1547eab8d510c67ac61c036ef3e91cb5a1be8561fdfa6ad3013b8fd5c3fb3434"}
Jul 17 18:38:16.271772 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:16.271747    2572 generic.go:356] "Generic (PLEG): container finished" podID="18f92954-60cf-4cf3-be11-e01f17f1ef69" containerID="9966c3c49fc3b58e6e4b8cf15097190dab47e313519b6290231110f18e8afaa4" exitCode=0
Jul 17 18:38:16.271898 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:16.271799    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7" event={"ID":"18f92954-60cf-4cf3-be11-e01f17f1ef69","Type":"ContainerDied","Data":"9966c3c49fc3b58e6e4b8cf15097190dab47e313519b6290231110f18e8afaa4"}
Jul 17 18:38:16.272218 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:16.272204    2572 scope.go:117] "RemoveContainer" containerID="9966c3c49fc3b58e6e4b8cf15097190dab47e313519b6290231110f18e8afaa4"
Jul 17 18:38:16.273302 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:16.273275    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:38:16.273382 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:16.273343    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:38:16.273382 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:16.273372    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:38:17.282398 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:17.282352    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7" event={"ID":"18f92954-60cf-4cf3-be11-e01f17f1ef69","Type":"ContainerStarted","Data":"753fa786e768a560a2aec0807ad451d73148771c463d991b0bcd3d1cd435500f"}
Jul 17 18:38:17.441754 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:17.441717    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89d8005f-ttq7b"
Jul 17 18:38:17.495539 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:17.495498    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb1d7e03-4955-4dfd-a9bd-cfd52ddf304f-maas-api-service-ca\") pod \"bb1d7e03-4955-4dfd-a9bd-cfd52ddf304f\" (UID: \"bb1d7e03-4955-4dfd-a9bd-cfd52ddf304f\") "
Jul 17 18:38:17.495870 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:17.495845    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb1d7e03-4955-4dfd-a9bd-cfd52ddf304f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bb1d7e03-4955-4dfd-a9bd-cfd52ddf304f" (UID: "bb1d7e03-4955-4dfd-a9bd-cfd52ddf304f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:38:17.596663 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:17.596554    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb1d7e03-4955-4dfd-a9bd-cfd52ddf304f-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:38:18.149159 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:18.149119    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:38:18.149379 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:18.149354    2572 patch_prober.go:28] interesting pod/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Jul 17 18:38:18.149426 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:18.149404    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7" podUID="18f92954-60cf-4cf3-be11-e01f17f1ef69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Jul 17 18:38:18.291148 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:18.291117    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89d8005f-ttq7b"
Jul 17 18:38:18.291562 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:18.291157    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-89d8005f-ttq7b" event={"ID":"bb1d7e03-4955-4dfd-a9bd-cfd52ddf304f","Type":"ContainerDied","Data":"ca594891849ebb0c65d4e467d1e1136352a3bb1611c17042754a735faa4cd021"}
Jul 17 18:38:18.291562 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:18.291204    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ca594891849ebb0c65d4e467d1e1136352a3bb1611c17042754a735faa4cd021"
Jul 17 18:38:19.149619 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:19.149577    2572 patch_prober.go:28] interesting pod/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Jul 17 18:38:19.149835 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:19.149647    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7" podUID="18f92954-60cf-4cf3-be11-e01f17f1ef69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Jul 17 18:38:20.149944 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:20.149905    2572 patch_prober.go:28] interesting pod/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Jul 17 18:38:20.150372 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:20.149965    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7" podUID="18f92954-60cf-4cf3-be11-e01f17f1ef69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Jul 17 18:38:21.149648 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:21.149614    2572 patch_prober.go:28] interesting pod/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Jul 17 18:38:21.150022 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:21.149680    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7" podUID="18f92954-60cf-4cf3-be11-e01f17f1ef69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Jul 17 18:38:22.153684 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:22.153653    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:38:22.154147 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:22.154030    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:38:22.155048 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:22.155028    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:38:23.270423 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:23.270382    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lp6rb"]
Jul 17 18:38:23.270835 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:23.270801    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb1d7e03-4955-4dfd-a9bd-cfd52ddf304f" containerName="revoke-keys"
Jul 17 18:38:23.270835 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:23.270813    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb1d7e03-4955-4dfd-a9bd-cfd52ddf304f" containerName="revoke-keys"
Jul 17 18:38:23.270835 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:23.270821    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19203c2f-33c1-4415-af10-6202504e0875" containerName="revoke-keys"
Jul 17 18:38:23.270835 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:23.270827    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="19203c2f-33c1-4415-af10-6202504e0875" containerName="revoke-keys"
Jul 17 18:38:23.270970 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:23.270888    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb1d7e03-4955-4dfd-a9bd-cfd52ddf304f" containerName="revoke-keys"
Jul 17 18:38:23.270970 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:23.270901    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="19203c2f-33c1-4415-af10-6202504e0875" containerName="revoke-keys"
Jul 17 18:38:23.274243 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:23.274222    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lp6rb"
Jul 17 18:38:23.276580 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:23.276556    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:38:23.280393 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:23.280359    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lp6rb"]
Jul 17 18:38:23.353036 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:23.352988    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2cc4da-c14f-4805-a42a-1c6feb16160f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a5b144da-lp6rb\" (UID: \"4c2cc4da-c14f-4805-a42a-1c6feb16160f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lp6rb"
Jul 17 18:38:23.454285 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:23.454238    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2cc4da-c14f-4805-a42a-1c6feb16160f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a5b144da-lp6rb\" (UID: \"4c2cc4da-c14f-4805-a42a-1c6feb16160f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lp6rb"
Jul 17 18:38:23.454868 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:23.454843    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2cc4da-c14f-4805-a42a-1c6feb16160f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a5b144da-lp6rb\" (UID: \"4c2cc4da-c14f-4805-a42a-1c6feb16160f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lp6rb"
Jul 17 18:38:23.587642 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:23.587543    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lp6rb"
Jul 17 18:38:23.727128 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:23.727101    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lp6rb"]
Jul 17 18:38:23.729453 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:38:23.729426    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c2cc4da_c14f_4805_a42a_1c6feb16160f.slice/crio-5a098579d4f6f443aa12e99a8237356f3f0264bde90fb0e41aa4646c57138b44 WatchSource:0}: Error finding container 5a098579d4f6f443aa12e99a8237356f3f0264bde90fb0e41aa4646c57138b44: Status 404 returned error can't find the container with id 5a098579d4f6f443aa12e99a8237356f3f0264bde90fb0e41aa4646c57138b44
Jul 17 18:38:24.329773 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:24.329740    2572 generic.go:356] "Generic (PLEG): container finished" podID="4c2cc4da-c14f-4805-a42a-1c6feb16160f" containerID="8fbbe220d0863ca9b7d2bdc918d711cfa5c1a8f051681ac14f14a72fb4b07207" exitCode=6
Jul 17 18:38:24.330218 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:24.329790    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lp6rb" event={"ID":"4c2cc4da-c14f-4805-a42a-1c6feb16160f","Type":"ContainerDied","Data":"8fbbe220d0863ca9b7d2bdc918d711cfa5c1a8f051681ac14f14a72fb4b07207"}
Jul 17 18:38:24.330218 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:24.329857    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lp6rb" event={"ID":"4c2cc4da-c14f-4805-a42a-1c6feb16160f","Type":"ContainerStarted","Data":"5a098579d4f6f443aa12e99a8237356f3f0264bde90fb0e41aa4646c57138b44"}
Jul 17 18:38:24.330218 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:24.330099    2572 scope.go:117] "RemoveContainer" containerID="8fbbe220d0863ca9b7d2bdc918d711cfa5c1a8f051681ac14f14a72fb4b07207"
Jul 17 18:38:24.389778 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:24.389743    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-89d8005f-769c68b69-84cjj"]
Jul 17 18:38:24.390039 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:24.390009    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89d8005f-769c68b69-84cjj" podUID="28727f55-5212-4748-99dd-a42a6007920a" containerName="maas-api" containerID="cri-o://ac427ee25ba84caec5e6889f523e51cbf432295e26357671c432b2714f25323f" gracePeriod=30
Jul 17 18:38:24.412374 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:24.412341    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:38:24.652525 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:24.652498    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89d8005f-769c68b69-84cjj"
Jul 17 18:38:24.768455 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:24.768361    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28727f55-5212-4748-99dd-a42a6007920a-openshift-service-ca\") pod \"28727f55-5212-4748-99dd-a42a6007920a\" (UID: \"28727f55-5212-4748-99dd-a42a6007920a\") "
Jul 17 18:38:24.768599 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:24.768459    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28727f55-5212-4748-99dd-a42a6007920a-maas-api-tls\") pod \"28727f55-5212-4748-99dd-a42a6007920a\" (UID: \"28727f55-5212-4748-99dd-a42a6007920a\") "
Jul 17 18:38:24.768599 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:24.768482    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2shnf\" (UniqueName: \"kubernetes.io/projected/28727f55-5212-4748-99dd-a42a6007920a-kube-api-access-2shnf\") pod \"28727f55-5212-4748-99dd-a42a6007920a\" (UID: \"28727f55-5212-4748-99dd-a42a6007920a\") "
Jul 17 18:38:24.768748 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:24.768722    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28727f55-5212-4748-99dd-a42a6007920a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "28727f55-5212-4748-99dd-a42a6007920a" (UID: "28727f55-5212-4748-99dd-a42a6007920a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:38:24.770616 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:24.770590    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28727f55-5212-4748-99dd-a42a6007920a-kube-api-access-2shnf" (OuterVolumeSpecName: "kube-api-access-2shnf") pod "28727f55-5212-4748-99dd-a42a6007920a" (UID: "28727f55-5212-4748-99dd-a42a6007920a"). InnerVolumeSpecName "kube-api-access-2shnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:38:24.770738 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:24.770619    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28727f55-5212-4748-99dd-a42a6007920a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "28727f55-5212-4748-99dd-a42a6007920a" (UID: "28727f55-5212-4748-99dd-a42a6007920a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 18:38:24.869832 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:24.869789    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28727f55-5212-4748-99dd-a42a6007920a-maas-api-tls\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:38:24.869832 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:24.869825    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2shnf\" (UniqueName: \"kubernetes.io/projected/28727f55-5212-4748-99dd-a42a6007920a-kube-api-access-2shnf\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:38:24.869832 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:24.869837    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28727f55-5212-4748-99dd-a42a6007920a-openshift-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:38:25.336554 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:25.336469    2572 generic.go:356] "Generic (PLEG): container finished" podID="4c2cc4da-c14f-4805-a42a-1c6feb16160f" containerID="8b7fb021e3f28f592d59aefeeb75236ad6c276c9fc4a8941e740d98b8f209668" exitCode=6
Jul 17 18:38:25.336554 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:25.336507    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lp6rb" event={"ID":"4c2cc4da-c14f-4805-a42a-1c6feb16160f","Type":"ContainerDied","Data":"8b7fb021e3f28f592d59aefeeb75236ad6c276c9fc4a8941e740d98b8f209668"}
Jul 17 18:38:25.337121 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:25.336575    2572 scope.go:117] "RemoveContainer" containerID="8fbbe220d0863ca9b7d2bdc918d711cfa5c1a8f051681ac14f14a72fb4b07207"
Jul 17 18:38:25.337121 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:25.336804    2572 scope.go:117] "RemoveContainer" containerID="8b7fb021e3f28f592d59aefeeb75236ad6c276c9fc4a8941e740d98b8f209668"
Jul 17 18:38:25.337121 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:38:25.337053    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a5b144da-lp6rb_odh-ai-gateway-infra(4c2cc4da-c14f-4805-a42a-1c6feb16160f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lp6rb" podUID="4c2cc4da-c14f-4805-a42a-1c6feb16160f"
Jul 17 18:38:25.338015 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:25.337974    2572 generic.go:356] "Generic (PLEG): container finished" podID="28727f55-5212-4748-99dd-a42a6007920a" containerID="ac427ee25ba84caec5e6889f523e51cbf432295e26357671c432b2714f25323f" exitCode=0
Jul 17 18:38:25.338141 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:25.338039    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89d8005f-769c68b69-84cjj" event={"ID":"28727f55-5212-4748-99dd-a42a6007920a","Type":"ContainerDied","Data":"ac427ee25ba84caec5e6889f523e51cbf432295e26357671c432b2714f25323f"}
Jul 17 18:38:25.338141 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:25.338072    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89d8005f-769c68b69-84cjj" event={"ID":"28727f55-5212-4748-99dd-a42a6007920a","Type":"ContainerDied","Data":"7783ea55c60fa01785ca1214e58d4458082a77fee00138a332ee0cff2ef8c82a"}
Jul 17 18:38:25.338141 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:25.338041    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-89d8005f-769c68b69-84cjj"
Jul 17 18:38:25.348161 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:25.348143    2572 scope.go:117] "RemoveContainer" containerID="ac427ee25ba84caec5e6889f523e51cbf432295e26357671c432b2714f25323f"
Jul 17 18:38:25.357165 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:25.357145    2572 scope.go:117] "RemoveContainer" containerID="ac427ee25ba84caec5e6889f523e51cbf432295e26357671c432b2714f25323f"
Jul 17 18:38:25.357471 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:38:25.357452    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac427ee25ba84caec5e6889f523e51cbf432295e26357671c432b2714f25323f\": container with ID starting with ac427ee25ba84caec5e6889f523e51cbf432295e26357671c432b2714f25323f not found: ID does not exist" containerID="ac427ee25ba84caec5e6889f523e51cbf432295e26357671c432b2714f25323f"
Jul 17 18:38:25.357560 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:25.357480    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac427ee25ba84caec5e6889f523e51cbf432295e26357671c432b2714f25323f"} err="failed to get container status \"ac427ee25ba84caec5e6889f523e51cbf432295e26357671c432b2714f25323f\": rpc error: code = NotFound desc = could not find container \"ac427ee25ba84caec5e6889f523e51cbf432295e26357671c432b2714f25323f\": container with ID starting with ac427ee25ba84caec5e6889f523e51cbf432295e26357671c432b2714f25323f not found: ID does not exist"
Jul 17 18:38:25.364163 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:25.364136    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-89d8005f-769c68b69-84cjj"]
Jul 17 18:38:25.365873 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:25.365851    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-89d8005f-769c68b69-84cjj"]
Jul 17 18:38:25.471889 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:25.471855    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28727f55-5212-4748-99dd-a42a6007920a" path="/var/lib/kubelet/pods/28727f55-5212-4748-99dd-a42a6007920a/volumes"
Jul 17 18:38:26.345729 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:26.345699    2572 scope.go:117] "RemoveContainer" containerID="8b7fb021e3f28f592d59aefeeb75236ad6c276c9fc4a8941e740d98b8f209668"
Jul 17 18:38:26.346213 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:38:26.345972    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a5b144da-lp6rb_odh-ai-gateway-infra(4c2cc4da-c14f-4805-a42a-1c6feb16160f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lp6rb" podUID="4c2cc4da-c14f-4805-a42a-1c6feb16160f"
Jul 17 18:38:27.241133 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:27.241094    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qwch5"]
Jul 17 18:38:27.241601 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:27.241580    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28727f55-5212-4748-99dd-a42a6007920a" containerName="maas-api"
Jul 17 18:38:27.241709 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:27.241605    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="28727f55-5212-4748-99dd-a42a6007920a" containerName="maas-api"
Jul 17 18:38:27.241765 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:27.241729    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="28727f55-5212-4748-99dd-a42a6007920a" containerName="maas-api"
Jul 17 18:38:27.245983 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:27.245962    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qwch5"
Jul 17 18:38:27.251671 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:27.251639    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qwch5"]
Jul 17 18:38:27.392293 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:27.392253    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/764d8aaf-d467-41c0-84c2-b4678793fd50-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-qwch5\" (UID: \"764d8aaf-d467-41c0-84c2-b4678793fd50\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qwch5"
Jul 17 18:38:27.497663 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:27.497560    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/764d8aaf-d467-41c0-84c2-b4678793fd50-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-qwch5\" (UID: \"764d8aaf-d467-41c0-84c2-b4678793fd50\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qwch5"
Jul 17 18:38:27.498415 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:27.498386    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/764d8aaf-d467-41c0-84c2-b4678793fd50-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-qwch5\" (UID: \"764d8aaf-d467-41c0-84c2-b4678793fd50\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qwch5"
Jul 17 18:38:27.559562 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:27.559531    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qwch5"
Jul 17 18:38:27.698691 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:27.698656    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qwch5"]
Jul 17 18:38:27.700569 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:38:27.700542    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod764d8aaf_d467_41c0_84c2_b4678793fd50.slice/crio-e7e81363141d07f92fa5dc2f2923221190f7149493def28d94c5bd6aab97dc48 WatchSource:0}: Error finding container e7e81363141d07f92fa5dc2f2923221190f7149493def28d94c5bd6aab97dc48: Status 404 returned error can't find the container with id e7e81363141d07f92fa5dc2f2923221190f7149493def28d94c5bd6aab97dc48
Jul 17 18:38:28.357545 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:28.357511    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qwch5" event={"ID":"764d8aaf-d467-41c0-84c2-b4678793fd50","Type":"ContainerStarted","Data":"b45ef9dcc44a6630bdee45b2ccb6e6878610f772f16ad1e1b8de401ac141adf4"}
Jul 17 18:38:28.357761 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:28.357560    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qwch5" event={"ID":"764d8aaf-d467-41c0-84c2-b4678793fd50","Type":"ContainerStarted","Data":"e7e81363141d07f92fa5dc2f2923221190f7149493def28d94c5bd6aab97dc48"}
Jul 17 18:38:28.374441 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:28.374398    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qwch5" podStartSLOduration=1.374379558 podStartE2EDuration="1.374379558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:38:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:38:28.371990292 +0000 UTC m=+2535.597219601" watchObservedRunningTime="2026-07-17 18:38:28.374379558 +0000 UTC m=+2535.599608865"
Jul 17 18:38:29.106821 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:29.106783    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:38:29.364212 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:29.364120    2572 generic.go:356] "Generic (PLEG): container finished" podID="764d8aaf-d467-41c0-84c2-b4678793fd50" containerID="b45ef9dcc44a6630bdee45b2ccb6e6878610f772f16ad1e1b8de401ac141adf4" exitCode=6
Jul 17 18:38:29.364360 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:29.364208    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qwch5" event={"ID":"764d8aaf-d467-41c0-84c2-b4678793fd50","Type":"ContainerDied","Data":"b45ef9dcc44a6630bdee45b2ccb6e6878610f772f16ad1e1b8de401ac141adf4"}
Jul 17 18:38:29.364406 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:29.364362    2572 scope.go:117] "RemoveContainer" containerID="b45ef9dcc44a6630bdee45b2ccb6e6878610f772f16ad1e1b8de401ac141adf4"
Jul 17 18:38:30.371473 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:30.371381    2572 generic.go:356] "Generic (PLEG): container finished" podID="764d8aaf-d467-41c0-84c2-b4678793fd50" containerID="54737ee6be2b47f302695f84a41649348fb72c12d74149c86b72f059da8c7c26" exitCode=6
Jul 17 18:38:30.371886 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:30.371471    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qwch5" event={"ID":"764d8aaf-d467-41c0-84c2-b4678793fd50","Type":"ContainerDied","Data":"54737ee6be2b47f302695f84a41649348fb72c12d74149c86b72f059da8c7c26"}
Jul 17 18:38:30.371886 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:30.371526    2572 scope.go:117] "RemoveContainer" containerID="b45ef9dcc44a6630bdee45b2ccb6e6878610f772f16ad1e1b8de401ac141adf4"
Jul 17 18:38:30.371886 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:30.371679    2572 scope.go:117] "RemoveContainer" containerID="54737ee6be2b47f302695f84a41649348fb72c12d74149c86b72f059da8c7c26"
Jul 17 18:38:30.372050 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:38:30.371897    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-qwch5_odh-ai-gateway-infra(764d8aaf-d467-41c0-84c2-b4678793fd50)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qwch5" podUID="764d8aaf-d467-41c0-84c2-b4678793fd50"
Jul 17 18:38:31.378384 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:31.378358    2572 scope.go:117] "RemoveContainer" containerID="54737ee6be2b47f302695f84a41649348fb72c12d74149c86b72f059da8c7c26"
Jul 17 18:38:31.378847 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:38:31.378592    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-qwch5_odh-ai-gateway-infra(764d8aaf-d467-41c0-84c2-b4678793fd50)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qwch5" podUID="764d8aaf-d467-41c0-84c2-b4678793fd50"
Jul 17 18:38:35.051240 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:35.051188    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:38:35.151404 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:35.151364    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:38:39.790240 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:39.790202    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"]
Jul 17 18:38:39.790665 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:39.790486    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7" podUID="18f92954-60cf-4cf3-be11-e01f17f1ef69" containerName="istio-proxy" containerID="cri-o://753fa786e768a560a2aec0807ad451d73148771c463d991b0bcd3d1cd435500f" gracePeriod=30
Jul 17 18:38:39.811012 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:39.810962    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:38:40.037721 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:40.037687    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:38:40.159895 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:40.159799    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:38:40.259533 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:40.259495    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:38:40.388513 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:40.388470    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:38:41.466026 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:41.465967    2572 scope.go:117] "RemoveContainer" containerID="8b7fb021e3f28f592d59aefeeb75236ad6c276c9fc4a8941e740d98b8f209668"
Jul 17 18:38:42.439638 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:42.439609    2572 generic.go:356] "Generic (PLEG): container finished" podID="4c2cc4da-c14f-4805-a42a-1c6feb16160f" containerID="dc09064607e532b21966e9bb0d4fa32fdc982ed6b3190b5e83e9aacf349eab41" exitCode=6
Jul 17 18:38:42.439818 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:42.439685    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lp6rb" event={"ID":"4c2cc4da-c14f-4805-a42a-1c6feb16160f","Type":"ContainerDied","Data":"dc09064607e532b21966e9bb0d4fa32fdc982ed6b3190b5e83e9aacf349eab41"}
Jul 17 18:38:42.439818 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:42.439750    2572 scope.go:117] "RemoveContainer" containerID="8b7fb021e3f28f592d59aefeeb75236ad6c276c9fc4a8941e740d98b8f209668"
Jul 17 18:38:42.440099 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:42.440082    2572 scope.go:117] "RemoveContainer" containerID="dc09064607e532b21966e9bb0d4fa32fdc982ed6b3190b5e83e9aacf349eab41"
Jul 17 18:38:42.440324 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:38:42.440302    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a5b144da-lp6rb_odh-ai-gateway-infra(4c2cc4da-c14f-4805-a42a-1c6feb16160f)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lp6rb" podUID="4c2cc4da-c14f-4805-a42a-1c6feb16160f"
Jul 17 18:38:43.471823 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:43.471792    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lp6rb"]
Jul 17 18:38:43.616327 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:43.616301    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lp6rb"
Jul 17 18:38:43.641485 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:43.641454    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2cc4da-c14f-4805-a42a-1c6feb16160f-maas-api-service-ca\") pod \"4c2cc4da-c14f-4805-a42a-1c6feb16160f\" (UID: \"4c2cc4da-c14f-4805-a42a-1c6feb16160f\") "
Jul 17 18:38:43.641888 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:43.641858    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c2cc4da-c14f-4805-a42a-1c6feb16160f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4c2cc4da-c14f-4805-a42a-1c6feb16160f" (UID: "4c2cc4da-c14f-4805-a42a-1c6feb16160f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:38:43.743140 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:43.743046    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c2cc4da-c14f-4805-a42a-1c6feb16160f-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:38:44.452040 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:44.451986    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lp6rb" event={"ID":"4c2cc4da-c14f-4805-a42a-1c6feb16160f","Type":"ContainerDied","Data":"5a098579d4f6f443aa12e99a8237356f3f0264bde90fb0e41aa4646c57138b44"}
Jul 17 18:38:44.452243 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:44.452068    2572 scope.go:117] "RemoveContainer" containerID="dc09064607e532b21966e9bb0d4fa32fdc982ed6b3190b5e83e9aacf349eab41"
Jul 17 18:38:44.452243 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:44.452020    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lp6rb"
Jul 17 18:38:44.465788 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:44.465765    2572 scope.go:117] "RemoveContainer" containerID="54737ee6be2b47f302695f84a41649348fb72c12d74149c86b72f059da8c7c26"
Jul 17 18:38:44.480807 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:44.480782    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lp6rb"]
Jul 17 18:38:44.484871 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:44.484844    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-lp6rb"]
Jul 17 18:38:45.053189 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.053161    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:38:45.155333 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.155300    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18f92954-60cf-4cf3-be11-e01f17f1ef69-istio-envoy\") pod \"18f92954-60cf-4cf3-be11-e01f17f1ef69\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") "
Jul 17 18:38:45.155520 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.155356    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18f92954-60cf-4cf3-be11-e01f17f1ef69-workload-certs\") pod \"18f92954-60cf-4cf3-be11-e01f17f1ef69\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") "
Jul 17 18:38:45.155520 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.155392    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18f92954-60cf-4cf3-be11-e01f17f1ef69-workload-socket\") pod \"18f92954-60cf-4cf3-be11-e01f17f1ef69\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") "
Jul 17 18:38:45.155520 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.155408    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18f92954-60cf-4cf3-be11-e01f17f1ef69-istio-token\") pod \"18f92954-60cf-4cf3-be11-e01f17f1ef69\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") "
Jul 17 18:38:45.155520 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.155426    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18f92954-60cf-4cf3-be11-e01f17f1ef69-istio-podinfo\") pod \"18f92954-60cf-4cf3-be11-e01f17f1ef69\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") "
Jul 17 18:38:45.155520 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.155454    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18f92954-60cf-4cf3-be11-e01f17f1ef69-credential-socket\") pod \"18f92954-60cf-4cf3-be11-e01f17f1ef69\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") "
Jul 17 18:38:45.155520 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.155489    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqxqb\" (UniqueName: \"kubernetes.io/projected/18f92954-60cf-4cf3-be11-e01f17f1ef69-kube-api-access-qqxqb\") pod \"18f92954-60cf-4cf3-be11-e01f17f1ef69\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") "
Jul 17 18:38:45.155855 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.155566    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18f92954-60cf-4cf3-be11-e01f17f1ef69-istiod-ca-cert\") pod \"18f92954-60cf-4cf3-be11-e01f17f1ef69\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") "
Jul 17 18:38:45.155855 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.155596    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18f92954-60cf-4cf3-be11-e01f17f1ef69-istio-data\") pod \"18f92954-60cf-4cf3-be11-e01f17f1ef69\" (UID: \"18f92954-60cf-4cf3-be11-e01f17f1ef69\") "
Jul 17 18:38:45.155961 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.155841    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18f92954-60cf-4cf3-be11-e01f17f1ef69-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "18f92954-60cf-4cf3-be11-e01f17f1ef69" (UID: "18f92954-60cf-4cf3-be11-e01f17f1ef69"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:38:45.155961 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.155942    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/18f92954-60cf-4cf3-be11-e01f17f1ef69-workload-certs\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:38:45.156102 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.156056    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18f92954-60cf-4cf3-be11-e01f17f1ef69-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "18f92954-60cf-4cf3-be11-e01f17f1ef69" (UID: "18f92954-60cf-4cf3-be11-e01f17f1ef69"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:38:45.156166 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.156078    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18f92954-60cf-4cf3-be11-e01f17f1ef69-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "18f92954-60cf-4cf3-be11-e01f17f1ef69" (UID: "18f92954-60cf-4cf3-be11-e01f17f1ef69"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:38:45.156274 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.156251    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18f92954-60cf-4cf3-be11-e01f17f1ef69-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "18f92954-60cf-4cf3-be11-e01f17f1ef69" (UID: "18f92954-60cf-4cf3-be11-e01f17f1ef69"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:38:45.156923 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.156899    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18f92954-60cf-4cf3-be11-e01f17f1ef69-istio-data" (OuterVolumeSpecName: "istio-data") pod "18f92954-60cf-4cf3-be11-e01f17f1ef69" (UID: "18f92954-60cf-4cf3-be11-e01f17f1ef69"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:38:45.157625 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.157604    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/18f92954-60cf-4cf3-be11-e01f17f1ef69-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "18f92954-60cf-4cf3-be11-e01f17f1ef69" (UID: "18f92954-60cf-4cf3-be11-e01f17f1ef69"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:38:45.157818 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.157801    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18f92954-60cf-4cf3-be11-e01f17f1ef69-kube-api-access-qqxqb" (OuterVolumeSpecName: "kube-api-access-qqxqb") pod "18f92954-60cf-4cf3-be11-e01f17f1ef69" (UID: "18f92954-60cf-4cf3-be11-e01f17f1ef69"). InnerVolumeSpecName "kube-api-access-qqxqb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:38:45.158074 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.158057    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/18f92954-60cf-4cf3-be11-e01f17f1ef69-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "18f92954-60cf-4cf3-be11-e01f17f1ef69" (UID: "18f92954-60cf-4cf3-be11-e01f17f1ef69"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 18:38:45.158147 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.158085    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18f92954-60cf-4cf3-be11-e01f17f1ef69-istio-token" (OuterVolumeSpecName: "istio-token") pod "18f92954-60cf-4cf3-be11-e01f17f1ef69" (UID: "18f92954-60cf-4cf3-be11-e01f17f1ef69"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:38:45.256451 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.256413    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/18f92954-60cf-4cf3-be11-e01f17f1ef69-istio-envoy\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:38:45.256451 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.256448    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/18f92954-60cf-4cf3-be11-e01f17f1ef69-workload-socket\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:38:45.256451 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.256458    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/18f92954-60cf-4cf3-be11-e01f17f1ef69-istio-token\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:38:45.256704 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.256467    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/18f92954-60cf-4cf3-be11-e01f17f1ef69-istio-podinfo\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:38:45.256704 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.256475    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/18f92954-60cf-4cf3-be11-e01f17f1ef69-credential-socket\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:38:45.256704 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.256485    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqxqb\" (UniqueName: \"kubernetes.io/projected/18f92954-60cf-4cf3-be11-e01f17f1ef69-kube-api-access-qqxqb\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:38:45.256704 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.256495    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/18f92954-60cf-4cf3-be11-e01f17f1ef69-istiod-ca-cert\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:38:45.256704 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.256505    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/18f92954-60cf-4cf3-be11-e01f17f1ef69-istio-data\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:38:45.458945 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.458907    2572 generic.go:356] "Generic (PLEG): container finished" podID="18f92954-60cf-4cf3-be11-e01f17f1ef69" containerID="753fa786e768a560a2aec0807ad451d73148771c463d991b0bcd3d1cd435500f" exitCode=0
Jul 17 18:38:45.459156 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.458963    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"
Jul 17 18:38:45.459156 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.458992    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7" event={"ID":"18f92954-60cf-4cf3-be11-e01f17f1ef69","Type":"ContainerDied","Data":"753fa786e768a560a2aec0807ad451d73148771c463d991b0bcd3d1cd435500f"}
Jul 17 18:38:45.459156 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.459061    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7" event={"ID":"18f92954-60cf-4cf3-be11-e01f17f1ef69","Type":"ContainerDied","Data":"101374cfc72defda6c3bdb4bdf5fc3570f13aff0de541181a43fcdc1c098bfbe"}
Jul 17 18:38:45.459156 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.459087    2572 scope.go:117] "RemoveContainer" containerID="753fa786e768a560a2aec0807ad451d73148771c463d991b0bcd3d1cd435500f"
Jul 17 18:38:45.462165 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.462136    2572 generic.go:356] "Generic (PLEG): container finished" podID="764d8aaf-d467-41c0-84c2-b4678793fd50" containerID="e963e72c5dd442488bb779be86299b9314ae7eaf94854c54dd1014ed100f9873" exitCode=6
Jul 17 18:38:45.462313 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.462232    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qwch5" event={"ID":"764d8aaf-d467-41c0-84c2-b4678793fd50","Type":"ContainerDied","Data":"e963e72c5dd442488bb779be86299b9314ae7eaf94854c54dd1014ed100f9873"}
Jul 17 18:38:45.462634 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.462616    2572 scope.go:117] "RemoveContainer" containerID="e963e72c5dd442488bb779be86299b9314ae7eaf94854c54dd1014ed100f9873"
Jul 17 18:38:45.462844 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:38:45.462824    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-qwch5_odh-ai-gateway-infra(764d8aaf-d467-41c0-84c2-b4678793fd50)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qwch5" podUID="764d8aaf-d467-41c0-84c2-b4678793fd50"
Jul 17 18:38:45.469257 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.469237    2572 scope.go:117] "RemoveContainer" containerID="9966c3c49fc3b58e6e4b8cf15097190dab47e313519b6290231110f18e8afaa4"
Jul 17 18:38:45.472243 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.472221    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c2cc4da-c14f-4805-a42a-1c6feb16160f" path="/var/lib/kubelet/pods/4c2cc4da-c14f-4805-a42a-1c6feb16160f/volumes"
Jul 17 18:38:45.478888 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.478846    2572 scope.go:117] "RemoveContainer" containerID="753fa786e768a560a2aec0807ad451d73148771c463d991b0bcd3d1cd435500f"
Jul 17 18:38:45.479194 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:38:45.479172    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"753fa786e768a560a2aec0807ad451d73148771c463d991b0bcd3d1cd435500f\": container with ID starting with 753fa786e768a560a2aec0807ad451d73148771c463d991b0bcd3d1cd435500f not found: ID does not exist" containerID="753fa786e768a560a2aec0807ad451d73148771c463d991b0bcd3d1cd435500f"
Jul 17 18:38:45.479268 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.479203    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"753fa786e768a560a2aec0807ad451d73148771c463d991b0bcd3d1cd435500f"} err="failed to get container status \"753fa786e768a560a2aec0807ad451d73148771c463d991b0bcd3d1cd435500f\": rpc error: code = NotFound desc = could not find container \"753fa786e768a560a2aec0807ad451d73148771c463d991b0bcd3d1cd435500f\": container with ID starting with 753fa786e768a560a2aec0807ad451d73148771c463d991b0bcd3d1cd435500f not found: ID does not exist"
Jul 17 18:38:45.479268 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.479224    2572 scope.go:117] "RemoveContainer" containerID="9966c3c49fc3b58e6e4b8cf15097190dab47e313519b6290231110f18e8afaa4"
Jul 17 18:38:45.479498 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:38:45.479479    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9966c3c49fc3b58e6e4b8cf15097190dab47e313519b6290231110f18e8afaa4\": container with ID starting with 9966c3c49fc3b58e6e4b8cf15097190dab47e313519b6290231110f18e8afaa4 not found: ID does not exist" containerID="9966c3c49fc3b58e6e4b8cf15097190dab47e313519b6290231110f18e8afaa4"
Jul 17 18:38:45.479542 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.479505    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9966c3c49fc3b58e6e4b8cf15097190dab47e313519b6290231110f18e8afaa4"} err="failed to get container status \"9966c3c49fc3b58e6e4b8cf15097190dab47e313519b6290231110f18e8afaa4\": rpc error: code = NotFound desc = could not find container \"9966c3c49fc3b58e6e4b8cf15097190dab47e313519b6290231110f18e8afaa4\": container with ID starting with 9966c3c49fc3b58e6e4b8cf15097190dab47e313519b6290231110f18e8afaa4 not found: ID does not exist"
Jul 17 18:38:45.479542 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.479522    2572 scope.go:117] "RemoveContainer" containerID="54737ee6be2b47f302695f84a41649348fb72c12d74149c86b72f059da8c7c26"
Jul 17 18:38:45.509099 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.509068    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"]
Jul 17 18:38:45.516692 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:45.516664    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-89d8005f-openshift-default-79c58cf65f-dgxz7"]
Jul 17 18:38:46.125336 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:46.125235    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:38:46.226890 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:46.226854    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:38:46.326741 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:46.326695    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:38:46.490934 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:46.490902    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qwch5"]
Jul 17 18:38:46.516665 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:46.516630    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:38:46.632451 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:46.632428    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qwch5"
Jul 17 18:38:46.665520 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:46.665486    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/764d8aaf-d467-41c0-84c2-b4678793fd50-maas-api-service-ca\") pod \"764d8aaf-d467-41c0-84c2-b4678793fd50\" (UID: \"764d8aaf-d467-41c0-84c2-b4678793fd50\") "
Jul 17 18:38:46.665852 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:46.665818    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/764d8aaf-d467-41c0-84c2-b4678793fd50-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "764d8aaf-d467-41c0-84c2-b4678793fd50" (UID: "764d8aaf-d467-41c0-84c2-b4678793fd50"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:38:46.766349 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:46.766259    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/764d8aaf-d467-41c0-84c2-b4678793fd50-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:38:47.471377 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:47.471340    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18f92954-60cf-4cf3-be11-e01f17f1ef69" path="/var/lib/kubelet/pods/18f92954-60cf-4cf3-be11-e01f17f1ef69/volumes"
Jul 17 18:38:47.477148 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:47.477119    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qwch5" event={"ID":"764d8aaf-d467-41c0-84c2-b4678793fd50","Type":"ContainerDied","Data":"e7e81363141d07f92fa5dc2f2923221190f7149493def28d94c5bd6aab97dc48"}
Jul 17 18:38:47.477318 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:47.477161    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qwch5"
Jul 17 18:38:47.477318 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:47.477176    2572 scope.go:117] "RemoveContainer" containerID="e963e72c5dd442488bb779be86299b9314ae7eaf94854c54dd1014ed100f9873"
Jul 17 18:38:47.496587 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:47.496562    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qwch5"]
Jul 17 18:38:47.502320 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:47.502298    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-qwch5"]
Jul 17 18:38:49.477871 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:49.477834    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="764d8aaf-d467-41c0-84c2-b4678793fd50" path="/var/lib/kubelet/pods/764d8aaf-d467-41c0-84c2-b4678793fd50/volumes"
Jul 17 18:38:52.060300 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:52.060262    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:38:52.130249 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:52.130214    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:38:58.998161 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:58.998114    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:38:59.277187 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.277108    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"]
Jul 17 18:38:59.277475 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.277463    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="764d8aaf-d467-41c0-84c2-b4678793fd50" containerName="revoke-keys"
Jul 17 18:38:59.277525 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.277477    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="764d8aaf-d467-41c0-84c2-b4678793fd50" containerName="revoke-keys"
Jul 17 18:38:59.277525 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.277490    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="764d8aaf-d467-41c0-84c2-b4678793fd50" containerName="revoke-keys"
Jul 17 18:38:59.277525 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.277496    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="764d8aaf-d467-41c0-84c2-b4678793fd50" containerName="revoke-keys"
Jul 17 18:38:59.277525 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.277503    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18f92954-60cf-4cf3-be11-e01f17f1ef69" containerName="istio-proxy"
Jul 17 18:38:59.277525 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.277508    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="18f92954-60cf-4cf3-be11-e01f17f1ef69" containerName="istio-proxy"
Jul 17 18:38:59.277525 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.277515    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c2cc4da-c14f-4805-a42a-1c6feb16160f" containerName="revoke-keys"
Jul 17 18:38:59.277525 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.277520    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c2cc4da-c14f-4805-a42a-1c6feb16160f" containerName="revoke-keys"
Jul 17 18:38:59.277736 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.277526    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c2cc4da-c14f-4805-a42a-1c6feb16160f" containerName="revoke-keys"
Jul 17 18:38:59.277736 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.277546    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c2cc4da-c14f-4805-a42a-1c6feb16160f" containerName="revoke-keys"
Jul 17 18:38:59.277736 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.277555    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18f92954-60cf-4cf3-be11-e01f17f1ef69" containerName="istio-proxy"
Jul 17 18:38:59.277736 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.277560    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="18f92954-60cf-4cf3-be11-e01f17f1ef69" containerName="istio-proxy"
Jul 17 18:38:59.277736 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.277568    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c2cc4da-c14f-4805-a42a-1c6feb16160f" containerName="revoke-keys"
Jul 17 18:38:59.277736 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.277573    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c2cc4da-c14f-4805-a42a-1c6feb16160f" containerName="revoke-keys"
Jul 17 18:38:59.277736 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.277634    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="18f92954-60cf-4cf3-be11-e01f17f1ef69" containerName="istio-proxy"
Jul 17 18:38:59.277736 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.277641    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="18f92954-60cf-4cf3-be11-e01f17f1ef69" containerName="istio-proxy"
Jul 17 18:38:59.277736 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.277647    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c2cc4da-c14f-4805-a42a-1c6feb16160f" containerName="revoke-keys"
Jul 17 18:38:59.277736 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.277652    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="764d8aaf-d467-41c0-84c2-b4678793fd50" containerName="revoke-keys"
Jul 17 18:38:59.277736 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.277658    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c2cc4da-c14f-4805-a42a-1c6feb16160f" containerName="revoke-keys"
Jul 17 18:38:59.277736 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.277664    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="764d8aaf-d467-41c0-84c2-b4678793fd50" containerName="revoke-keys"
Jul 17 18:38:59.277736 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.277671    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="764d8aaf-d467-41c0-84c2-b4678793fd50" containerName="revoke-keys"
Jul 17 18:38:59.280760 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.280739    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:38:59.283343 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.283318    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-186d6157-openshift-default-dockercfg-6cflb\""
Jul 17 18:38:59.292854 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.292825    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"]
Jul 17 18:38:59.312358 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.312324    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:38:59.381134 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.381097    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/490fcbfb-e25b-42fa-a64e-a25b28896841-workload-certs\") pod \"e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") " pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:38:59.381357 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.381150    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/490fcbfb-e25b-42fa-a64e-a25b28896841-credential-socket\") pod \"e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") " pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:38:59.381357 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.381222    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/490fcbfb-e25b-42fa-a64e-a25b28896841-istiod-ca-cert\") pod \"e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") " pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:38:59.381357 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.381284    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/490fcbfb-e25b-42fa-a64e-a25b28896841-istio-envoy\") pod \"e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") " pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:38:59.381357 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.381338    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc4fd\" (UniqueName: \"kubernetes.io/projected/490fcbfb-e25b-42fa-a64e-a25b28896841-kube-api-access-kc4fd\") pod \"e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") " pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:38:59.381593 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.381368    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/490fcbfb-e25b-42fa-a64e-a25b28896841-istio-podinfo\") pod \"e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") " pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:38:59.381593 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.381396    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/490fcbfb-e25b-42fa-a64e-a25b28896841-istio-token\") pod \"e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") " pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:38:59.381593 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.381436    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/490fcbfb-e25b-42fa-a64e-a25b28896841-istio-data\") pod \"e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") " pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:38:59.381593 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.381482    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/490fcbfb-e25b-42fa-a64e-a25b28896841-workload-socket\") pod \"e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") " pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:38:59.465474 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.465435    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:38:59.482529 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.482492    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/490fcbfb-e25b-42fa-a64e-a25b28896841-workload-certs\") pod \"e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") " pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:38:59.482709 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.482544    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/490fcbfb-e25b-42fa-a64e-a25b28896841-credential-socket\") pod \"e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") " pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:38:59.482709 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.482569    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/490fcbfb-e25b-42fa-a64e-a25b28896841-istiod-ca-cert\") pod \"e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") " pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:38:59.482709 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.482588    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/490fcbfb-e25b-42fa-a64e-a25b28896841-istio-envoy\") pod \"e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") " pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:38:59.482709 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.482628    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc4fd\" (UniqueName: \"kubernetes.io/projected/490fcbfb-e25b-42fa-a64e-a25b28896841-kube-api-access-kc4fd\") pod \"e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") " pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:38:59.482709 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.482650    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/490fcbfb-e25b-42fa-a64e-a25b28896841-istio-podinfo\") pod \"e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") " pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:38:59.482709 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.482671    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/490fcbfb-e25b-42fa-a64e-a25b28896841-istio-token\") pod \"e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") " pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:38:59.483065 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.482828    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/490fcbfb-e25b-42fa-a64e-a25b28896841-istio-data\") pod \"e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") " pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:38:59.483065 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.482896    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/490fcbfb-e25b-42fa-a64e-a25b28896841-workload-socket\") pod \"e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") " pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:38:59.483361 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.483309    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/490fcbfb-e25b-42fa-a64e-a25b28896841-istio-data\") pod \"e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") " pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:38:59.483361 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.483344    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/490fcbfb-e25b-42fa-a64e-a25b28896841-workload-certs\") pod \"e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") " pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:38:59.483551 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.483421    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/490fcbfb-e25b-42fa-a64e-a25b28896841-credential-socket\") pod \"e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") " pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:38:59.483551 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.483466    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/490fcbfb-e25b-42fa-a64e-a25b28896841-workload-socket\") pod \"e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") " pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:38:59.483685 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.483665    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/490fcbfb-e25b-42fa-a64e-a25b28896841-istiod-ca-cert\") pod \"e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") " pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:38:59.485064 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.485043    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/490fcbfb-e25b-42fa-a64e-a25b28896841-istio-envoy\") pod \"e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") " pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:38:59.485315 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.485295    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/490fcbfb-e25b-42fa-a64e-a25b28896841-istio-podinfo\") pod \"e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") " pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:38:59.490433 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.490413    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/490fcbfb-e25b-42fa-a64e-a25b28896841-istio-token\") pod \"e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") " pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:38:59.490638 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.490613    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc4fd\" (UniqueName: \"kubernetes.io/projected/490fcbfb-e25b-42fa-a64e-a25b28896841-kube-api-access-kc4fd\") pod \"e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") " pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:38:59.593379 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.593288    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:38:59.737294 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.737263    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"]
Jul 17 18:38:59.739969 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:38:59.739941    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod490fcbfb_e25b_42fa_a64e_a25b28896841.slice/crio-7464914b42a49af03cb8958df15730eb50cf773866c8082c1c29a98be317585b WatchSource:0}: Error finding container 7464914b42a49af03cb8958df15730eb50cf773866c8082c1c29a98be317585b: Status 404 returned error can't find the container with id 7464914b42a49af03cb8958df15730eb50cf773866c8082c1c29a98be317585b
Jul 17 18:38:59.742084 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.742055    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:38:59.742154 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.742120    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:38:59.742154 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:38:59.742148    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:39:00.542419 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:00.542381    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k" event={"ID":"490fcbfb-e25b-42fa-a64e-a25b28896841","Type":"ContainerStarted","Data":"ab707f158bef4e0bbb6b222a4b3927f554a01219948cc3cbcf0e129a8dbc6dc0"}
Jul 17 18:39:00.542921 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:00.542435    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k" event={"ID":"490fcbfb-e25b-42fa-a64e-a25b28896841","Type":"ContainerStarted","Data":"7464914b42a49af03cb8958df15730eb50cf773866c8082c1c29a98be317585b"}
Jul 17 18:39:00.561296 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:00.561241    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k" podStartSLOduration=1.561218726 podStartE2EDuration="1.561218726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:38:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:39:00.560734272 +0000 UTC m=+2567.785963593" watchObservedRunningTime="2026-07-17 18:39:00.561218726 +0000 UTC m=+2567.786448036"
Jul 17 18:39:00.593884 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:00.593839    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:39:00.599116 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:00.599091    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:39:01.547306 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:01.547273    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:39:01.548403 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:01.548384    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:39:02.504869 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:02.504824    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:39:02.580523 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:02.580067    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-186d6157-6856976567-52sb4"]
Jul 17 18:39:02.581020 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:02.580683    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="764d8aaf-d467-41c0-84c2-b4678793fd50" containerName="revoke-keys"
Jul 17 18:39:02.581020 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:02.580700    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="764d8aaf-d467-41c0-84c2-b4678793fd50" containerName="revoke-keys"
Jul 17 18:39:02.581020 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:02.580815    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c2cc4da-c14f-4805-a42a-1c6feb16160f" containerName="revoke-keys"
Jul 17 18:39:02.584678 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:02.584652    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-186d6157-6856976567-52sb4"
Jul 17 18:39:02.587689 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:02.587523    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-186d6157-serving-cert\""
Jul 17 18:39:02.597221 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:02.596374    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-186d6157-6856976567-52sb4"]
Jul 17 18:39:02.599414 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:02.599278    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:39:02.698164 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:02.698108    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:39:02.715244 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:02.715201    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f698cc50-a3ec-4f91-95c7-d712255d394e-maas-api-tls\") pod \"maas-api-e2e-mt-186d6157-6856976567-52sb4\" (UID: \"f698cc50-a3ec-4f91-95c7-d712255d394e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-186d6157-6856976567-52sb4"
Jul 17 18:39:02.715433 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:02.715261    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f698cc50-a3ec-4f91-95c7-d712255d394e-openshift-service-ca\") pod \"maas-api-e2e-mt-186d6157-6856976567-52sb4\" (UID: \"f698cc50-a3ec-4f91-95c7-d712255d394e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-186d6157-6856976567-52sb4"
Jul 17 18:39:02.715433 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:02.715321    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cxjr\" (UniqueName: \"kubernetes.io/projected/f698cc50-a3ec-4f91-95c7-d712255d394e-kube-api-access-2cxjr\") pod \"maas-api-e2e-mt-186d6157-6856976567-52sb4\" (UID: \"f698cc50-a3ec-4f91-95c7-d712255d394e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-186d6157-6856976567-52sb4"
Jul 17 18:39:02.816877 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:02.816783    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f698cc50-a3ec-4f91-95c7-d712255d394e-maas-api-tls\") pod \"maas-api-e2e-mt-186d6157-6856976567-52sb4\" (UID: \"f698cc50-a3ec-4f91-95c7-d712255d394e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-186d6157-6856976567-52sb4"
Jul 17 18:39:02.816877 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:02.816865    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f698cc50-a3ec-4f91-95c7-d712255d394e-openshift-service-ca\") pod \"maas-api-e2e-mt-186d6157-6856976567-52sb4\" (UID: \"f698cc50-a3ec-4f91-95c7-d712255d394e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-186d6157-6856976567-52sb4"
Jul 17 18:39:02.817158 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:02.816903    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cxjr\" (UniqueName: \"kubernetes.io/projected/f698cc50-a3ec-4f91-95c7-d712255d394e-kube-api-access-2cxjr\") pod \"maas-api-e2e-mt-186d6157-6856976567-52sb4\" (UID: \"f698cc50-a3ec-4f91-95c7-d712255d394e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-186d6157-6856976567-52sb4"
Jul 17 18:39:02.817158 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:39:02.816956    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-186d6157-serving-cert: secret "maas-api-e2e-mt-186d6157-serving-cert" not found
Jul 17 18:39:02.817158 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:39:02.817070    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f698cc50-a3ec-4f91-95c7-d712255d394e-maas-api-tls podName:f698cc50-a3ec-4f91-95c7-d712255d394e nodeName:}" failed. No retries permitted until 2026-07-17 18:39:03.31704584 +0000 UTC m=+2570.542275159 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f698cc50-a3ec-4f91-95c7-d712255d394e-maas-api-tls") pod "maas-api-e2e-mt-186d6157-6856976567-52sb4" (UID: "f698cc50-a3ec-4f91-95c7-d712255d394e") : secret "maas-api-e2e-mt-186d6157-serving-cert" not found
Jul 17 18:39:02.817610 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:02.817589    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f698cc50-a3ec-4f91-95c7-d712255d394e-openshift-service-ca\") pod \"maas-api-e2e-mt-186d6157-6856976567-52sb4\" (UID: \"f698cc50-a3ec-4f91-95c7-d712255d394e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-186d6157-6856976567-52sb4"
Jul 17 18:39:02.828606 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:02.828580    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cxjr\" (UniqueName: \"kubernetes.io/projected/f698cc50-a3ec-4f91-95c7-d712255d394e-kube-api-access-2cxjr\") pod \"maas-api-e2e-mt-186d6157-6856976567-52sb4\" (UID: \"f698cc50-a3ec-4f91-95c7-d712255d394e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-186d6157-6856976567-52sb4"
Jul 17 18:39:02.942512 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:02.942473    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:39:03.072212 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:03.072115    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:39:03.172520 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:03.172474    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:39:03.322708 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:03.322596    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f698cc50-a3ec-4f91-95c7-d712255d394e-maas-api-tls\") pod \"maas-api-e2e-mt-186d6157-6856976567-52sb4\" (UID: \"f698cc50-a3ec-4f91-95c7-d712255d394e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-186d6157-6856976567-52sb4"
Jul 17 18:39:03.325126 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:03.325099    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f698cc50-a3ec-4f91-95c7-d712255d394e-maas-api-tls\") pod \"maas-api-e2e-mt-186d6157-6856976567-52sb4\" (UID: \"f698cc50-a3ec-4f91-95c7-d712255d394e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-186d6157-6856976567-52sb4"
Jul 17 18:39:03.501149 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:03.501110    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-186d6157-6856976567-52sb4"
Jul 17 18:39:03.642514 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:03.642486    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-186d6157-6856976567-52sb4"]
Jul 17 18:39:03.644689 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:39:03.644655    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf698cc50_a3ec_4f91_95c7_d712255d394e.slice/crio-ab835469e68874cc7514ca3583d1e12521280145ae98e65a547394439e7fefba WatchSource:0}: Error finding container ab835469e68874cc7514ca3583d1e12521280145ae98e65a547394439e7fefba: Status 404 returned error can't find the container with id ab835469e68874cc7514ca3583d1e12521280145ae98e65a547394439e7fefba
Jul 17 18:39:03.646164 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:03.646141    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 18:39:04.567351 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:04.567319    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-186d6157-6856976567-52sb4" event={"ID":"f698cc50-a3ec-4f91-95c7-d712255d394e","Type":"ContainerStarted","Data":"88058e26677da4b71f689b7d337414fa0dcc478b92a34e9a25bfb75385f2247d"}
Jul 17 18:39:04.567548 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:04.567375    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-186d6157-6856976567-52sb4" event={"ID":"f698cc50-a3ec-4f91-95c7-d712255d394e","Type":"ContainerStarted","Data":"ab835469e68874cc7514ca3583d1e12521280145ae98e65a547394439e7fefba"}
Jul 17 18:39:04.567548 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:04.567407    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-186d6157-6856976567-52sb4"
Jul 17 18:39:04.588458 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:04.588403    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-186d6157-6856976567-52sb4" podStartSLOduration=2.135569597 podStartE2EDuration="2.588385123s" totalImagesPullingTime="452.815526ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:39:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:39:04.586261424 +0000 UTC m=+2571.811490731" watchObservedRunningTime="2026-07-17 18:39:04.588385123 +0000 UTC m=+2571.813614431"
Jul 17 18:39:07.034427 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:07.034388    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:39:10.587141 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:10.587103    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-186d6157-6856976567-52sb4"
Jul 17 18:39:17.040858 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:17.039223    2572 patch_prober.go:28] interesting pod/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": read tcp 10.132.0.2:51874->10.132.0.86:15021: read: connection reset by peer" start-of-body=
Jul 17 18:39:17.040858 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:17.039309    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k" podUID="490fcbfb-e25b-42fa-a64e-a25b28896841" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": read tcp 10.132.0.2:51874->10.132.0.86:15021: read: connection reset by peer"
Jul 17 18:39:17.632425 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:17.632391    2572 generic.go:356] "Generic (PLEG): container finished" podID="490fcbfb-e25b-42fa-a64e-a25b28896841" containerID="ab707f158bef4e0bbb6b222a4b3927f554a01219948cc3cbcf0e129a8dbc6dc0" exitCode=0
Jul 17 18:39:17.632607 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:17.632438    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k" event={"ID":"490fcbfb-e25b-42fa-a64e-a25b28896841","Type":"ContainerDied","Data":"ab707f158bef4e0bbb6b222a4b3927f554a01219948cc3cbcf0e129a8dbc6dc0"}
Jul 17 18:39:17.632810 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:17.632797    2572 scope.go:117] "RemoveContainer" containerID="ab707f158bef4e0bbb6b222a4b3927f554a01219948cc3cbcf0e129a8dbc6dc0"
Jul 17 18:39:17.633846 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:17.633821    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:39:17.633909 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:17.633885    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:39:17.633945 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:17.633915    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:39:18.640242 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:18.640203    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k" event={"ID":"490fcbfb-e25b-42fa-a64e-a25b28896841","Type":"ContainerStarted","Data":"72a230429c7d372157bded01b0adf376d1d1e94e255468a9cd038c8fd0e6c95f"}
Jul 17 18:39:19.593500 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:19.593460    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:39:19.593733 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:19.593704    2572 patch_prober.go:28] interesting pod/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Jul 17 18:39:19.593794 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:19.593775    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k" podUID="490fcbfb-e25b-42fa-a64e-a25b28896841" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Jul 17 18:39:20.593978 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:20.593942    2572 patch_prober.go:28] interesting pod/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Jul 17 18:39:20.594388 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:20.594013    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k" podUID="490fcbfb-e25b-42fa-a64e-a25b28896841" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Jul 17 18:39:21.593949 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:21.593907    2572 patch_prober.go:28] interesting pod/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Jul 17 18:39:21.594176 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:21.593980    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k" podUID="490fcbfb-e25b-42fa-a64e-a25b28896841" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Jul 17 18:39:22.594395 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:22.594357    2572 patch_prober.go:28] interesting pod/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Jul 17 18:39:22.594932 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:22.594895    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k" podUID="490fcbfb-e25b-42fa-a64e-a25b28896841" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Jul 17 18:39:23.497703 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:23.497670    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:39:23.598082 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:23.598045    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:39:23.598609 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:23.598590    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:39:23.599423 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:23.599406    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:39:25.184497 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:25.184465    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-5dmt6"]
Jul 17 18:39:25.188076 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:25.188059    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-5dmt6"
Jul 17 18:39:25.191686 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:25.191661    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:39:25.198406 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:25.198382    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-5dmt6"]
Jul 17 18:39:25.336373 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:25.336336    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1f44348-7b5c-4076-bcba-a36280ad45a3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35dc36c4-5dmt6\" (UID: \"d1f44348-7b5c-4076-bcba-a36280ad45a3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-5dmt6"
Jul 17 18:39:25.437893 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:25.437840    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1f44348-7b5c-4076-bcba-a36280ad45a3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35dc36c4-5dmt6\" (UID: \"d1f44348-7b5c-4076-bcba-a36280ad45a3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-5dmt6"
Jul 17 18:39:25.438573 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:25.438547    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1f44348-7b5c-4076-bcba-a36280ad45a3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35dc36c4-5dmt6\" (UID: \"d1f44348-7b5c-4076-bcba-a36280ad45a3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-5dmt6"
Jul 17 18:39:25.498845 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:25.498798    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-5dmt6"
Jul 17 18:39:25.636161 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:25.636134    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-5dmt6"]
Jul 17 18:39:25.638703 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:39:25.638654    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f44348_7b5c_4076_bcba_a36280ad45a3.slice/crio-057efb966446654142a0ca47f0445b07ffb3661d89b19e5977a8016a278e570a WatchSource:0}: Error finding container 057efb966446654142a0ca47f0445b07ffb3661d89b19e5977a8016a278e570a: Status 404 returned error can't find the container with id 057efb966446654142a0ca47f0445b07ffb3661d89b19e5977a8016a278e570a
Jul 17 18:39:25.678423 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:25.678388    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-5dmt6" event={"ID":"d1f44348-7b5c-4076-bcba-a36280ad45a3","Type":"ContainerStarted","Data":"057efb966446654142a0ca47f0445b07ffb3661d89b19e5977a8016a278e570a"}
Jul 17 18:39:26.684684 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:26.684588    2572 generic.go:356] "Generic (PLEG): container finished" podID="d1f44348-7b5c-4076-bcba-a36280ad45a3" containerID="bd18307abc656d440f00056e11c4809fde3440ebf978a9dbe25295221e4fb876" exitCode=6
Jul 17 18:39:26.685091 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:26.684678    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-5dmt6" event={"ID":"d1f44348-7b5c-4076-bcba-a36280ad45a3","Type":"ContainerDied","Data":"bd18307abc656d440f00056e11c4809fde3440ebf978a9dbe25295221e4fb876"}
Jul 17 18:39:26.685091 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:26.684861    2572 scope.go:117] "RemoveContainer" containerID="bd18307abc656d440f00056e11c4809fde3440ebf978a9dbe25295221e4fb876"
Jul 17 18:39:27.691073 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:27.691040    2572 generic.go:356] "Generic (PLEG): container finished" podID="d1f44348-7b5c-4076-bcba-a36280ad45a3" containerID="822a50c5790800223dd7d06729a875c98031da42d1b8ee9ffd3681262d511c19" exitCode=6
Jul 17 18:39:27.691539 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:27.691132    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-5dmt6" event={"ID":"d1f44348-7b5c-4076-bcba-a36280ad45a3","Type":"ContainerDied","Data":"822a50c5790800223dd7d06729a875c98031da42d1b8ee9ffd3681262d511c19"}
Jul 17 18:39:27.691539 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:27.691213    2572 scope.go:117] "RemoveContainer" containerID="bd18307abc656d440f00056e11c4809fde3440ebf978a9dbe25295221e4fb876"
Jul 17 18:39:27.691539 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:27.691337    2572 scope.go:117] "RemoveContainer" containerID="822a50c5790800223dd7d06729a875c98031da42d1b8ee9ffd3681262d511c19"
Jul 17 18:39:27.691539 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:39:27.691519    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-35dc36c4-5dmt6_odh-ai-gateway-infra(d1f44348-7b5c-4076-bcba-a36280ad45a3)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-5dmt6" podUID="d1f44348-7b5c-4076-bcba-a36280ad45a3"
Jul 17 18:39:28.698540 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:28.698510    2572 scope.go:117] "RemoveContainer" containerID="822a50c5790800223dd7d06729a875c98031da42d1b8ee9ffd3681262d511c19"
Jul 17 18:39:28.698929 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:39:28.698730    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-35dc36c4-5dmt6_odh-ai-gateway-infra(d1f44348-7b5c-4076-bcba-a36280ad45a3)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-5dmt6" podUID="d1f44348-7b5c-4076-bcba-a36280ad45a3"
Jul 17 18:39:40.466131 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:40.466051    2572 scope.go:117] "RemoveContainer" containerID="822a50c5790800223dd7d06729a875c98031da42d1b8ee9ffd3681262d511c19"
Jul 17 18:39:41.768758 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:41.768722    2572 generic.go:356] "Generic (PLEG): container finished" podID="d1f44348-7b5c-4076-bcba-a36280ad45a3" containerID="a753e6e62b6726bca6dc125f6a386e3f71f4d823f75c27518b759be1b552071b" exitCode=6
Jul 17 18:39:41.769229 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:41.768795    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-5dmt6" event={"ID":"d1f44348-7b5c-4076-bcba-a36280ad45a3","Type":"ContainerDied","Data":"a753e6e62b6726bca6dc125f6a386e3f71f4d823f75c27518b759be1b552071b"}
Jul 17 18:39:41.769229 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:41.768855    2572 scope.go:117] "RemoveContainer" containerID="822a50c5790800223dd7d06729a875c98031da42d1b8ee9ffd3681262d511c19"
Jul 17 18:39:41.769229 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:41.769186    2572 scope.go:117] "RemoveContainer" containerID="a753e6e62b6726bca6dc125f6a386e3f71f4d823f75c27518b759be1b552071b"
Jul 17 18:39:41.769434 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:39:41.769409    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-35dc36c4-5dmt6_odh-ai-gateway-infra(d1f44348-7b5c-4076-bcba-a36280ad45a3)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-5dmt6" podUID="d1f44348-7b5c-4076-bcba-a36280ad45a3"
Jul 17 18:39:42.793747 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:42.793713    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-5dmt6"]
Jul 17 18:39:42.935110 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:42.935084    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-5dmt6"
Jul 17 18:39:42.989768 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:42.989733    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1f44348-7b5c-4076-bcba-a36280ad45a3-maas-api-service-ca\") pod \"d1f44348-7b5c-4076-bcba-a36280ad45a3\" (UID: \"d1f44348-7b5c-4076-bcba-a36280ad45a3\") "
Jul 17 18:39:42.990188 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:42.990164    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1f44348-7b5c-4076-bcba-a36280ad45a3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d1f44348-7b5c-4076-bcba-a36280ad45a3" (UID: "d1f44348-7b5c-4076-bcba-a36280ad45a3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:39:43.091042 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:43.090949    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d1f44348-7b5c-4076-bcba-a36280ad45a3-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:39:43.782237 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:43.782149    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-5dmt6"
Jul 17 18:39:43.782237 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:43.782146    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-5dmt6" event={"ID":"d1f44348-7b5c-4076-bcba-a36280ad45a3","Type":"ContainerDied","Data":"057efb966446654142a0ca47f0445b07ffb3661d89b19e5977a8016a278e570a"}
Jul 17 18:39:43.782556 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:43.782285    2572 scope.go:117] "RemoveContainer" containerID="a753e6e62b6726bca6dc125f6a386e3f71f4d823f75c27518b759be1b552071b"
Jul 17 18:39:43.799475 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:43.799435    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-5dmt6"]
Jul 17 18:39:43.807362 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:43.807329    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-5dmt6"]
Jul 17 18:39:45.386261 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:45.386220    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-186d6157-7mv2t"]
Jul 17 18:39:45.386729 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:45.386586    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1f44348-7b5c-4076-bcba-a36280ad45a3" containerName="revoke-keys"
Jul 17 18:39:45.386729 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:45.386597    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1f44348-7b5c-4076-bcba-a36280ad45a3" containerName="revoke-keys"
Jul 17 18:39:45.386729 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:45.386614    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1f44348-7b5c-4076-bcba-a36280ad45a3" containerName="revoke-keys"
Jul 17 18:39:45.386729 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:45.386619    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1f44348-7b5c-4076-bcba-a36280ad45a3" containerName="revoke-keys"
Jul 17 18:39:45.386729 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:45.386693    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1f44348-7b5c-4076-bcba-a36280ad45a3" containerName="revoke-keys"
Jul 17 18:39:45.386729 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:45.386702    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1f44348-7b5c-4076-bcba-a36280ad45a3" containerName="revoke-keys"
Jul 17 18:39:45.390945 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:45.390924    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-186d6157-7mv2t"
Jul 17 18:39:45.393615 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:45.393590    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:39:45.395875 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:45.395851    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-186d6157-7mv2t"]
Jul 17 18:39:45.412494 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:45.412459    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b94cc690-99d6-464b-941a-c8f1ebb8cf21-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-186d6157-7mv2t\" (UID: \"b94cc690-99d6-464b-941a-c8f1ebb8cf21\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-186d6157-7mv2t"
Jul 17 18:39:45.471783 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:45.471752    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1f44348-7b5c-4076-bcba-a36280ad45a3" path="/var/lib/kubelet/pods/d1f44348-7b5c-4076-bcba-a36280ad45a3/volumes"
Jul 17 18:39:45.513394 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:45.513363    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b94cc690-99d6-464b-941a-c8f1ebb8cf21-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-186d6157-7mv2t\" (UID: \"b94cc690-99d6-464b-941a-c8f1ebb8cf21\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-186d6157-7mv2t"
Jul 17 18:39:45.514059 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:45.514036    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b94cc690-99d6-464b-941a-c8f1ebb8cf21-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-186d6157-7mv2t\" (UID: \"b94cc690-99d6-464b-941a-c8f1ebb8cf21\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-186d6157-7mv2t"
Jul 17 18:39:45.705975 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:45.705938    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-186d6157-7mv2t"
Jul 17 18:39:45.853381 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:45.853355    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-186d6157-7mv2t"]
Jul 17 18:39:45.856116 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:39:45.856083    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb94cc690_99d6_464b_941a_c8f1ebb8cf21.slice/crio-18966d1042735471e0508cd711dcf06e327abdd2b1c76b221095283a0b5eca51 WatchSource:0}: Error finding container 18966d1042735471e0508cd711dcf06e327abdd2b1c76b221095283a0b5eca51: Status 404 returned error can't find the container with id 18966d1042735471e0508cd711dcf06e327abdd2b1c76b221095283a0b5eca51
Jul 17 18:39:46.801130 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:46.801096    2572 generic.go:356] "Generic (PLEG): container finished" podID="b94cc690-99d6-464b-941a-c8f1ebb8cf21" containerID="3e26d2b489da7e2ebc2f1d0f307ef746c665995ece4bd8d8f76ea585d138c47e" exitCode=0
Jul 17 18:39:46.801522 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:46.801182    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-186d6157-7mv2t" event={"ID":"b94cc690-99d6-464b-941a-c8f1ebb8cf21","Type":"ContainerDied","Data":"3e26d2b489da7e2ebc2f1d0f307ef746c665995ece4bd8d8f76ea585d138c47e"}
Jul 17 18:39:46.801522 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:46.801244    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-186d6157-7mv2t" event={"ID":"b94cc690-99d6-464b-941a-c8f1ebb8cf21","Type":"ContainerStarted","Data":"18966d1042735471e0508cd711dcf06e327abdd2b1c76b221095283a0b5eca51"}
Jul 17 18:39:47.944546 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:47.944519    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-186d6157-7mv2t"
Jul 17 18:39:48.038684 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:48.038646    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b94cc690-99d6-464b-941a-c8f1ebb8cf21-maas-api-service-ca\") pod \"b94cc690-99d6-464b-941a-c8f1ebb8cf21\" (UID: \"b94cc690-99d6-464b-941a-c8f1ebb8cf21\") "
Jul 17 18:39:48.039041 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:48.038987    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b94cc690-99d6-464b-941a-c8f1ebb8cf21-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b94cc690-99d6-464b-941a-c8f1ebb8cf21" (UID: "b94cc690-99d6-464b-941a-c8f1ebb8cf21"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:39:48.140163 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:48.140071    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b94cc690-99d6-464b-941a-c8f1ebb8cf21-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:39:48.811932 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:48.811894    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-186d6157-7mv2t"
Jul 17 18:39:48.811932 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:48.811923    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-186d6157-7mv2t" event={"ID":"b94cc690-99d6-464b-941a-c8f1ebb8cf21","Type":"ContainerDied","Data":"18966d1042735471e0508cd711dcf06e327abdd2b1c76b221095283a0b5eca51"}
Jul 17 18:39:48.812181 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:48.811967    2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="18966d1042735471e0508cd711dcf06e327abdd2b1c76b221095283a0b5eca51"
Jul 17 18:39:55.850597 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:55.850559    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-186d6157-6856976567-52sb4"]
Jul 17 18:39:55.851241 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:55.850803    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-186d6157-6856976567-52sb4" podUID="f698cc50-a3ec-4f91-95c7-d712255d394e" containerName="maas-api" containerID="cri-o://88058e26677da4b71f689b7d337414fa0dcc478b92a34e9a25bfb75385f2247d" gracePeriod=30
Jul 17 18:39:55.882730 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:55.882694    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:39:56.094719 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:56.094691    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-186d6157-6856976567-52sb4"
Jul 17 18:39:56.219986 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:56.219952    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cxjr\" (UniqueName: \"kubernetes.io/projected/f698cc50-a3ec-4f91-95c7-d712255d394e-kube-api-access-2cxjr\") pod \"f698cc50-a3ec-4f91-95c7-d712255d394e\" (UID: \"f698cc50-a3ec-4f91-95c7-d712255d394e\") "
Jul 17 18:39:56.220212 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:56.220053    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f698cc50-a3ec-4f91-95c7-d712255d394e-maas-api-tls\") pod \"f698cc50-a3ec-4f91-95c7-d712255d394e\" (UID: \"f698cc50-a3ec-4f91-95c7-d712255d394e\") "
Jul 17 18:39:56.220212 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:56.220074    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f698cc50-a3ec-4f91-95c7-d712255d394e-openshift-service-ca\") pod \"f698cc50-a3ec-4f91-95c7-d712255d394e\" (UID: \"f698cc50-a3ec-4f91-95c7-d712255d394e\") "
Jul 17 18:39:56.220480 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:56.220454    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f698cc50-a3ec-4f91-95c7-d712255d394e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f698cc50-a3ec-4f91-95c7-d712255d394e" (UID: "f698cc50-a3ec-4f91-95c7-d712255d394e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:39:56.222067 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:56.222035    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f698cc50-a3ec-4f91-95c7-d712255d394e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f698cc50-a3ec-4f91-95c7-d712255d394e" (UID: "f698cc50-a3ec-4f91-95c7-d712255d394e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 18:39:56.222182 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:56.222130    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f698cc50-a3ec-4f91-95c7-d712255d394e-kube-api-access-2cxjr" (OuterVolumeSpecName: "kube-api-access-2cxjr") pod "f698cc50-a3ec-4f91-95c7-d712255d394e" (UID: "f698cc50-a3ec-4f91-95c7-d712255d394e"). InnerVolumeSpecName "kube-api-access-2cxjr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:39:56.321418 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:56.321385    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cxjr\" (UniqueName: \"kubernetes.io/projected/f698cc50-a3ec-4f91-95c7-d712255d394e-kube-api-access-2cxjr\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:39:56.321418 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:56.321414    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f698cc50-a3ec-4f91-95c7-d712255d394e-maas-api-tls\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:39:56.321418 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:56.321423    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f698cc50-a3ec-4f91-95c7-d712255d394e-openshift-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:39:56.855935 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:56.855900    2572 generic.go:356] "Generic (PLEG): container finished" podID="f698cc50-a3ec-4f91-95c7-d712255d394e" containerID="88058e26677da4b71f689b7d337414fa0dcc478b92a34e9a25bfb75385f2247d" exitCode=0
Jul 17 18:39:56.856382 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:56.855947    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-186d6157-6856976567-52sb4"
Jul 17 18:39:56.856382 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:56.855968    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-186d6157-6856976567-52sb4" event={"ID":"f698cc50-a3ec-4f91-95c7-d712255d394e","Type":"ContainerDied","Data":"88058e26677da4b71f689b7d337414fa0dcc478b92a34e9a25bfb75385f2247d"}
Jul 17 18:39:56.856382 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:56.856034    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-186d6157-6856976567-52sb4" event={"ID":"f698cc50-a3ec-4f91-95c7-d712255d394e","Type":"ContainerDied","Data":"ab835469e68874cc7514ca3583d1e12521280145ae98e65a547394439e7fefba"}
Jul 17 18:39:56.856382 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:56.856056    2572 scope.go:117] "RemoveContainer" containerID="88058e26677da4b71f689b7d337414fa0dcc478b92a34e9a25bfb75385f2247d"
Jul 17 18:39:56.867688 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:56.867666    2572 scope.go:117] "RemoveContainer" containerID="88058e26677da4b71f689b7d337414fa0dcc478b92a34e9a25bfb75385f2247d"
Jul 17 18:39:56.868256 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:39:56.868225    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88058e26677da4b71f689b7d337414fa0dcc478b92a34e9a25bfb75385f2247d\": container with ID starting with 88058e26677da4b71f689b7d337414fa0dcc478b92a34e9a25bfb75385f2247d not found: ID does not exist" containerID="88058e26677da4b71f689b7d337414fa0dcc478b92a34e9a25bfb75385f2247d"
Jul 17 18:39:56.868384 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:56.868262    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88058e26677da4b71f689b7d337414fa0dcc478b92a34e9a25bfb75385f2247d"} err="failed to get container status \"88058e26677da4b71f689b7d337414fa0dcc478b92a34e9a25bfb75385f2247d\": rpc error: code = NotFound desc = could not find container \"88058e26677da4b71f689b7d337414fa0dcc478b92a34e9a25bfb75385f2247d\": container with ID starting with 88058e26677da4b71f689b7d337414fa0dcc478b92a34e9a25bfb75385f2247d not found: ID does not exist"
Jul 17 18:39:56.878216 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:56.878191    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-186d6157-6856976567-52sb4"]
Jul 17 18:39:56.882428 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:56.882404    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-186d6157-6856976567-52sb4"]
Jul 17 18:39:57.471610 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:39:57.471573    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f698cc50-a3ec-4f91-95c7-d712255d394e" path="/var/lib/kubelet/pods/f698cc50-a3ec-4f91-95c7-d712255d394e/volumes"
Jul 17 18:40:00.472696 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:00.472663    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:40:05.548504 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:05.548469    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:40:18.282138 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:18.282097    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:40:18.377136 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:18.377101    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:40:27.332897 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:27.332853    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-7s2js"]
Jul 17 18:40:27.333318 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:27.333257    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b94cc690-99d6-464b-941a-c8f1ebb8cf21" containerName="revoke-keys"
Jul 17 18:40:27.333318 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:27.333269    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b94cc690-99d6-464b-941a-c8f1ebb8cf21" containerName="revoke-keys"
Jul 17 18:40:27.333318 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:27.333284    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1f44348-7b5c-4076-bcba-a36280ad45a3" containerName="revoke-keys"
Jul 17 18:40:27.333318 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:27.333290    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1f44348-7b5c-4076-bcba-a36280ad45a3" containerName="revoke-keys"
Jul 17 18:40:27.333318 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:27.333300    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f698cc50-a3ec-4f91-95c7-d712255d394e" containerName="maas-api"
Jul 17 18:40:27.333318 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:27.333306    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f698cc50-a3ec-4f91-95c7-d712255d394e" containerName="maas-api"
Jul 17 18:40:27.333512 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:27.333355    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1f44348-7b5c-4076-bcba-a36280ad45a3" containerName="revoke-keys"
Jul 17 18:40:27.333512 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:27.333363    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f698cc50-a3ec-4f91-95c7-d712255d394e" containerName="maas-api"
Jul 17 18:40:27.333512 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:27.333371    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b94cc690-99d6-464b-941a-c8f1ebb8cf21" containerName="revoke-keys"
Jul 17 18:40:27.336470 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:27.336452    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-7s2js"
Jul 17 18:40:27.339163 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:27.339136    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:40:27.344747 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:27.344722    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-7s2js"]
Jul 17 18:40:27.406776 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:27.406736    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35045196-aad0-4644-8444-a7ed356687d5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-7s2js\" (UID: \"35045196-aad0-4644-8444-a7ed356687d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-7s2js"
Jul 17 18:40:27.507309 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:27.507276    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35045196-aad0-4644-8444-a7ed356687d5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-7s2js\" (UID: \"35045196-aad0-4644-8444-a7ed356687d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-7s2js"
Jul 17 18:40:27.507882 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:27.507864    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35045196-aad0-4644-8444-a7ed356687d5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-7s2js\" (UID: \"35045196-aad0-4644-8444-a7ed356687d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-7s2js"
Jul 17 18:40:27.648222 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:27.648137    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-7s2js"
Jul 17 18:40:27.992064 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:27.992030    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-7s2js"]
Jul 17 18:40:27.994966 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:40:27.994938    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35045196_aad0_4644_8444_a7ed356687d5.slice/crio-9b147005592b30221d059ea82e817bf8c1ea68350d2b9b750c00096ab60be784 WatchSource:0}: Error finding container 9b147005592b30221d059ea82e817bf8c1ea68350d2b9b750c00096ab60be784: Status 404 returned error can't find the container with id 9b147005592b30221d059ea82e817bf8c1ea68350d2b9b750c00096ab60be784
Jul 17 18:40:28.007456 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:28.007423    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-7s2js" event={"ID":"35045196-aad0-4644-8444-a7ed356687d5","Type":"ContainerStarted","Data":"9b147005592b30221d059ea82e817bf8c1ea68350d2b9b750c00096ab60be784"}
Jul 17 18:40:28.074585 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:28.074531    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:40:29.013291 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:29.013253    2572 generic.go:356] "Generic (PLEG): container finished" podID="35045196-aad0-4644-8444-a7ed356687d5" containerID="a73941171c1bc5ce878f43eb3caed2c896de8b0fe623f8e9269fcfd96c7eb9ca" exitCode=6
Jul 17 18:40:29.013753 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:29.013307    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-7s2js" event={"ID":"35045196-aad0-4644-8444-a7ed356687d5","Type":"ContainerDied","Data":"a73941171c1bc5ce878f43eb3caed2c896de8b0fe623f8e9269fcfd96c7eb9ca"}
Jul 17 18:40:29.013753 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:29.013572    2572 scope.go:117] "RemoveContainer" containerID="a73941171c1bc5ce878f43eb3caed2c896de8b0fe623f8e9269fcfd96c7eb9ca"
Jul 17 18:40:30.020175 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:30.020139    2572 generic.go:356] "Generic (PLEG): container finished" podID="35045196-aad0-4644-8444-a7ed356687d5" containerID="63010a724d160993bcd35fe0787dcdf3d99ee2df200096469906f6c51fa9d27c" exitCode=6
Jul 17 18:40:30.020636 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:30.020197    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-7s2js" event={"ID":"35045196-aad0-4644-8444-a7ed356687d5","Type":"ContainerDied","Data":"63010a724d160993bcd35fe0787dcdf3d99ee2df200096469906f6c51fa9d27c"}
Jul 17 18:40:30.020636 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:30.020245    2572 scope.go:117] "RemoveContainer" containerID="a73941171c1bc5ce878f43eb3caed2c896de8b0fe623f8e9269fcfd96c7eb9ca"
Jul 17 18:40:30.020636 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:30.020436    2572 scope.go:117] "RemoveContainer" containerID="63010a724d160993bcd35fe0787dcdf3d99ee2df200096469906f6c51fa9d27c"
Jul 17 18:40:30.021040 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:40:30.020694    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-7s2js_odh-ai-gateway-infra(35045196-aad0-4644-8444-a7ed356687d5)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-7s2js" podUID="35045196-aad0-4644-8444-a7ed356687d5"
Jul 17 18:40:31.026762 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:31.026723    2572 scope.go:117] "RemoveContainer" containerID="63010a724d160993bcd35fe0787dcdf3d99ee2df200096469906f6c51fa9d27c"
Jul 17 18:40:31.027203 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:40:31.026931    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-7s2js_odh-ai-gateway-infra(35045196-aad0-4644-8444-a7ed356687d5)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-7s2js" podUID="35045196-aad0-4644-8444-a7ed356687d5"
Jul 17 18:40:41.928821 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:41.928786    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:40:42.465676 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:42.465642    2572 scope.go:117] "RemoveContainer" containerID="63010a724d160993bcd35fe0787dcdf3d99ee2df200096469906f6c51fa9d27c"
Jul 17 18:40:43.088232 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:43.088148    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-7s2js" event={"ID":"35045196-aad0-4644-8444-a7ed356687d5","Type":"ContainerStarted","Data":"0b01cf87b2082bcd3aca63644c83092d8eb0d279cae97a451676d326b720b63e"}
Jul 17 18:40:43.104967 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:43.104918    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-7s2js" podStartSLOduration=16.104901819 podStartE2EDuration="16.104901819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:40:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:40:43.102994289 +0000 UTC m=+2670.328223598" watchObservedRunningTime="2026-07-17 18:40:43.104901819 +0000 UTC m=+2670.330131105"
Jul 17 18:40:43.495130 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:43.495089    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:40:44.094373 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:44.094339    2572 generic.go:356] "Generic (PLEG): container finished" podID="35045196-aad0-4644-8444-a7ed356687d5" containerID="0b01cf87b2082bcd3aca63644c83092d8eb0d279cae97a451676d326b720b63e" exitCode=6
Jul 17 18:40:44.094832 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:44.094416    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-7s2js" event={"ID":"35045196-aad0-4644-8444-a7ed356687d5","Type":"ContainerDied","Data":"0b01cf87b2082bcd3aca63644c83092d8eb0d279cae97a451676d326b720b63e"}
Jul 17 18:40:44.094832 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:44.094482    2572 scope.go:117] "RemoveContainer" containerID="63010a724d160993bcd35fe0787dcdf3d99ee2df200096469906f6c51fa9d27c"
Jul 17 18:40:44.094832 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:44.094784    2572 scope.go:117] "RemoveContainer" containerID="0b01cf87b2082bcd3aca63644c83092d8eb0d279cae97a451676d326b720b63e"
Jul 17 18:40:44.095066 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:40:44.095042    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-7s2js_odh-ai-gateway-infra(35045196-aad0-4644-8444-a7ed356687d5)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-7s2js" podUID="35045196-aad0-4644-8444-a7ed356687d5"
Jul 17 18:40:44.115655 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:44.115624    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-7s2js"]
Jul 17 18:40:45.244627 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:45.244596    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-7s2js"
Jul 17 18:40:45.377078 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:45.376959    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35045196-aad0-4644-8444-a7ed356687d5-maas-api-service-ca\") pod \"35045196-aad0-4644-8444-a7ed356687d5\" (UID: \"35045196-aad0-4644-8444-a7ed356687d5\") "
Jul 17 18:40:45.377341 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:45.377318    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35045196-aad0-4644-8444-a7ed356687d5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "35045196-aad0-4644-8444-a7ed356687d5" (UID: "35045196-aad0-4644-8444-a7ed356687d5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:40:45.478262 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:45.478220    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/35045196-aad0-4644-8444-a7ed356687d5-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:40:46.107385 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:46.107357    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-7s2js"
Jul 17 18:40:46.107539 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:46.107351    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-7s2js" event={"ID":"35045196-aad0-4644-8444-a7ed356687d5","Type":"ContainerDied","Data":"9b147005592b30221d059ea82e817bf8c1ea68350d2b9b750c00096ab60be784"}
Jul 17 18:40:46.107539 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:46.107531    2572 scope.go:117] "RemoveContainer" containerID="0b01cf87b2082bcd3aca63644c83092d8eb0d279cae97a451676d326b720b63e"
Jul 17 18:40:46.124232 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:46.124202    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-7s2js"]
Jul 17 18:40:46.129890 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:46.129866    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-7s2js"]
Jul 17 18:40:47.471133 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:47.471100    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35045196-aad0-4644-8444-a7ed356687d5" path="/var/lib/kubelet/pods/35045196-aad0-4644-8444-a7ed356687d5/volumes"
Jul 17 18:40:48.184782 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:48.184742    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:40:48.248292 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:48.248249    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:40:52.694096 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:52.694053    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"]
Jul 17 18:40:52.694626 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:52.694319    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k" podUID="490fcbfb-e25b-42fa-a64e-a25b28896841" containerName="istio-proxy" containerID="cri-o://72a230429c7d372157bded01b0adf376d1d1e94e255468a9cd038c8fd0e6c95f" gracePeriod=30
Jul 17 18:40:52.709354 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:52.709310    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:40:52.978011 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:52.977892    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:40:53.601345 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:53.601307    2572 patch_prober.go:28] interesting pod/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 18:40:53.601517 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:53.601367    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k" podUID="490fcbfb-e25b-42fa-a64e-a25b28896841" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 18:40:54.082293 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:54.082257    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:40:54.182168 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:54.182137    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:40:54.967733 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:54.967683    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:40:55.030424 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:55.030393    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:40:55.107829 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:55.107789    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:40:56.614722 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:56.614676    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:40:57.951419 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:57.951395    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:40:58.110295 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.110202    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/490fcbfb-e25b-42fa-a64e-a25b28896841-istio-token\") pod \"490fcbfb-e25b-42fa-a64e-a25b28896841\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") "
Jul 17 18:40:58.110295 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.110241    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/490fcbfb-e25b-42fa-a64e-a25b28896841-istio-podinfo\") pod \"490fcbfb-e25b-42fa-a64e-a25b28896841\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") "
Jul 17 18:40:58.110295 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.110269    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kc4fd\" (UniqueName: \"kubernetes.io/projected/490fcbfb-e25b-42fa-a64e-a25b28896841-kube-api-access-kc4fd\") pod \"490fcbfb-e25b-42fa-a64e-a25b28896841\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") "
Jul 17 18:40:58.110295 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.110295    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/490fcbfb-e25b-42fa-a64e-a25b28896841-workload-certs\") pod \"490fcbfb-e25b-42fa-a64e-a25b28896841\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") "
Jul 17 18:40:58.110612 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.110485    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/490fcbfb-e25b-42fa-a64e-a25b28896841-workload-socket\") pod \"490fcbfb-e25b-42fa-a64e-a25b28896841\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") "
Jul 17 18:40:58.110612 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.110575    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/490fcbfb-e25b-42fa-a64e-a25b28896841-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "490fcbfb-e25b-42fa-a64e-a25b28896841" (UID: "490fcbfb-e25b-42fa-a64e-a25b28896841"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:40:58.110612 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.110593    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/490fcbfb-e25b-42fa-a64e-a25b28896841-istio-data\") pod \"490fcbfb-e25b-42fa-a64e-a25b28896841\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") "
Jul 17 18:40:58.110767 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.110661    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/490fcbfb-e25b-42fa-a64e-a25b28896841-istiod-ca-cert\") pod \"490fcbfb-e25b-42fa-a64e-a25b28896841\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") "
Jul 17 18:40:58.110767 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.110710    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/490fcbfb-e25b-42fa-a64e-a25b28896841-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "490fcbfb-e25b-42fa-a64e-a25b28896841" (UID: "490fcbfb-e25b-42fa-a64e-a25b28896841"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:40:58.110767 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.110730    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/490fcbfb-e25b-42fa-a64e-a25b28896841-istio-envoy\") pod \"490fcbfb-e25b-42fa-a64e-a25b28896841\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") "
Jul 17 18:40:58.110912 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.110774    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/490fcbfb-e25b-42fa-a64e-a25b28896841-credential-socket\") pod \"490fcbfb-e25b-42fa-a64e-a25b28896841\" (UID: \"490fcbfb-e25b-42fa-a64e-a25b28896841\") "
Jul 17 18:40:58.111072 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.111047    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/490fcbfb-e25b-42fa-a64e-a25b28896841-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "490fcbfb-e25b-42fa-a64e-a25b28896841" (UID: "490fcbfb-e25b-42fa-a64e-a25b28896841"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:40:58.111202 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.111092    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/490fcbfb-e25b-42fa-a64e-a25b28896841-workload-certs\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:40:58.111202 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.111184    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/490fcbfb-e25b-42fa-a64e-a25b28896841-workload-socket\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:40:58.111370 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.111307    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/490fcbfb-e25b-42fa-a64e-a25b28896841-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "490fcbfb-e25b-42fa-a64e-a25b28896841" (UID: "490fcbfb-e25b-42fa-a64e-a25b28896841"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:40:58.111570 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.111541    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/490fcbfb-e25b-42fa-a64e-a25b28896841-istio-data" (OuterVolumeSpecName: "istio-data") pod "490fcbfb-e25b-42fa-a64e-a25b28896841" (UID: "490fcbfb-e25b-42fa-a64e-a25b28896841"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:40:58.112658 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.112623    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/490fcbfb-e25b-42fa-a64e-a25b28896841-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "490fcbfb-e25b-42fa-a64e-a25b28896841" (UID: "490fcbfb-e25b-42fa-a64e-a25b28896841"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 18:40:58.112764 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.112660    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/490fcbfb-e25b-42fa-a64e-a25b28896841-kube-api-access-kc4fd" (OuterVolumeSpecName: "kube-api-access-kc4fd") pod "490fcbfb-e25b-42fa-a64e-a25b28896841" (UID: "490fcbfb-e25b-42fa-a64e-a25b28896841"). InnerVolumeSpecName "kube-api-access-kc4fd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:40:58.112764 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.112703    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/490fcbfb-e25b-42fa-a64e-a25b28896841-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "490fcbfb-e25b-42fa-a64e-a25b28896841" (UID: "490fcbfb-e25b-42fa-a64e-a25b28896841"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:40:58.112764 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.112708    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/490fcbfb-e25b-42fa-a64e-a25b28896841-istio-token" (OuterVolumeSpecName: "istio-token") pod "490fcbfb-e25b-42fa-a64e-a25b28896841" (UID: "490fcbfb-e25b-42fa-a64e-a25b28896841"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:40:58.170301 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.170268    2572 generic.go:356] "Generic (PLEG): container finished" podID="490fcbfb-e25b-42fa-a64e-a25b28896841" containerID="72a230429c7d372157bded01b0adf376d1d1e94e255468a9cd038c8fd0e6c95f" exitCode=0
Jul 17 18:40:58.170465 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.170318    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k" event={"ID":"490fcbfb-e25b-42fa-a64e-a25b28896841","Type":"ContainerDied","Data":"72a230429c7d372157bded01b0adf376d1d1e94e255468a9cd038c8fd0e6c95f"}
Jul 17 18:40:58.170465 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.170327    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"
Jul 17 18:40:58.170465 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.170384    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k" event={"ID":"490fcbfb-e25b-42fa-a64e-a25b28896841","Type":"ContainerDied","Data":"7464914b42a49af03cb8958df15730eb50cf773866c8082c1c29a98be317585b"}
Jul 17 18:40:58.170465 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.170406    2572 scope.go:117] "RemoveContainer" containerID="72a230429c7d372157bded01b0adf376d1d1e94e255468a9cd038c8fd0e6c95f"
Jul 17 18:40:58.179267 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.179251    2572 scope.go:117] "RemoveContainer" containerID="ab707f158bef4e0bbb6b222a4b3927f554a01219948cc3cbcf0e129a8dbc6dc0"
Jul 17 18:40:58.187287 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.187269    2572 scope.go:117] "RemoveContainer" containerID="72a230429c7d372157bded01b0adf376d1d1e94e255468a9cd038c8fd0e6c95f"
Jul 17 18:40:58.187523 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:40:58.187504    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72a230429c7d372157bded01b0adf376d1d1e94e255468a9cd038c8fd0e6c95f\": container with ID starting with 72a230429c7d372157bded01b0adf376d1d1e94e255468a9cd038c8fd0e6c95f not found: ID does not exist" containerID="72a230429c7d372157bded01b0adf376d1d1e94e255468a9cd038c8fd0e6c95f"
Jul 17 18:40:58.187598 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.187534    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72a230429c7d372157bded01b0adf376d1d1e94e255468a9cd038c8fd0e6c95f"} err="failed to get container status \"72a230429c7d372157bded01b0adf376d1d1e94e255468a9cd038c8fd0e6c95f\": rpc error: code = NotFound desc = could not find container \"72a230429c7d372157bded01b0adf376d1d1e94e255468a9cd038c8fd0e6c95f\": container with ID starting with 72a230429c7d372157bded01b0adf376d1d1e94e255468a9cd038c8fd0e6c95f not found: ID does not exist"
Jul 17 18:40:58.187598 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.187556    2572 scope.go:117] "RemoveContainer" containerID="ab707f158bef4e0bbb6b222a4b3927f554a01219948cc3cbcf0e129a8dbc6dc0"
Jul 17 18:40:58.187796 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:40:58.187778    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab707f158bef4e0bbb6b222a4b3927f554a01219948cc3cbcf0e129a8dbc6dc0\": container with ID starting with ab707f158bef4e0bbb6b222a4b3927f554a01219948cc3cbcf0e129a8dbc6dc0 not found: ID does not exist" containerID="ab707f158bef4e0bbb6b222a4b3927f554a01219948cc3cbcf0e129a8dbc6dc0"
Jul 17 18:40:58.187837 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.187815    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab707f158bef4e0bbb6b222a4b3927f554a01219948cc3cbcf0e129a8dbc6dc0"} err="failed to get container status \"ab707f158bef4e0bbb6b222a4b3927f554a01219948cc3cbcf0e129a8dbc6dc0\": rpc error: code = NotFound desc = could not find container \"ab707f158bef4e0bbb6b222a4b3927f554a01219948cc3cbcf0e129a8dbc6dc0\": container with ID starting with ab707f158bef4e0bbb6b222a4b3927f554a01219948cc3cbcf0e129a8dbc6dc0 not found: ID does not exist"
Jul 17 18:40:58.193522 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.193499    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"]
Jul 17 18:40:58.197764 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.197743    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-186d6157-openshift-default-6dbdd66f67-znf6k"]
Jul 17 18:40:58.211783 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.211756    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kc4fd\" (UniqueName: \"kubernetes.io/projected/490fcbfb-e25b-42fa-a64e-a25b28896841-kube-api-access-kc4fd\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:40:58.211783 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.211782    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/490fcbfb-e25b-42fa-a64e-a25b28896841-istio-data\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:40:58.211917 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.211793    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/490fcbfb-e25b-42fa-a64e-a25b28896841-istiod-ca-cert\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:40:58.211917 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.211802    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/490fcbfb-e25b-42fa-a64e-a25b28896841-istio-envoy\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:40:58.211917 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.211810    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/490fcbfb-e25b-42fa-a64e-a25b28896841-credential-socket\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:40:58.211917 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.211819    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/490fcbfb-e25b-42fa-a64e-a25b28896841-istio-token\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:40:58.211917 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:58.211828    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/490fcbfb-e25b-42fa-a64e-a25b28896841-istio-podinfo\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:40:59.471363 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:40:59.471327    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="490fcbfb-e25b-42fa-a64e-a25b28896841" path="/var/lib/kubelet/pods/490fcbfb-e25b-42fa-a64e-a25b28896841/volumes"
Jul 17 18:41:02.430224 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:02.430190    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:41:02.530545 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:02.530508    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:41:03.126193 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:03.126154    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:41:05.259188 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:05.259098    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-x2cpx"]
Jul 17 18:41:05.259594 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:05.259463    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="490fcbfb-e25b-42fa-a64e-a25b28896841" containerName="istio-proxy"
Jul 17 18:41:05.259594 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:05.259475    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="490fcbfb-e25b-42fa-a64e-a25b28896841" containerName="istio-proxy"
Jul 17 18:41:05.259594 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:05.259496    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35045196-aad0-4644-8444-a7ed356687d5" containerName="revoke-keys"
Jul 17 18:41:05.259594 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:05.259502    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="35045196-aad0-4644-8444-a7ed356687d5" containerName="revoke-keys"
Jul 17 18:41:05.259594 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:05.259508    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35045196-aad0-4644-8444-a7ed356687d5" containerName="revoke-keys"
Jul 17 18:41:05.259594 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:05.259514    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="35045196-aad0-4644-8444-a7ed356687d5" containerName="revoke-keys"
Jul 17 18:41:05.259594 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:05.259521    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35045196-aad0-4644-8444-a7ed356687d5" containerName="revoke-keys"
Jul 17 18:41:05.259594 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:05.259526    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="35045196-aad0-4644-8444-a7ed356687d5" containerName="revoke-keys"
Jul 17 18:41:05.259594 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:05.259585    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="490fcbfb-e25b-42fa-a64e-a25b28896841" containerName="istio-proxy"
Jul 17 18:41:05.259594 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:05.259593    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="490fcbfb-e25b-42fa-a64e-a25b28896841" containerName="istio-proxy"
Jul 17 18:41:05.259594 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:05.259599    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="35045196-aad0-4644-8444-a7ed356687d5" containerName="revoke-keys"
Jul 17 18:41:05.260059 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:05.259607    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="35045196-aad0-4644-8444-a7ed356687d5" containerName="revoke-keys"
Jul 17 18:41:05.260059 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:05.259614    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="35045196-aad0-4644-8444-a7ed356687d5" containerName="revoke-keys"
Jul 17 18:41:05.264029 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:05.263986    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-x2cpx"
Jul 17 18:41:05.266597 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:05.266570    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:41:05.269765 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:05.269738    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-x2cpx"]
Jul 17 18:41:05.274682 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:05.274656    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35dc36c4-x2cpx\" (UID: \"b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-x2cpx"
Jul 17 18:41:05.375959 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:05.375917    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35dc36c4-x2cpx\" (UID: \"b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-x2cpx"
Jul 17 18:41:05.376595 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:05.376574    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35dc36c4-x2cpx\" (UID: \"b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-x2cpx"
Jul 17 18:41:05.577037 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:05.576910    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-x2cpx"
Jul 17 18:41:05.710806 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:05.710781    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-x2cpx"]
Jul 17 18:41:05.712408 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:41:05.712380    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb71e4248_7d3c_4cfe_b3f3_5ee0a3cff0e5.slice/crio-9e009e4bcc1e35edc555f5258554026b41884b21ee1fb9efae60aedf599c46e2 WatchSource:0}: Error finding container 9e009e4bcc1e35edc555f5258554026b41884b21ee1fb9efae60aedf599c46e2: Status 404 returned error can't find the container with id 9e009e4bcc1e35edc555f5258554026b41884b21ee1fb9efae60aedf599c46e2
Jul 17 18:41:06.214447 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:06.214408    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-x2cpx" event={"ID":"b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5","Type":"ContainerStarted","Data":"03ae03733eec1244c5a3dd62a8d51d48535790f2fb077506f671fbc72b2be91d"}
Jul 17 18:41:06.214631 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:06.214469    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-x2cpx" event={"ID":"b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5","Type":"ContainerStarted","Data":"9e009e4bcc1e35edc555f5258554026b41884b21ee1fb9efae60aedf599c46e2"}
Jul 17 18:41:06.230942 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:06.230891    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-x2cpx" podStartSLOduration=1.2308723320000001 podStartE2EDuration="1.230872332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:41:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:41:06.22939911 +0000 UTC m=+2693.454628418" watchObservedRunningTime="2026-07-17 18:41:06.230872332 +0000 UTC m=+2693.456101640"
Jul 17 18:41:07.221586 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:07.221551    2572 generic.go:356] "Generic (PLEG): container finished" podID="b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5" containerID="03ae03733eec1244c5a3dd62a8d51d48535790f2fb077506f671fbc72b2be91d" exitCode=6
Jul 17 18:41:07.222031 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:07.221645    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-x2cpx" event={"ID":"b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5","Type":"ContainerDied","Data":"03ae03733eec1244c5a3dd62a8d51d48535790f2fb077506f671fbc72b2be91d"}
Jul 17 18:41:07.222031 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:07.221820    2572 scope.go:117] "RemoveContainer" containerID="03ae03733eec1244c5a3dd62a8d51d48535790f2fb077506f671fbc72b2be91d"
Jul 17 18:41:08.229009 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:08.228960    2572 generic.go:356] "Generic (PLEG): container finished" podID="b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5" containerID="d54cf02a0dbbe557ebd0643d9859d1f5143061b843d80d807cf8a9fda046d358" exitCode=6
Jul 17 18:41:08.229439 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:08.229041    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-x2cpx" event={"ID":"b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5","Type":"ContainerDied","Data":"d54cf02a0dbbe557ebd0643d9859d1f5143061b843d80d807cf8a9fda046d358"}
Jul 17 18:41:08.229439 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:08.229110    2572 scope.go:117] "RemoveContainer" containerID="03ae03733eec1244c5a3dd62a8d51d48535790f2fb077506f671fbc72b2be91d"
Jul 17 18:41:08.229439 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:08.229340    2572 scope.go:117] "RemoveContainer" containerID="d54cf02a0dbbe557ebd0643d9859d1f5143061b843d80d807cf8a9fda046d358"
Jul 17 18:41:08.229613 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:41:08.229590    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-35dc36c4-x2cpx_odh-ai-gateway-infra(b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-x2cpx" podUID="b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5"
Jul 17 18:41:08.957935 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:08.957897    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:41:09.017979 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:09.017937    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:41:09.098458 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:09.098421    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:41:09.194063 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:09.194029    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:41:09.239196 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:09.239110    2572 scope.go:117] "RemoveContainer" containerID="d54cf02a0dbbe557ebd0643d9859d1f5143061b843d80d807cf8a9fda046d358"
Jul 17 18:41:09.239654 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:41:09.239358    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-35dc36c4-x2cpx_odh-ai-gateway-infra(b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-x2cpx" podUID="b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5"
Jul 17 18:41:13.623888 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:13.623858    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tp9qm_6c101a17-a051-4e9d-a9dd-f72c67ba2a8a/console-operator/2.log"
Jul 17 18:41:13.630541 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:13.630514    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5mdx_2e3bd369-576e-4df1-8a76-aebd537cde58/ovn-acl-logging/0.log"
Jul 17 18:41:13.664845 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:13.664814    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tp9qm_6c101a17-a051-4e9d-a9dd-f72c67ba2a8a/console-operator/2.log"
Jul 17 18:41:13.671247 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:13.671223    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5mdx_2e3bd369-576e-4df1-8a76-aebd537cde58/ovn-acl-logging/0.log"
Jul 17 18:41:17.373070 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:17.373030    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-lstff"]
Jul 17 18:41:17.373500 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:17.373391    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="490fcbfb-e25b-42fa-a64e-a25b28896841" containerName="istio-proxy"
Jul 17 18:41:17.373500 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:17.373402    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="490fcbfb-e25b-42fa-a64e-a25b28896841" containerName="istio-proxy"
Jul 17 18:41:17.377723 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:17.377704    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-lstff"
Jul 17 18:41:17.383221 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:17.383196    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-lstff"]
Jul 17 18:41:17.470647 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:17.470604    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dca969a6-d0fb-44d0-aa66-59405b9487c3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-lstff\" (UID: \"dca969a6-d0fb-44d0-aa66-59405b9487c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-lstff"
Jul 17 18:41:17.571622 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:17.571582    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dca969a6-d0fb-44d0-aa66-59405b9487c3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-lstff\" (UID: \"dca969a6-d0fb-44d0-aa66-59405b9487c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-lstff"
Jul 17 18:41:17.572254 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:17.572234    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dca969a6-d0fb-44d0-aa66-59405b9487c3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-lstff\" (UID: \"dca969a6-d0fb-44d0-aa66-59405b9487c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-lstff"
Jul 17 18:41:17.689696 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:17.689668    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-lstff"
Jul 17 18:41:17.826216 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:17.826186    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-lstff"]
Jul 17 18:41:17.828364 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:41:17.828338    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddca969a6_d0fb_44d0_aa66_59405b9487c3.slice/crio-45c34a7828f0fffe9e0eb4badd79dd7445851c9d817ed167e57fb3a299b43e37 WatchSource:0}: Error finding container 45c34a7828f0fffe9e0eb4badd79dd7445851c9d817ed167e57fb3a299b43e37: Status 404 returned error can't find the container with id 45c34a7828f0fffe9e0eb4badd79dd7445851c9d817ed167e57fb3a299b43e37
Jul 17 18:41:18.287521 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:18.287485    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-lstff" event={"ID":"dca969a6-d0fb-44d0-aa66-59405b9487c3","Type":"ContainerStarted","Data":"058a73b70183e5f85a9e748c662ab11c287cb4f969f3039fab7fde62fa01e15c"}
Jul 17 18:41:18.287748 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:18.287538    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-lstff" event={"ID":"dca969a6-d0fb-44d0-aa66-59405b9487c3","Type":"ContainerStarted","Data":"45c34a7828f0fffe9e0eb4badd79dd7445851c9d817ed167e57fb3a299b43e37"}
Jul 17 18:41:18.303599 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:18.303535    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-lstff" podStartSLOduration=1.303514227 podStartE2EDuration="1.303514227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:41:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:41:18.302962863 +0000 UTC m=+2705.528192175" watchObservedRunningTime="2026-07-17 18:41:18.303514227 +0000 UTC m=+2705.528743536"
Jul 17 18:41:19.294161 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:19.294128    2572 generic.go:356] "Generic (PLEG): container finished" podID="dca969a6-d0fb-44d0-aa66-59405b9487c3" containerID="058a73b70183e5f85a9e748c662ab11c287cb4f969f3039fab7fde62fa01e15c" exitCode=6
Jul 17 18:41:19.294548 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:19.294197    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-lstff" event={"ID":"dca969a6-d0fb-44d0-aa66-59405b9487c3","Type":"ContainerDied","Data":"058a73b70183e5f85a9e748c662ab11c287cb4f969f3039fab7fde62fa01e15c"}
Jul 17 18:41:19.294548 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:19.294403    2572 scope.go:117] "RemoveContainer" containerID="058a73b70183e5f85a9e748c662ab11c287cb4f969f3039fab7fde62fa01e15c"
Jul 17 18:41:19.700081 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:19.700021    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:41:20.128474 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:20.128362    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:41:20.300979 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:20.300945    2572 generic.go:356] "Generic (PLEG): container finished" podID="dca969a6-d0fb-44d0-aa66-59405b9487c3" containerID="a70b73bb290dd616ad3c8013077f19059839ac554029d370f7c69c5e3f0d0486" exitCode=6
Jul 17 18:41:20.301443 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:20.301021    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-lstff" event={"ID":"dca969a6-d0fb-44d0-aa66-59405b9487c3","Type":"ContainerDied","Data":"a70b73bb290dd616ad3c8013077f19059839ac554029d370f7c69c5e3f0d0486"}
Jul 17 18:41:20.301443 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:20.301072    2572 scope.go:117] "RemoveContainer" containerID="058a73b70183e5f85a9e748c662ab11c287cb4f969f3039fab7fde62fa01e15c"
Jul 17 18:41:20.301443 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:20.301225    2572 scope.go:117] "RemoveContainer" containerID="a70b73bb290dd616ad3c8013077f19059839ac554029d370f7c69c5e3f0d0486"
Jul 17 18:41:20.301570 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:41:20.301480    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-lstff_odh-ai-gateway-infra(dca969a6-d0fb-44d0-aa66-59405b9487c3)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-lstff" podUID="dca969a6-d0fb-44d0-aa66-59405b9487c3"
Jul 17 18:41:21.307660 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:21.307627    2572 scope.go:117] "RemoveContainer" containerID="a70b73bb290dd616ad3c8013077f19059839ac554029d370f7c69c5e3f0d0486"
Jul 17 18:41:21.308099 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:41:21.307814    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-lstff_odh-ai-gateway-infra(dca969a6-d0fb-44d0-aa66-59405b9487c3)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-lstff" podUID="dca969a6-d0fb-44d0-aa66-59405b9487c3"
Jul 17 18:41:23.468365 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:23.468328    2572 scope.go:117] "RemoveContainer" containerID="d54cf02a0dbbe557ebd0643d9859d1f5143061b843d80d807cf8a9fda046d358"
Jul 17 18:41:24.323881 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:24.323792    2572 generic.go:356] "Generic (PLEG): container finished" podID="b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5" containerID="423b20438122d836670bfbca377fff77827ead657272b7a9f20a0605740c10fe" exitCode=6
Jul 17 18:41:24.323881 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:24.323863    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-x2cpx" event={"ID":"b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5","Type":"ContainerDied","Data":"423b20438122d836670bfbca377fff77827ead657272b7a9f20a0605740c10fe"}
Jul 17 18:41:24.324189 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:24.323922    2572 scope.go:117] "RemoveContainer" containerID="d54cf02a0dbbe557ebd0643d9859d1f5143061b843d80d807cf8a9fda046d358"
Jul 17 18:41:24.324241 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:24.324195    2572 scope.go:117] "RemoveContainer" containerID="423b20438122d836670bfbca377fff77827ead657272b7a9f20a0605740c10fe"
Jul 17 18:41:24.324446 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:41:24.324425    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-35dc36c4-x2cpx_odh-ai-gateway-infra(b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-x2cpx" podUID="b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5"
Jul 17 18:41:25.348934 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:25.348882    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-x2cpx"]
Jul 17 18:41:25.489340 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:25.489313    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-x2cpx"
Jul 17 18:41:25.544644 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:25.544612    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5-maas-api-service-ca\") pod \"b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5\" (UID: \"b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5\") "
Jul 17 18:41:25.544987 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:25.544954    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5" (UID: "b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:41:25.645532 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:25.645442    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:41:26.336262 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:26.336226    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-x2cpx"
Jul 17 18:41:26.336442 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:26.336225    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-x2cpx" event={"ID":"b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5","Type":"ContainerDied","Data":"9e009e4bcc1e35edc555f5258554026b41884b21ee1fb9efae60aedf599c46e2"}
Jul 17 18:41:26.336442 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:26.336388    2572 scope.go:117] "RemoveContainer" containerID="423b20438122d836670bfbca377fff77827ead657272b7a9f20a0605740c10fe"
Jul 17 18:41:26.360086 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:26.360054    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-x2cpx"]
Jul 17 18:41:26.368054 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:26.368028    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-x2cpx"]
Jul 17 18:41:27.471355 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:27.471321    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5" path="/var/lib/kubelet/pods/b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5/volumes"
Jul 17 18:41:34.466434 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:34.466403    2572 scope.go:117] "RemoveContainer" containerID="a70b73bb290dd616ad3c8013077f19059839ac554029d370f7c69c5e3f0d0486"
Jul 17 18:41:35.383550 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:35.383512    2572 generic.go:356] "Generic (PLEG): container finished" podID="dca969a6-d0fb-44d0-aa66-59405b9487c3" containerID="97c0d212492e151da75bf3a64effe68b1435051eb173afe220245d2c1e984c91" exitCode=6
Jul 17 18:41:35.383731 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:35.383563    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-lstff" event={"ID":"dca969a6-d0fb-44d0-aa66-59405b9487c3","Type":"ContainerDied","Data":"97c0d212492e151da75bf3a64effe68b1435051eb173afe220245d2c1e984c91"}
Jul 17 18:41:35.383731 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:35.383614    2572 scope.go:117] "RemoveContainer" containerID="a70b73bb290dd616ad3c8013077f19059839ac554029d370f7c69c5e3f0d0486"
Jul 17 18:41:35.383940 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:35.383916    2572 scope.go:117] "RemoveContainer" containerID="97c0d212492e151da75bf3a64effe68b1435051eb173afe220245d2c1e984c91"
Jul 17 18:41:35.384215 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:41:35.384186    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-lstff_odh-ai-gateway-infra(dca969a6-d0fb-44d0-aa66-59405b9487c3)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-lstff" podUID="dca969a6-d0fb-44d0-aa66-59405b9487c3"
Jul 17 18:41:36.408375 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:36.408334    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-lstff"]
Jul 17 18:41:36.547415 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:36.547388    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-lstff"
Jul 17 18:41:36.647162 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:36.647130    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dca969a6-d0fb-44d0-aa66-59405b9487c3-maas-api-service-ca\") pod \"dca969a6-d0fb-44d0-aa66-59405b9487c3\" (UID: \"dca969a6-d0fb-44d0-aa66-59405b9487c3\") "
Jul 17 18:41:36.647500 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:36.647477    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dca969a6-d0fb-44d0-aa66-59405b9487c3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dca969a6-d0fb-44d0-aa66-59405b9487c3" (UID: "dca969a6-d0fb-44d0-aa66-59405b9487c3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:41:36.747985 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:36.747940    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dca969a6-d0fb-44d0-aa66-59405b9487c3-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:41:37.396231 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:37.396206    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-lstff"
Jul 17 18:41:37.396231 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:37.396222    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-lstff" event={"ID":"dca969a6-d0fb-44d0-aa66-59405b9487c3","Type":"ContainerDied","Data":"45c34a7828f0fffe9e0eb4badd79dd7445851c9d817ed167e57fb3a299b43e37"}
Jul 17 18:41:37.396491 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:37.396278    2572 scope.go:117] "RemoveContainer" containerID="97c0d212492e151da75bf3a64effe68b1435051eb173afe220245d2c1e984c91"
Jul 17 18:41:37.420197 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:37.420166    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-lstff"]
Jul 17 18:41:37.425167 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:37.425141    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-lstff"]
Jul 17 18:41:37.472094 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:37.472056    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dca969a6-d0fb-44d0-aa66-59405b9487c3" path="/var/lib/kubelet/pods/dca969a6-d0fb-44d0-aa66-59405b9487c3/volumes"
Jul 17 18:41:40.882146 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:40.882104    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-t75xf"]
Jul 17 18:41:40.882672 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:40.882645    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5" containerName="revoke-keys"
Jul 17 18:41:40.882729 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:40.882677    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5" containerName="revoke-keys"
Jul 17 18:41:40.882729 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:40.882694    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dca969a6-d0fb-44d0-aa66-59405b9487c3" containerName="revoke-keys"
Jul 17 18:41:40.882729 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:40.882702    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="dca969a6-d0fb-44d0-aa66-59405b9487c3" containerName="revoke-keys"
Jul 17 18:41:40.882729 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:40.882710    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dca969a6-d0fb-44d0-aa66-59405b9487c3" containerName="revoke-keys"
Jul 17 18:41:40.882729 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:40.882718    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="dca969a6-d0fb-44d0-aa66-59405b9487c3" containerName="revoke-keys"
Jul 17 18:41:40.882907 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:40.882732    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5" containerName="revoke-keys"
Jul 17 18:41:40.882907 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:40.882738    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5" containerName="revoke-keys"
Jul 17 18:41:40.882907 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:40.882744    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dca969a6-d0fb-44d0-aa66-59405b9487c3" containerName="revoke-keys"
Jul 17 18:41:40.882907 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:40.882749    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="dca969a6-d0fb-44d0-aa66-59405b9487c3" containerName="revoke-keys"
Jul 17 18:41:40.882907 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:40.882817    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5" containerName="revoke-keys"
Jul 17 18:41:40.882907 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:40.882823    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="dca969a6-d0fb-44d0-aa66-59405b9487c3" containerName="revoke-keys"
Jul 17 18:41:40.882907 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:40.882830    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="dca969a6-d0fb-44d0-aa66-59405b9487c3" containerName="revoke-keys"
Jul 17 18:41:40.882907 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:40.882835    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="dca969a6-d0fb-44d0-aa66-59405b9487c3" containerName="revoke-keys"
Jul 17 18:41:40.882907 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:40.882843    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5" containerName="revoke-keys"
Jul 17 18:41:40.887140 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:40.887123    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-t75xf"
Jul 17 18:41:40.889680 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:40.889644    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:41:40.892575 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:40.892547    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-t75xf"]
Jul 17 18:41:40.987970 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:40.987923    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a517848b-2d45-4c8b-8143-a5efb985afd6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-df78e9c5-t75xf\" (UID: \"a517848b-2d45-4c8b-8143-a5efb985afd6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-t75xf"
Jul 17 18:41:41.079842 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:41.079801    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:41:41.089026 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:41.088985    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a517848b-2d45-4c8b-8143-a5efb985afd6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-df78e9c5-t75xf\" (UID: \"a517848b-2d45-4c8b-8143-a5efb985afd6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-t75xf"
Jul 17 18:41:41.089567 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:41.089549    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a517848b-2d45-4c8b-8143-a5efb985afd6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-df78e9c5-t75xf\" (UID: \"a517848b-2d45-4c8b-8143-a5efb985afd6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-t75xf"
Jul 17 18:41:41.198953 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:41.198922    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-t75xf"
Jul 17 18:41:41.349636 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:41.349611    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-t75xf"]
Jul 17 18:41:41.351657 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:41:41.351625    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda517848b_2d45_4c8b_8143_a5efb985afd6.slice/crio-6053080d9a859d6247e243dd3ce1c44e14f8cffa59fe252b2e4663e57bd66f85 WatchSource:0}: Error finding container 6053080d9a859d6247e243dd3ce1c44e14f8cffa59fe252b2e4663e57bd66f85: Status 404 returned error can't find the container with id 6053080d9a859d6247e243dd3ce1c44e14f8cffa59fe252b2e4663e57bd66f85
Jul 17 18:41:41.418147 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:41.418110    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-t75xf" event={"ID":"a517848b-2d45-4c8b-8143-a5efb985afd6","Type":"ContainerStarted","Data":"6053080d9a859d6247e243dd3ce1c44e14f8cffa59fe252b2e4663e57bd66f85"}
Jul 17 18:41:42.424308 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:42.424215    2572 generic.go:356] "Generic (PLEG): container finished" podID="a517848b-2d45-4c8b-8143-a5efb985afd6" containerID="6df3106ed8b05f763ce3f0816bb672fadabe0ca508f34eb00454f5a42f673b8a" exitCode=6
Jul 17 18:41:42.424698 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:42.424307    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-t75xf" event={"ID":"a517848b-2d45-4c8b-8143-a5efb985afd6","Type":"ContainerDied","Data":"6df3106ed8b05f763ce3f0816bb672fadabe0ca508f34eb00454f5a42f673b8a"}
Jul 17 18:41:42.424698 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:42.424496    2572 scope.go:117] "RemoveContainer" containerID="6df3106ed8b05f763ce3f0816bb672fadabe0ca508f34eb00454f5a42f673b8a"
Jul 17 18:41:43.437282 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:43.437186    2572 generic.go:356] "Generic (PLEG): container finished" podID="a517848b-2d45-4c8b-8143-a5efb985afd6" containerID="f4af366ec3c926906c0c9d1c992d54e4313dc42d0e44f8be3293dc7ba1313d4f" exitCode=6
Jul 17 18:41:43.437842 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:43.437578    2572 scope.go:117] "RemoveContainer" containerID="f4af366ec3c926906c0c9d1c992d54e4313dc42d0e44f8be3293dc7ba1313d4f"
Jul 17 18:41:43.438030 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:43.437723    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-t75xf" event={"ID":"a517848b-2d45-4c8b-8143-a5efb985afd6","Type":"ContainerDied","Data":"f4af366ec3c926906c0c9d1c992d54e4313dc42d0e44f8be3293dc7ba1313d4f"}
Jul 17 18:41:43.438143 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:43.438123    2572 scope.go:117] "RemoveContainer" containerID="6df3106ed8b05f763ce3f0816bb672fadabe0ca508f34eb00454f5a42f673b8a"
Jul 17 18:41:43.438428 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:41:43.438400    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-df78e9c5-t75xf_odh-ai-gateway-infra(a517848b-2d45-4c8b-8143-a5efb985afd6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-t75xf" podUID="a517848b-2d45-4c8b-8143-a5efb985afd6"
Jul 17 18:41:44.445962 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:44.445937    2572 scope.go:117] "RemoveContainer" containerID="f4af366ec3c926906c0c9d1c992d54e4313dc42d0e44f8be3293dc7ba1313d4f"
Jul 17 18:41:44.446365 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:41:44.446186    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-df78e9c5-t75xf_odh-ai-gateway-infra(a517848b-2d45-4c8b-8143-a5efb985afd6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-t75xf" podUID="a517848b-2d45-4c8b-8143-a5efb985afd6"
Jul 17 18:41:46.819127 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:46.819091    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:41:46.919746 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:46.919712    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:41:47.185709 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.185618    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:41:47.488785 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.488752    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"]
Jul 17 18:41:47.489243 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.489227    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5" containerName="revoke-keys"
Jul 17 18:41:47.489243 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.489244    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5" containerName="revoke-keys"
Jul 17 18:41:47.489382 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.489328    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b71e4248-7d3c-4cfe-b3f3-5ee0a3cff0e5" containerName="revoke-keys"
Jul 17 18:41:47.494286 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.494263    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:41:47.496867 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.496845    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-ddeacf-openshift-default-dockercfg-6qhs5\""
Jul 17 18:41:47.504479 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.504451    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"]
Jul 17 18:41:47.513895 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.513861    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:41:47.644473 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.644429    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-credential-socket\") pod \"e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") " pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:41:47.644696 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.644507    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-istio-podinfo\") pod \"e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") " pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:41:47.644696 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.644562    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-istio-data\") pod \"e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") " pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:41:47.644696 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.644585    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-istiod-ca-cert\") pod \"e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") " pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:41:47.644877 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.644692    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-workload-socket\") pod \"e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") " pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:41:47.644877 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.644751    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-istio-envoy\") pod \"e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") " pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:41:47.644877 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.644798    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-istio-token\") pod \"e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") " pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:41:47.644877 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.644816    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmz8f\" (UniqueName: \"kubernetes.io/projected/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-kube-api-access-lmz8f\") pod \"e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") " pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:41:47.644877 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.644855    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-workload-certs\") pod \"e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") " pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:41:47.688579 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.688545    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:41:47.746338 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.746252    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-workload-socket\") pod \"e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") " pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:41:47.746338 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.746305    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-istio-envoy\") pod \"e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") " pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:41:47.746519 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.746352    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-istio-token\") pod \"e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") " pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:41:47.746519 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.746389    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmz8f\" (UniqueName: \"kubernetes.io/projected/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-kube-api-access-lmz8f\") pod \"e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") " pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:41:47.746519 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.746453    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-workload-certs\") pod \"e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") " pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:41:47.746671 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.746520    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-credential-socket\") pod \"e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") " pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:41:47.746671 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.746548    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-istio-podinfo\") pod \"e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") " pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:41:47.746671 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.746582    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-istio-data\") pod \"e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") " pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:41:47.746671 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.746606    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-istiod-ca-cert\") pod \"e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") " pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:41:47.747075 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.747046    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-workload-socket\") pod \"e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") " pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:41:47.747206 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.747078    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-workload-certs\") pod \"e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") " pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:41:47.747206 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.747117    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-credential-socket\") pod \"e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") " pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:41:47.747206 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.747189    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-istio-data\") pod \"e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") " pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:41:47.747435 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.747417    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-istiod-ca-cert\") pod \"e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") " pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:41:47.749023 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.748988    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-istio-envoy\") pod \"e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") " pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:41:47.749206 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.749187    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-istio-podinfo\") pod \"e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") " pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:41:47.754217 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.754196    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-istio-token\") pod \"e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") " pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:41:47.754426 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.754406    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmz8f\" (UniqueName: \"kubernetes.io/projected/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-kube-api-access-lmz8f\") pod \"e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") " pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:41:47.806647 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.806619    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:41:47.949394 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.949362    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"]
Jul 17 18:41:47.951084 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:41:47.951059    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cb73fb4_f1c3_4656_87e2_4ae85a21249c.slice/crio-58e54bb1815722c8e2a06a08ef3ce9bbfaa9edf1e58a1c7efa47c4bc559267c4 WatchSource:0}: Error finding container 58e54bb1815722c8e2a06a08ef3ce9bbfaa9edf1e58a1c7efa47c4bc559267c4: Status 404 returned error can't find the container with id 58e54bb1815722c8e2a06a08ef3ce9bbfaa9edf1e58a1c7efa47c4bc559267c4
Jul 17 18:41:47.953437 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.953397    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:41:47.953517 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.953485    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:41:47.953568 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:47.953529    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:41:48.467878 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:48.467841    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn" event={"ID":"8cb73fb4-f1c3-4656-87e2-4ae85a21249c","Type":"ContainerStarted","Data":"8d1034d70024e9a340c6a5777200b2ff4497f17de982927eb0f8fa518c01f3db"}
Jul 17 18:41:48.468057 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:48.467897    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn" event={"ID":"8cb73fb4-f1c3-4656-87e2-4ae85a21249c","Type":"ContainerStarted","Data":"58e54bb1815722c8e2a06a08ef3ce9bbfaa9edf1e58a1c7efa47c4bc559267c4"}
Jul 17 18:41:48.491631 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:48.491576    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn" podStartSLOduration=1.4915604980000001 podStartE2EDuration="1.491560498s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:41:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:41:48.489261202 +0000 UTC m=+2735.714490511" watchObservedRunningTime="2026-07-17 18:41:48.491560498 +0000 UTC m=+2735.716789805"
Jul 17 18:41:48.807740 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:48.807643    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:41:49.812901 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:49.812866    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:41:50.453517 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:50.453469    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:41:50.481904 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:50.481869    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:41:50.482871 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:50.482841    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:41:50.555602 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:50.555555    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:41:50.624626 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:50.624587    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg"]
Jul 17 18:41:50.628967 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:50.628937    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg"
Jul 17 18:41:50.631519 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:50.631499    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-ddeacf-serving-cert\""
Jul 17 18:41:50.639435 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:50.639407    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg"]
Jul 17 18:41:50.666750 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:50.666718    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:41:50.776226 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:50.776129    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8240e4ff-a7f9-43a8-bf2d-f1bf66b22556-maas-api-tls\") pod \"maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg\" (UID: \"8240e4ff-a7f9-43a8-bf2d-f1bf66b22556\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg"
Jul 17 18:41:50.776226 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:50.776176    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8240e4ff-a7f9-43a8-bf2d-f1bf66b22556-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg\" (UID: \"8240e4ff-a7f9-43a8-bf2d-f1bf66b22556\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg"
Jul 17 18:41:50.776431 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:50.776246    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88kvf\" (UniqueName: \"kubernetes.io/projected/8240e4ff-a7f9-43a8-bf2d-f1bf66b22556-kube-api-access-88kvf\") pod \"maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg\" (UID: \"8240e4ff-a7f9-43a8-bf2d-f1bf66b22556\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg"
Jul 17 18:41:50.833576 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:50.833538    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:41:50.877628 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:50.877591    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8240e4ff-a7f9-43a8-bf2d-f1bf66b22556-maas-api-tls\") pod \"maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg\" (UID: \"8240e4ff-a7f9-43a8-bf2d-f1bf66b22556\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg"
Jul 17 18:41:50.877628 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:50.877626    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8240e4ff-a7f9-43a8-bf2d-f1bf66b22556-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg\" (UID: \"8240e4ff-a7f9-43a8-bf2d-f1bf66b22556\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg"
Jul 17 18:41:50.877859 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:50.877748    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88kvf\" (UniqueName: \"kubernetes.io/projected/8240e4ff-a7f9-43a8-bf2d-f1bf66b22556-kube-api-access-88kvf\") pod \"maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg\" (UID: \"8240e4ff-a7f9-43a8-bf2d-f1bf66b22556\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg"
Jul 17 18:41:50.878376 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:50.878358    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8240e4ff-a7f9-43a8-bf2d-f1bf66b22556-openshift-service-ca\") pod \"maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg\" (UID: \"8240e4ff-a7f9-43a8-bf2d-f1bf66b22556\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg"
Jul 17 18:41:50.880011 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:50.879975    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8240e4ff-a7f9-43a8-bf2d-f1bf66b22556-maas-api-tls\") pod \"maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg\" (UID: \"8240e4ff-a7f9-43a8-bf2d-f1bf66b22556\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg"
Jul 17 18:41:50.888678 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:50.888652    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88kvf\" (UniqueName: \"kubernetes.io/projected/8240e4ff-a7f9-43a8-bf2d-f1bf66b22556-kube-api-access-88kvf\") pod \"maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg\" (UID: \"8240e4ff-a7f9-43a8-bf2d-f1bf66b22556\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg"
Jul 17 18:41:50.943502 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:50.943462    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg"
Jul 17 18:41:51.089807 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:51.089731    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg"]
Jul 17 18:41:51.092764 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:41:51.092731    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8240e4ff_a7f9_43a8_bf2d_f1bf66b22556.slice/crio-f3b4b693b86e66b644666a8407f50e1f98d69df65e7e3605646954d84b4cfd21 WatchSource:0}: Error finding container f3b4b693b86e66b644666a8407f50e1f98d69df65e7e3605646954d84b4cfd21: Status 404 returned error can't find the container with id f3b4b693b86e66b644666a8407f50e1f98d69df65e7e3605646954d84b4cfd21
Jul 17 18:41:51.136496 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:51.136455    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:41:51.237849 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:51.237808    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:41:51.487716 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:51.487682    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg" event={"ID":"8240e4ff-a7f9-43a8-bf2d-f1bf66b22556","Type":"ContainerStarted","Data":"f3b4b693b86e66b644666a8407f50e1f98d69df65e7e3605646954d84b4cfd21"}
Jul 17 18:41:52.494949 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:52.494908    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg" event={"ID":"8240e4ff-a7f9-43a8-bf2d-f1bf66b22556","Type":"ContainerStarted","Data":"a312a5cc27f5db69b63b1f8283ca3c980f178a38219eedb0308d713cab20097a"}
Jul 17 18:41:52.495394 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:52.495186    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg"
Jul 17 18:41:52.511904 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:52.511855    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg" podStartSLOduration=2.109432574 podStartE2EDuration="2.511839612s" totalImagesPullingTime="402.407038ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:41:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:41:52.510682908 +0000 UTC m=+2739.735912216" watchObservedRunningTime="2026-07-17 18:41:52.511839612 +0000 UTC m=+2739.737068920"
Jul 17 18:41:54.987464 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:54.987423    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:41:55.346388 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:55.346288    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:41:55.632266 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:55.632179    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"]
Jul 17 18:41:55.635850 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:55.635828    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:41:55.638570 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:55.638548    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-3be95b-openshift-default-dockercfg-dlcq6\""
Jul 17 18:41:55.646586 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:55.646560    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"]
Jul 17 18:41:55.659530 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:55.659478    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:41:55.726291 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:55.726260    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f377470c-84e4-4287-a00b-494c8c39e0f4-istio-token\") pod \"e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") " pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:41:55.726489 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:55.726309    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f377470c-84e4-4287-a00b-494c8c39e0f4-credential-socket\") pod \"e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") " pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:41:55.726489 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:55.726341    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f377470c-84e4-4287-a00b-494c8c39e0f4-istio-podinfo\") pod \"e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") " pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:41:55.726489 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:55.726368    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f377470c-84e4-4287-a00b-494c8c39e0f4-istio-data\") pod \"e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") " pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:41:55.726489 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:55.726451    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f377470c-84e4-4287-a00b-494c8c39e0f4-workload-socket\") pod \"e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") " pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:41:55.726690 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:55.726508    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f377470c-84e4-4287-a00b-494c8c39e0f4-workload-certs\") pod \"e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") " pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:41:55.726690 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:55.726547    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f377470c-84e4-4287-a00b-494c8c39e0f4-istio-envoy\") pod \"e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") " pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:41:55.726690 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:55.726584    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgqm5\" (UniqueName: \"kubernetes.io/projected/f377470c-84e4-4287-a00b-494c8c39e0f4-kube-api-access-fgqm5\") pod \"e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") " pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:41:55.726690 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:55.726666    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f377470c-84e4-4287-a00b-494c8c39e0f4-istiod-ca-cert\") pod \"e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") " pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:41:55.827731 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:55.827686    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f377470c-84e4-4287-a00b-494c8c39e0f4-istio-token\") pod \"e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") " pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:41:55.827943 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:55.827739    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f377470c-84e4-4287-a00b-494c8c39e0f4-credential-socket\") pod \"e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") " pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:41:55.827943 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:55.827766    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f377470c-84e4-4287-a00b-494c8c39e0f4-istio-podinfo\") pod \"e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") " pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:41:55.827943 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:55.827791    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f377470c-84e4-4287-a00b-494c8c39e0f4-istio-data\") pod \"e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") " pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:41:55.827943 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:55.827823    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f377470c-84e4-4287-a00b-494c8c39e0f4-workload-socket\") pod \"e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") " pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:41:55.827943 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:55.827860    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f377470c-84e4-4287-a00b-494c8c39e0f4-workload-certs\") pod \"e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") " pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:41:55.827943 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:55.827890    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f377470c-84e4-4287-a00b-494c8c39e0f4-istio-envoy\") pod \"e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") " pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:41:55.827943 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:55.827923    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgqm5\" (UniqueName: \"kubernetes.io/projected/f377470c-84e4-4287-a00b-494c8c39e0f4-kube-api-access-fgqm5\") pod \"e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") " pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:41:55.828357 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:55.827975    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f377470c-84e4-4287-a00b-494c8c39e0f4-istiod-ca-cert\") pod \"e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") " pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:41:55.828357 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:55.828220    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f377470c-84e4-4287-a00b-494c8c39e0f4-credential-socket\") pod \"e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") " pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:41:55.828357 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:55.828253    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f377470c-84e4-4287-a00b-494c8c39e0f4-workload-socket\") pod \"e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") " pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:41:55.828357 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:55.828311    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f377470c-84e4-4287-a00b-494c8c39e0f4-workload-certs\") pod \"e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") " pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:41:55.828640 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:55.828618    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f377470c-84e4-4287-a00b-494c8c39e0f4-istio-data\") pod \"e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") " pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:41:55.829093 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:55.829070    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f377470c-84e4-4287-a00b-494c8c39e0f4-istiod-ca-cert\") pod \"e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") " pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:41:55.830299 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:55.830269    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f377470c-84e4-4287-a00b-494c8c39e0f4-istio-envoy\") pod \"e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") " pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:41:55.830440 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:55.830419    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f377470c-84e4-4287-a00b-494c8c39e0f4-istio-podinfo\") pod \"e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") " pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:41:55.839983 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:55.839957    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgqm5\" (UniqueName: \"kubernetes.io/projected/f377470c-84e4-4287-a00b-494c8c39e0f4-kube-api-access-fgqm5\") pod \"e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") " pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:41:55.840364 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:55.840346    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f377470c-84e4-4287-a00b-494c8c39e0f4-istio-token\") pod \"e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") " pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:41:55.948423 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:55.948391    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:41:56.107667 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:56.107633    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"]
Jul 17 18:41:56.108823 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:41:56.108789    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf377470c_84e4_4287_a00b_494c8c39e0f4.slice/crio-2903057f5adbd5e7dc292a902c5301355b9c2d534f936a98c28ff2313a555e9b WatchSource:0}: Error finding container 2903057f5adbd5e7dc292a902c5301355b9c2d534f936a98c28ff2313a555e9b: Status 404 returned error can't find the container with id 2903057f5adbd5e7dc292a902c5301355b9c2d534f936a98c28ff2313a555e9b
Jul 17 18:41:56.111095 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:56.111064    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:41:56.111169 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:56.111141    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:41:56.111219 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:56.111179    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:41:56.327217 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:56.327113    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:41:56.466461 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:56.466431    2572 scope.go:117] "RemoveContainer" containerID="f4af366ec3c926906c0c9d1c992d54e4313dc42d0e44f8be3293dc7ba1313d4f"
Jul 17 18:41:56.516819 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:56.516785    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2" event={"ID":"f377470c-84e4-4287-a00b-494c8c39e0f4","Type":"ContainerStarted","Data":"d0a047b5361a91bb149ddc9b2195b82a965c67dd982fc46eb04f3d9d69a84ddb"}
Jul 17 18:41:56.517022 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:56.516843    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2" event={"ID":"f377470c-84e4-4287-a00b-494c8c39e0f4","Type":"ContainerStarted","Data":"2903057f5adbd5e7dc292a902c5301355b9c2d534f936a98c28ff2313a555e9b"}
Jul 17 18:41:56.538892 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:56.538834    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2" podStartSLOduration=1.538819065 podStartE2EDuration="1.538819065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:41:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:41:56.537487096 +0000 UTC m=+2743.762716407" watchObservedRunningTime="2026-07-17 18:41:56.538819065 +0000 UTC m=+2743.764048373"
Jul 17 18:41:56.949089 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:56.949059    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:41:57.523596 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:57.523566    2572 generic.go:356] "Generic (PLEG): container finished" podID="a517848b-2d45-4c8b-8143-a5efb985afd6" containerID="c2e96f5f8f9cb3cc21510fafc8a04ef275a27e1e0e3c4f7414be72707d148bdc" exitCode=6
Jul 17 18:41:57.524038 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:57.523640    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-t75xf" event={"ID":"a517848b-2d45-4c8b-8143-a5efb985afd6","Type":"ContainerDied","Data":"c2e96f5f8f9cb3cc21510fafc8a04ef275a27e1e0e3c4f7414be72707d148bdc"}
Jul 17 18:41:57.524038 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:57.523703    2572 scope.go:117] "RemoveContainer" containerID="f4af366ec3c926906c0c9d1c992d54e4313dc42d0e44f8be3293dc7ba1313d4f"
Jul 17 18:41:57.524187 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:57.524090    2572 scope.go:117] "RemoveContainer" containerID="c2e96f5f8f9cb3cc21510fafc8a04ef275a27e1e0e3c4f7414be72707d148bdc"
Jul 17 18:41:57.524303 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:41:57.524281    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-df78e9c5-t75xf_odh-ai-gateway-infra(a517848b-2d45-4c8b-8143-a5efb985afd6)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-t75xf" podUID="a517848b-2d45-4c8b-8143-a5efb985afd6"
Jul 17 18:41:57.954539 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:57.954499    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:41:58.485031 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:58.484977    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:41:58.505879 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:58.505842    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg"
Jul 17 18:41:58.530140 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:58.530104    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:41:58.531028 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:58.530990    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:41:58.554106 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:58.554068    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m"]
Jul 17 18:41:58.559545 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:58.559518    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-t75xf"]
Jul 17 18:41:58.560019 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:58.559969    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m"
Jul 17 18:41:58.562754 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:58.562730    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-3be95b-serving-cert\""
Jul 17 18:41:58.573495 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:58.572975    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m"]
Jul 17 18:41:58.586455 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:58.586317    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:41:58.655552 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:58.655520    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cb3098d-8e8d-4a51-9f81-e626f2427db1-openshift-service-ca\") pod \"maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m\" (UID: \"2cb3098d-8e8d-4a51-9f81-e626f2427db1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m"
Jul 17 18:41:58.655706 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:58.655645    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf469\" (UniqueName: \"kubernetes.io/projected/2cb3098d-8e8d-4a51-9f81-e626f2427db1-kube-api-access-xf469\") pod \"maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m\" (UID: \"2cb3098d-8e8d-4a51-9f81-e626f2427db1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m"
Jul 17 18:41:58.656515 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:58.656102    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cb3098d-8e8d-4a51-9f81-e626f2427db1-maas-api-tls\") pod \"maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m\" (UID: \"2cb3098d-8e8d-4a51-9f81-e626f2427db1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m"
Jul 17 18:41:58.658744 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:58.658715    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:41:58.727150 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:58.727123    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-t75xf"
Jul 17 18:41:58.757585 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:58.757497    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf469\" (UniqueName: \"kubernetes.io/projected/2cb3098d-8e8d-4a51-9f81-e626f2427db1-kube-api-access-xf469\") pod \"maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m\" (UID: \"2cb3098d-8e8d-4a51-9f81-e626f2427db1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m"
Jul 17 18:41:58.757585 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:58.757563    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cb3098d-8e8d-4a51-9f81-e626f2427db1-maas-api-tls\") pod \"maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m\" (UID: \"2cb3098d-8e8d-4a51-9f81-e626f2427db1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m"
Jul 17 18:41:58.757808 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:58.757621    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cb3098d-8e8d-4a51-9f81-e626f2427db1-openshift-service-ca\") pod \"maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m\" (UID: \"2cb3098d-8e8d-4a51-9f81-e626f2427db1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m"
Jul 17 18:41:58.758377 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:58.758355    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cb3098d-8e8d-4a51-9f81-e626f2427db1-openshift-service-ca\") pod \"maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m\" (UID: \"2cb3098d-8e8d-4a51-9f81-e626f2427db1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m"
Jul 17 18:41:58.760148 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:58.760124    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cb3098d-8e8d-4a51-9f81-e626f2427db1-maas-api-tls\") pod \"maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m\" (UID: \"2cb3098d-8e8d-4a51-9f81-e626f2427db1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m"
Jul 17 18:41:58.762738 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:58.762710    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:41:58.766961 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:58.766936    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf469\" (UniqueName: \"kubernetes.io/projected/2cb3098d-8e8d-4a51-9f81-e626f2427db1-kube-api-access-xf469\") pod \"maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m\" (UID: \"2cb3098d-8e8d-4a51-9f81-e626f2427db1\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m"
Jul 17 18:41:58.858045 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:58.857962    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a517848b-2d45-4c8b-8143-a5efb985afd6-maas-api-service-ca\") pod \"a517848b-2d45-4c8b-8143-a5efb985afd6\" (UID: \"a517848b-2d45-4c8b-8143-a5efb985afd6\") "
Jul 17 18:41:58.858377 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:58.858355    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a517848b-2d45-4c8b-8143-a5efb985afd6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a517848b-2d45-4c8b-8143-a5efb985afd6" (UID: "a517848b-2d45-4c8b-8143-a5efb985afd6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:41:58.880803 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:58.880762    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m"
Jul 17 18:41:58.959638 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:58.959605    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a517848b-2d45-4c8b-8143-a5efb985afd6-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:41:59.025561 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:59.025532    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m"]
Jul 17 18:41:59.027081 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:41:59.027050    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cb3098d_8e8d_4a51_9f81_e626f2427db1.slice/crio-c10dc6d1a35d53e2479c719a2542bec959f7cafe2eef3cc3946d4b0d518ce32a WatchSource:0}: Error finding container c10dc6d1a35d53e2479c719a2542bec959f7cafe2eef3cc3946d4b0d518ce32a: Status 404 returned error can't find the container with id c10dc6d1a35d53e2479c719a2542bec959f7cafe2eef3cc3946d4b0d518ce32a
Jul 17 18:41:59.167510 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:59.167467    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:41:59.536285 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:59.536250    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m" event={"ID":"2cb3098d-8e8d-4a51-9f81-e626f2427db1","Type":"ContainerStarted","Data":"d91098914fa58e2ab276e60289132cac4751e96dde5ef689e58d5b6bb6ef29e0"}
Jul 17 18:41:59.536715 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:59.536305    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m" event={"ID":"2cb3098d-8e8d-4a51-9f81-e626f2427db1","Type":"ContainerStarted","Data":"c10dc6d1a35d53e2479c719a2542bec959f7cafe2eef3cc3946d4b0d518ce32a"}
Jul 17 18:41:59.536715 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:59.536348    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m"
Jul 17 18:41:59.537719 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:59.537692    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-t75xf" event={"ID":"a517848b-2d45-4c8b-8143-a5efb985afd6","Type":"ContainerDied","Data":"6053080d9a859d6247e243dd3ce1c44e14f8cffa59fe252b2e4663e57bd66f85"}
Jul 17 18:41:59.537719 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:59.537706    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-t75xf"
Jul 17 18:41:59.537935 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:59.537745    2572 scope.go:117] "RemoveContainer" containerID="c2e96f5f8f9cb3cc21510fafc8a04ef275a27e1e0e3c4f7414be72707d148bdc"
Jul 17 18:41:59.553580 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:59.553531    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m" podStartSLOduration=1.226658077 podStartE2EDuration="1.553514577s" totalImagesPullingTime="326.8565ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:41:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:41:59.551946085 +0000 UTC m=+2746.777175393" watchObservedRunningTime="2026-07-17 18:41:59.553514577 +0000 UTC m=+2746.778743887"
Jul 17 18:41:59.571605 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:59.571572    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-t75xf"]
Jul 17 18:41:59.579337 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:41:59.579309    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-t75xf"]
Jul 17 18:42:00.673824 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:00.673785    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:42:01.475301 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:01.475258    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a517848b-2d45-4c8b-8143-a5efb985afd6" path="/var/lib/kubelet/pods/a517848b-2d45-4c8b-8143-a5efb985afd6/volumes"
Jul 17 18:42:02.976859 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:02.976821    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:42:05.549454 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:05.549424    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m"
Jul 17 18:42:06.524219 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:06.524175    2572 patch_prober.go:28] interesting pod/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 17 18:42:06.524432 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:06.524254    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn" podUID="8cb73fb4-f1c3-4656-87e2-4ae85a21249c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 17 18:42:07.589106 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:07.589070    2572 generic.go:356] "Generic (PLEG): container finished" podID="8cb73fb4-f1c3-4656-87e2-4ae85a21249c" containerID="8d1034d70024e9a340c6a5777200b2ff4497f17de982927eb0f8fa518c01f3db" exitCode=0
Jul 17 18:42:07.589597 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:07.589145    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn" event={"ID":"8cb73fb4-f1c3-4656-87e2-4ae85a21249c","Type":"ContainerDied","Data":"8d1034d70024e9a340c6a5777200b2ff4497f17de982927eb0f8fa518c01f3db"}
Jul 17 18:42:07.589660 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:07.589615    2572 scope.go:117] "RemoveContainer" containerID="8d1034d70024e9a340c6a5777200b2ff4497f17de982927eb0f8fa518c01f3db"
Jul 17 18:42:07.590931 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:07.590893    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:42:07.591035 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:07.590989    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:42:07.591089 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:07.591068    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:42:08.596660 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:08.596626    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn" event={"ID":"8cb73fb4-f1c3-4656-87e2-4ae85a21249c","Type":"ContainerStarted","Data":"4706fbe95ce884059440b36c40a96cbeddf772cdfaeb0c0bc3964571026b121c"}
Jul 17 18:42:08.807294 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:08.807247    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:42:08.807539 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:08.807513    2572 patch_prober.go:28] interesting pod/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Jul 17 18:42:08.807629 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:08.807574    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn" podUID="8cb73fb4-f1c3-4656-87e2-4ae85a21249c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Jul 17 18:42:09.807187 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:09.807147    2572 patch_prober.go:28] interesting pod/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Jul 17 18:42:09.807598 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:09.807212    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn" podUID="8cb73fb4-f1c3-4656-87e2-4ae85a21249c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Jul 17 18:42:10.508338 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:10.508303    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:42:10.807215 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:10.807099    2572 patch_prober.go:28] interesting pod/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Jul 17 18:42:10.807215 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:10.807173    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn" podUID="8cb73fb4-f1c3-4656-87e2-4ae85a21249c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Jul 17 18:42:11.807780 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:11.807741    2572 patch_prober.go:28] interesting pod/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Jul 17 18:42:11.808208 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:11.807807    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn" podUID="8cb73fb4-f1c3-4656-87e2-4ae85a21249c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Jul 17 18:42:11.942511 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:11.942481    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:42:12.071800 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:12.071706    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:42:12.807945 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:12.807903    2572 patch_prober.go:28] interesting pod/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Jul 17 18:42:12.808405 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:12.807973    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn" podUID="8cb73fb4-f1c3-4656-87e2-4ae85a21249c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Jul 17 18:42:13.807069 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:13.807028    2572 patch_prober.go:28] interesting pod/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Jul 17 18:42:13.807289 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:13.807096    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn" podUID="8cb73fb4-f1c3-4656-87e2-4ae85a21249c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Jul 17 18:42:14.486512 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:14.485399    2572 patch_prober.go:28] interesting pod/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": read tcp 10.132.0.2:41750->10.132.0.96:15021: read: connection reset by peer" start-of-body=
Jul 17 18:42:14.486512 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:14.485468    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2" podUID="f377470c-84e4-4287-a00b-494c8c39e0f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": read tcp 10.132.0.2:41750->10.132.0.96:15021: read: connection reset by peer"
Jul 17 18:42:14.634637 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:14.634603    2572 generic.go:356] "Generic (PLEG): container finished" podID="f377470c-84e4-4287-a00b-494c8c39e0f4" containerID="d0a047b5361a91bb149ddc9b2195b82a965c67dd982fc46eb04f3d9d69a84ddb" exitCode=0
Jul 17 18:42:14.634809 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:14.634680    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2" event={"ID":"f377470c-84e4-4287-a00b-494c8c39e0f4","Type":"ContainerDied","Data":"d0a047b5361a91bb149ddc9b2195b82a965c67dd982fc46eb04f3d9d69a84ddb"}
Jul 17 18:42:14.635159 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:14.635141    2572 scope.go:117] "RemoveContainer" containerID="d0a047b5361a91bb149ddc9b2195b82a965c67dd982fc46eb04f3d9d69a84ddb"
Jul 17 18:42:14.636176 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:14.636147    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:42:14.636252 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:14.636213    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:42:14.636252 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:14.636246    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:42:14.810980 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:14.810898    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:42:14.811236 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:14.811212    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:42:14.811803 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:14.811784    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:42:15.642073 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:15.642033    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2" event={"ID":"f377470c-84e4-4287-a00b-494c8c39e0f4","Type":"ContainerStarted","Data":"fff4782a7237394293e9d75f7c80515deb5ebef57a2c33160daab0d839d2bb8c"}
Jul 17 18:42:15.948677 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:15.948647    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:42:15.949040 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:15.948981    2572 patch_prober.go:28] interesting pod/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Jul 17 18:42:15.949209 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:15.949078    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2" podUID="f377470c-84e4-4287-a00b-494c8c39e0f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Jul 17 18:42:16.949091 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:16.949054    2572 patch_prober.go:28] interesting pod/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Jul 17 18:42:16.949502 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:16.949110    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2" podUID="f377470c-84e4-4287-a00b-494c8c39e0f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Jul 17 18:42:17.949821 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:17.949774    2572 patch_prober.go:28] interesting pod/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Jul 17 18:42:17.950302 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:17.949851    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2" podUID="f377470c-84e4-4287-a00b-494c8c39e0f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Jul 17 18:42:18.949110 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:18.949071    2572 patch_prober.go:28] interesting pod/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused" start-of-body=
Jul 17 18:42:18.949283 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:18.949143    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2" podUID="f377470c-84e4-4287-a00b-494c8c39e0f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.96:15021/healthz/ready\": dial tcp 10.132.0.96:15021: connect: connection refused"
Jul 17 18:42:19.951615 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:19.951576    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:42:19.953775 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:19.953749    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:42:19.954198 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:19.954181    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:42:19.954960 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:19.954939    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:42:20.049339 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:20.049307    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:42:55.726260 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:42:55.726168    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:43:17.369629 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:17.369586    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:43:18.402588 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:18.402548    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:43:19.085868 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:19.085826    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:43:19.191391 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:19.191353    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:43:24.533671 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:24.533600    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:43:28.934406 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:28.934369    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg"]
Jul 17 18:43:28.966600 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:28.966561    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:43:29.013287 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:29.013244    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg" podUID="8240e4ff-a7f9-43a8-bf2d-f1bf66b22556" containerName="maas-api" containerID="cri-o://a312a5cc27f5db69b63b1f8283ca3c980f178a38219eedb0308d713cab20097a" gracePeriod=30
Jul 17 18:43:29.275895 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:29.275865    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg"
Jul 17 18:43:29.371104 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:29.371067    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8240e4ff-a7f9-43a8-bf2d-f1bf66b22556-maas-api-tls\") pod \"8240e4ff-a7f9-43a8-bf2d-f1bf66b22556\" (UID: \"8240e4ff-a7f9-43a8-bf2d-f1bf66b22556\") "
Jul 17 18:43:29.371104 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:29.371106    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8240e4ff-a7f9-43a8-bf2d-f1bf66b22556-openshift-service-ca\") pod \"8240e4ff-a7f9-43a8-bf2d-f1bf66b22556\" (UID: \"8240e4ff-a7f9-43a8-bf2d-f1bf66b22556\") "
Jul 17 18:43:29.371374 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:29.371154    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88kvf\" (UniqueName: \"kubernetes.io/projected/8240e4ff-a7f9-43a8-bf2d-f1bf66b22556-kube-api-access-88kvf\") pod \"8240e4ff-a7f9-43a8-bf2d-f1bf66b22556\" (UID: \"8240e4ff-a7f9-43a8-bf2d-f1bf66b22556\") "
Jul 17 18:43:29.371599 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:29.371563    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8240e4ff-a7f9-43a8-bf2d-f1bf66b22556-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8240e4ff-a7f9-43a8-bf2d-f1bf66b22556" (UID: "8240e4ff-a7f9-43a8-bf2d-f1bf66b22556"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:43:29.373364 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:29.373332    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8240e4ff-a7f9-43a8-bf2d-f1bf66b22556-kube-api-access-88kvf" (OuterVolumeSpecName: "kube-api-access-88kvf") pod "8240e4ff-a7f9-43a8-bf2d-f1bf66b22556" (UID: "8240e4ff-a7f9-43a8-bf2d-f1bf66b22556"). InnerVolumeSpecName "kube-api-access-88kvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:43:29.373472 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:29.373371    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8240e4ff-a7f9-43a8-bf2d-f1bf66b22556-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8240e4ff-a7f9-43a8-bf2d-f1bf66b22556" (UID: "8240e4ff-a7f9-43a8-bf2d-f1bf66b22556"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 18:43:29.472265 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:29.472236    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8240e4ff-a7f9-43a8-bf2d-f1bf66b22556-maas-api-tls\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:43:29.472265 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:29.472265    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8240e4ff-a7f9-43a8-bf2d-f1bf66b22556-openshift-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:43:29.472483 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:29.472278    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88kvf\" (UniqueName: \"kubernetes.io/projected/8240e4ff-a7f9-43a8-bf2d-f1bf66b22556-kube-api-access-88kvf\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:43:30.019628 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:30.019592    2572 generic.go:356] "Generic (PLEG): container finished" podID="8240e4ff-a7f9-43a8-bf2d-f1bf66b22556" containerID="a312a5cc27f5db69b63b1f8283ca3c980f178a38219eedb0308d713cab20097a" exitCode=0
Jul 17 18:43:30.020170 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:30.019652    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg"
Jul 17 18:43:30.020170 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:30.019680    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg" event={"ID":"8240e4ff-a7f9-43a8-bf2d-f1bf66b22556","Type":"ContainerDied","Data":"a312a5cc27f5db69b63b1f8283ca3c980f178a38219eedb0308d713cab20097a"}
Jul 17 18:43:30.020170 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:30.019736    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg" event={"ID":"8240e4ff-a7f9-43a8-bf2d-f1bf66b22556","Type":"ContainerDied","Data":"f3b4b693b86e66b644666a8407f50e1f98d69df65e7e3605646954d84b4cfd21"}
Jul 17 18:43:30.020170 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:30.019759    2572 scope.go:117] "RemoveContainer" containerID="a312a5cc27f5db69b63b1f8283ca3c980f178a38219eedb0308d713cab20097a"
Jul 17 18:43:30.028792 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:30.028771    2572 scope.go:117] "RemoveContainer" containerID="a312a5cc27f5db69b63b1f8283ca3c980f178a38219eedb0308d713cab20097a"
Jul 17 18:43:30.029077 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:43:30.029057    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a312a5cc27f5db69b63b1f8283ca3c980f178a38219eedb0308d713cab20097a\": container with ID starting with a312a5cc27f5db69b63b1f8283ca3c980f178a38219eedb0308d713cab20097a not found: ID does not exist" containerID="a312a5cc27f5db69b63b1f8283ca3c980f178a38219eedb0308d713cab20097a"
Jul 17 18:43:30.029137 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:30.029087    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a312a5cc27f5db69b63b1f8283ca3c980f178a38219eedb0308d713cab20097a"} err="failed to get container status \"a312a5cc27f5db69b63b1f8283ca3c980f178a38219eedb0308d713cab20097a\": rpc error: code = NotFound desc = could not find container \"a312a5cc27f5db69b63b1f8283ca3c980f178a38219eedb0308d713cab20097a\": container with ID starting with a312a5cc27f5db69b63b1f8283ca3c980f178a38219eedb0308d713cab20097a not found: ID does not exist"
Jul 17 18:43:30.036176 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:30.036150    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg"]
Jul 17 18:43:30.039502 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:30.039479    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-ddeacf-7b794db784-bkkgg"]
Jul 17 18:43:31.471423 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:31.471392    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8240e4ff-a7f9-43a8-bf2d-f1bf66b22556" path="/var/lib/kubelet/pods/8240e4ff-a7f9-43a8-bf2d-f1bf66b22556/volumes"
Jul 17 18:43:33.623589 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:33.623557    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:43:39.604275 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:39.604240    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:43:39.704549 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:39.704511    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:43:44.302490 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:44.302449    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"]
Jul 17 18:43:44.302905 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:44.302713    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn" podUID="8cb73fb4-f1c3-4656-87e2-4ae85a21249c" containerName="istio-proxy" containerID="cri-o://4706fbe95ce884059440b36c40a96cbeddf772cdfaeb0c0bc3964571026b121c" gracePeriod=30
Jul 17 18:43:44.327583 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:44.327547    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:43:44.562372 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:44.562279    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:43:44.813890 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:44.813805    2572 patch_prober.go:28] interesting pod/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 18:43:44.813890 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:44.813874    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn" podUID="8cb73fb4-f1c3-4656-87e2-4ae85a21249c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 18:43:45.187392 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:45.187292    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:43:45.293164 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:45.293129    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:43:49.570019 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:49.569934    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:43:49.686931 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:49.686891    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-workload-certs\") pod \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") "
Jul 17 18:43:49.687164 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:49.686948    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-istio-token\") pod \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") "
Jul 17 18:43:49.687164 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:49.686968    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-workload-socket\") pod \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") "
Jul 17 18:43:49.687164 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:49.686983    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-istio-envoy\") pod \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") "
Jul 17 18:43:49.687164 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:49.687029    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-istiod-ca-cert\") pod \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") "
Jul 17 18:43:49.687164 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:49.687098    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-istio-podinfo\") pod \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") "
Jul 17 18:43:49.687164 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:49.687132    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-credential-socket\") pod \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") "
Jul 17 18:43:49.687492 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:49.687173    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmz8f\" (UniqueName: \"kubernetes.io/projected/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-kube-api-access-lmz8f\") pod \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") "
Jul 17 18:43:49.687492 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:49.687225    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-istio-data\") pod \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\" (UID: \"8cb73fb4-f1c3-4656-87e2-4ae85a21249c\") "
Jul 17 18:43:49.687492 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:49.687243    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8cb73fb4-f1c3-4656-87e2-4ae85a21249c" (UID: "8cb73fb4-f1c3-4656-87e2-4ae85a21249c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:43:49.687492 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:49.687358    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8cb73fb4-f1c3-4656-87e2-4ae85a21249c" (UID: "8cb73fb4-f1c3-4656-87e2-4ae85a21249c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:43:49.687667 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:49.687526    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8cb73fb4-f1c3-4656-87e2-4ae85a21249c" (UID: "8cb73fb4-f1c3-4656-87e2-4ae85a21249c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:43:49.687667 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:49.687647    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-workload-certs\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:43:49.687744 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:49.687666    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-workload-socket\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:43:49.687744 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:49.687661    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8cb73fb4-f1c3-4656-87e2-4ae85a21249c" (UID: "8cb73fb4-f1c3-4656-87e2-4ae85a21249c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:43:49.687744 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:49.687679    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-credential-socket\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:43:49.688128 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:49.688107    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-istio-data" (OuterVolumeSpecName: "istio-data") pod "8cb73fb4-f1c3-4656-87e2-4ae85a21249c" (UID: "8cb73fb4-f1c3-4656-87e2-4ae85a21249c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:43:49.689533 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:49.689505    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8cb73fb4-f1c3-4656-87e2-4ae85a21249c" (UID: "8cb73fb4-f1c3-4656-87e2-4ae85a21249c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 18:43:49.689625 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:49.689588    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-kube-api-access-lmz8f" (OuterVolumeSpecName: "kube-api-access-lmz8f") pod "8cb73fb4-f1c3-4656-87e2-4ae85a21249c" (UID: "8cb73fb4-f1c3-4656-87e2-4ae85a21249c"). InnerVolumeSpecName "kube-api-access-lmz8f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:43:49.689783 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:49.689760    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8cb73fb4-f1c3-4656-87e2-4ae85a21249c" (UID: "8cb73fb4-f1c3-4656-87e2-4ae85a21249c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:43:49.689876 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:49.689778    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-istio-token" (OuterVolumeSpecName: "istio-token") pod "8cb73fb4-f1c3-4656-87e2-4ae85a21249c" (UID: "8cb73fb4-f1c3-4656-87e2-4ae85a21249c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:43:49.788415 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:49.788380    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-istio-token\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:43:49.788415 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:49.788415    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-istio-envoy\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:43:49.788415 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:49.788427    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-istiod-ca-cert\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:43:49.788655 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:49.788435    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-istio-podinfo\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:43:49.788655 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:49.788443    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmz8f\" (UniqueName: \"kubernetes.io/projected/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-kube-api-access-lmz8f\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:43:49.788655 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:49.788453    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8cb73fb4-f1c3-4656-87e2-4ae85a21249c-istio-data\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:43:50.130244 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:50.130209    2572 generic.go:356] "Generic (PLEG): container finished" podID="8cb73fb4-f1c3-4656-87e2-4ae85a21249c" containerID="4706fbe95ce884059440b36c40a96cbeddf772cdfaeb0c0bc3964571026b121c" exitCode=0
Jul 17 18:43:50.130425 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:50.130258    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"
Jul 17 18:43:50.130425 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:50.130268    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn" event={"ID":"8cb73fb4-f1c3-4656-87e2-4ae85a21249c","Type":"ContainerDied","Data":"4706fbe95ce884059440b36c40a96cbeddf772cdfaeb0c0bc3964571026b121c"}
Jul 17 18:43:50.130425 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:50.130317    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn" event={"ID":"8cb73fb4-f1c3-4656-87e2-4ae85a21249c","Type":"ContainerDied","Data":"58e54bb1815722c8e2a06a08ef3ce9bbfaa9edf1e58a1c7efa47c4bc559267c4"}
Jul 17 18:43:50.130425 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:50.130341    2572 scope.go:117] "RemoveContainer" containerID="4706fbe95ce884059440b36c40a96cbeddf772cdfaeb0c0bc3964571026b121c"
Jul 17 18:43:50.140456 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:50.140436    2572 scope.go:117] "RemoveContainer" containerID="8d1034d70024e9a340c6a5777200b2ff4497f17de982927eb0f8fa518c01f3db"
Jul 17 18:43:50.149142 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:50.149121    2572 scope.go:117] "RemoveContainer" containerID="4706fbe95ce884059440b36c40a96cbeddf772cdfaeb0c0bc3964571026b121c"
Jul 17 18:43:50.149419 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:43:50.149401    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4706fbe95ce884059440b36c40a96cbeddf772cdfaeb0c0bc3964571026b121c\": container with ID starting with 4706fbe95ce884059440b36c40a96cbeddf772cdfaeb0c0bc3964571026b121c not found: ID does not exist" containerID="4706fbe95ce884059440b36c40a96cbeddf772cdfaeb0c0bc3964571026b121c"
Jul 17 18:43:50.149465 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:50.149428    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4706fbe95ce884059440b36c40a96cbeddf772cdfaeb0c0bc3964571026b121c"} err="failed to get container status \"4706fbe95ce884059440b36c40a96cbeddf772cdfaeb0c0bc3964571026b121c\": rpc error: code = NotFound desc = could not find container \"4706fbe95ce884059440b36c40a96cbeddf772cdfaeb0c0bc3964571026b121c\": container with ID starting with 4706fbe95ce884059440b36c40a96cbeddf772cdfaeb0c0bc3964571026b121c not found: ID does not exist"
Jul 17 18:43:50.149465 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:50.149445    2572 scope.go:117] "RemoveContainer" containerID="8d1034d70024e9a340c6a5777200b2ff4497f17de982927eb0f8fa518c01f3db"
Jul 17 18:43:50.149669 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:43:50.149653    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d1034d70024e9a340c6a5777200b2ff4497f17de982927eb0f8fa518c01f3db\": container with ID starting with 8d1034d70024e9a340c6a5777200b2ff4497f17de982927eb0f8fa518c01f3db not found: ID does not exist" containerID="8d1034d70024e9a340c6a5777200b2ff4497f17de982927eb0f8fa518c01f3db"
Jul 17 18:43:50.149707 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:50.149676    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d1034d70024e9a340c6a5777200b2ff4497f17de982927eb0f8fa518c01f3db"} err="failed to get container status \"8d1034d70024e9a340c6a5777200b2ff4497f17de982927eb0f8fa518c01f3db\": rpc error: code = NotFound desc = could not find container \"8d1034d70024e9a340c6a5777200b2ff4497f17de982927eb0f8fa518c01f3db\": container with ID starting with 8d1034d70024e9a340c6a5777200b2ff4497f17de982927eb0f8fa518c01f3db not found: ID does not exist"
Jul 17 18:43:50.153864 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:50.153839    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"]
Jul 17 18:43:50.157926 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:50.157906    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-ddeacf-openshift-default-549977b4f5-8jjdn"]
Jul 17 18:43:51.479060 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:51.479026    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cb73fb4-f1c3-4656-87e2-4ae85a21249c" path="/var/lib/kubelet/pods/8cb73fb4-f1c3-4656-87e2-4ae85a21249c/volumes"
Jul 17 18:43:55.159164 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:55.159128    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m"]
Jul 17 18:43:55.159688 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:55.159398    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m" podUID="2cb3098d-8e8d-4a51-9f81-e626f2427db1" containerName="maas-api" containerID="cri-o://d91098914fa58e2ab276e60289132cac4751e96dde5ef689e58d5b6bb6ef29e0" gracePeriod=30
Jul 17 18:43:55.186311 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:55.186275    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:43:55.614584 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:55.614560    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m"
Jul 17 18:43:55.638557 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:55.638526    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xf469\" (UniqueName: \"kubernetes.io/projected/2cb3098d-8e8d-4a51-9f81-e626f2427db1-kube-api-access-xf469\") pod \"2cb3098d-8e8d-4a51-9f81-e626f2427db1\" (UID: \"2cb3098d-8e8d-4a51-9f81-e626f2427db1\") "
Jul 17 18:43:55.638739 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:55.638594    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cb3098d-8e8d-4a51-9f81-e626f2427db1-maas-api-tls\") pod \"2cb3098d-8e8d-4a51-9f81-e626f2427db1\" (UID: \"2cb3098d-8e8d-4a51-9f81-e626f2427db1\") "
Jul 17 18:43:55.638814 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:55.638737    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cb3098d-8e8d-4a51-9f81-e626f2427db1-openshift-service-ca\") pod \"2cb3098d-8e8d-4a51-9f81-e626f2427db1\" (UID: \"2cb3098d-8e8d-4a51-9f81-e626f2427db1\") "
Jul 17 18:43:55.639096 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:55.639065    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2cb3098d-8e8d-4a51-9f81-e626f2427db1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2cb3098d-8e8d-4a51-9f81-e626f2427db1" (UID: "2cb3098d-8e8d-4a51-9f81-e626f2427db1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:43:55.640719 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:55.640687    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2cb3098d-8e8d-4a51-9f81-e626f2427db1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2cb3098d-8e8d-4a51-9f81-e626f2427db1" (UID: "2cb3098d-8e8d-4a51-9f81-e626f2427db1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 18:43:55.640823 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:55.640749    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cb3098d-8e8d-4a51-9f81-e626f2427db1-kube-api-access-xf469" (OuterVolumeSpecName: "kube-api-access-xf469") pod "2cb3098d-8e8d-4a51-9f81-e626f2427db1" (UID: "2cb3098d-8e8d-4a51-9f81-e626f2427db1"). InnerVolumeSpecName "kube-api-access-xf469". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:43:55.739853 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:55.739821    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cb3098d-8e8d-4a51-9f81-e626f2427db1-openshift-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:43:55.739853 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:55.739851    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xf469\" (UniqueName: \"kubernetes.io/projected/2cb3098d-8e8d-4a51-9f81-e626f2427db1-kube-api-access-xf469\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:43:55.739853 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:55.739862    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cb3098d-8e8d-4a51-9f81-e626f2427db1-maas-api-tls\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:43:56.165392 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:56.165309    2572 generic.go:356] "Generic (PLEG): container finished" podID="2cb3098d-8e8d-4a51-9f81-e626f2427db1" containerID="d91098914fa58e2ab276e60289132cac4751e96dde5ef689e58d5b6bb6ef29e0" exitCode=0
Jul 17 18:43:56.165392 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:56.165346    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m" event={"ID":"2cb3098d-8e8d-4a51-9f81-e626f2427db1","Type":"ContainerDied","Data":"d91098914fa58e2ab276e60289132cac4751e96dde5ef689e58d5b6bb6ef29e0"}
Jul 17 18:43:56.165392 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:56.165356    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m"
Jul 17 18:43:56.165392 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:56.165386    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m" event={"ID":"2cb3098d-8e8d-4a51-9f81-e626f2427db1","Type":"ContainerDied","Data":"c10dc6d1a35d53e2479c719a2542bec959f7cafe2eef3cc3946d4b0d518ce32a"}
Jul 17 18:43:56.165969 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:56.165408    2572 scope.go:117] "RemoveContainer" containerID="d91098914fa58e2ab276e60289132cac4751e96dde5ef689e58d5b6bb6ef29e0"
Jul 17 18:43:56.174588 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:56.174546    2572 scope.go:117] "RemoveContainer" containerID="d91098914fa58e2ab276e60289132cac4751e96dde5ef689e58d5b6bb6ef29e0"
Jul 17 18:43:56.174830 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:43:56.174807    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d91098914fa58e2ab276e60289132cac4751e96dde5ef689e58d5b6bb6ef29e0\": container with ID starting with d91098914fa58e2ab276e60289132cac4751e96dde5ef689e58d5b6bb6ef29e0 not found: ID does not exist" containerID="d91098914fa58e2ab276e60289132cac4751e96dde5ef689e58d5b6bb6ef29e0"
Jul 17 18:43:56.174895 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:56.174841    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d91098914fa58e2ab276e60289132cac4751e96dde5ef689e58d5b6bb6ef29e0"} err="failed to get container status \"d91098914fa58e2ab276e60289132cac4751e96dde5ef689e58d5b6bb6ef29e0\": rpc error: code = NotFound desc = could not find container \"d91098914fa58e2ab276e60289132cac4751e96dde5ef689e58d5b6bb6ef29e0\": container with ID starting with d91098914fa58e2ab276e60289132cac4751e96dde5ef689e58d5b6bb6ef29e0 not found: ID does not exist"
Jul 17 18:43:56.185987 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:56.185963    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m"]
Jul 17 18:43:56.192171 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:56.192147    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m"]
Jul 17 18:43:57.471259 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:57.471225    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cb3098d-8e8d-4a51-9f81-e626f2427db1" path="/var/lib/kubelet/pods/2cb3098d-8e8d-4a51-9f81-e626f2427db1/volumes"
Jul 17 18:43:57.520651 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:57.520617    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-2gv29"]
Jul 17 18:43:57.521030 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:57.521016    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a517848b-2d45-4c8b-8143-a5efb985afd6" containerName="revoke-keys"
Jul 17 18:43:57.521091 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:57.521031    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a517848b-2d45-4c8b-8143-a5efb985afd6" containerName="revoke-keys"
Jul 17 18:43:57.521091 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:57.521042    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a517848b-2d45-4c8b-8143-a5efb985afd6" containerName="revoke-keys"
Jul 17 18:43:57.521091 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:57.521049    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a517848b-2d45-4c8b-8143-a5efb985afd6" containerName="revoke-keys"
Jul 17 18:43:57.521091 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:57.521055    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cb73fb4-f1c3-4656-87e2-4ae85a21249c" containerName="istio-proxy"
Jul 17 18:43:57.521091 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:57.521061    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cb73fb4-f1c3-4656-87e2-4ae85a21249c" containerName="istio-proxy"
Jul 17 18:43:57.521091 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:57.521070    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8240e4ff-a7f9-43a8-bf2d-f1bf66b22556" containerName="maas-api"
Jul 17 18:43:57.521091 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:57.521075    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8240e4ff-a7f9-43a8-bf2d-f1bf66b22556" containerName="maas-api"
Jul 17 18:43:57.521326 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:57.521097    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cb3098d-8e8d-4a51-9f81-e626f2427db1" containerName="maas-api"
Jul 17 18:43:57.521326 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:57.521103    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cb3098d-8e8d-4a51-9f81-e626f2427db1" containerName="maas-api"
Jul 17 18:43:57.521326 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:57.521160    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a517848b-2d45-4c8b-8143-a5efb985afd6" containerName="revoke-keys"
Jul 17 18:43:57.521326 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:57.521167    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cb3098d-8e8d-4a51-9f81-e626f2427db1" containerName="maas-api"
Jul 17 18:43:57.521326 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:57.521176    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8240e4ff-a7f9-43a8-bf2d-f1bf66b22556" containerName="maas-api"
Jul 17 18:43:57.521326 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:57.521184    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a517848b-2d45-4c8b-8143-a5efb985afd6" containerName="revoke-keys"
Jul 17 18:43:57.521326 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:57.521190    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a517848b-2d45-4c8b-8143-a5efb985afd6" containerName="revoke-keys"
Jul 17 18:43:57.521326 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:57.521197    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cb73fb4-f1c3-4656-87e2-4ae85a21249c" containerName="istio-proxy"
Jul 17 18:43:57.521326 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:57.521203    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cb73fb4-f1c3-4656-87e2-4ae85a21249c" containerName="istio-proxy"
Jul 17 18:43:57.528662 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:57.528629    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-2gv29"
Jul 17 18:43:57.532862 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:57.532594    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:43:57.533037 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:57.532856    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-2gv29"]
Jul 17 18:43:57.556794 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:57.556755    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af61cb09-02e8-41a9-941a-4ed5e69be168-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-2gv29\" (UID: \"af61cb09-02e8-41a9-941a-4ed5e69be168\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-2gv29"
Jul 17 18:43:57.658159 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:57.658121    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af61cb09-02e8-41a9-941a-4ed5e69be168-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-2gv29\" (UID: \"af61cb09-02e8-41a9-941a-4ed5e69be168\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-2gv29"
Jul 17 18:43:57.658737 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:57.658712    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af61cb09-02e8-41a9-941a-4ed5e69be168-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-2gv29\" (UID: \"af61cb09-02e8-41a9-941a-4ed5e69be168\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-2gv29"
Jul 17 18:43:57.841832 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:57.841739    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-2gv29"
Jul 17 18:43:57.975735 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:57.975702    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-2gv29"]
Jul 17 18:43:57.977832 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:43:57.977801    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf61cb09_02e8_41a9_941a_4ed5e69be168.slice/crio-864371f21e4280592c5c0eae5222f531df58f2b4fcb69b67b62ab7d2546fc50d WatchSource:0}: Error finding container 864371f21e4280592c5c0eae5222f531df58f2b4fcb69b67b62ab7d2546fc50d: Status 404 returned error can't find the container with id 864371f21e4280592c5c0eae5222f531df58f2b4fcb69b67b62ab7d2546fc50d
Jul 17 18:43:58.178950 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:58.178924    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-2gv29" event={"ID":"af61cb09-02e8-41a9-941a-4ed5e69be168","Type":"ContainerStarted","Data":"864371f21e4280592c5c0eae5222f531df58f2b4fcb69b67b62ab7d2546fc50d"}
Jul 17 18:43:58.544581 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:58.544535    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-3be95b-599557d6fb-sr88m" podUID="2cb3098d-8e8d-4a51-9f81-e626f2427db1" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.97:8443/health\": context deadline exceeded"
Jul 17 18:43:59.185404 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:59.185369    2572 generic.go:356] "Generic (PLEG): container finished" podID="af61cb09-02e8-41a9-941a-4ed5e69be168" containerID="028bb41ee1dbf315a0b8f1c65954e6e1820ec0a36e82983aa2321769b0dd1d03" exitCode=6
Jul 17 18:43:59.185656 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:59.185451    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-2gv29" event={"ID":"af61cb09-02e8-41a9-941a-4ed5e69be168","Type":"ContainerDied","Data":"028bb41ee1dbf315a0b8f1c65954e6e1820ec0a36e82983aa2321769b0dd1d03"}
Jul 17 18:43:59.185733 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:59.185700    2572 scope.go:117] "RemoveContainer" containerID="028bb41ee1dbf315a0b8f1c65954e6e1820ec0a36e82983aa2321769b0dd1d03"
Jul 17 18:43:59.788291 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:43:59.788253    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:44:00.192471 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:00.192443    2572 generic.go:356] "Generic (PLEG): container finished" podID="af61cb09-02e8-41a9-941a-4ed5e69be168" containerID="6e3073def6c234ddc9b8c6fa5b693aee70e80524286498c933cc4fe89dfc0ebe" exitCode=6
Jul 17 18:44:00.192667 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:00.192527    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-2gv29" event={"ID":"af61cb09-02e8-41a9-941a-4ed5e69be168","Type":"ContainerDied","Data":"6e3073def6c234ddc9b8c6fa5b693aee70e80524286498c933cc4fe89dfc0ebe"}
Jul 17 18:44:00.192667 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:00.192590    2572 scope.go:117] "RemoveContainer" containerID="028bb41ee1dbf315a0b8f1c65954e6e1820ec0a36e82983aa2321769b0dd1d03"
Jul 17 18:44:00.192795 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:00.192742    2572 scope.go:117] "RemoveContainer" containerID="6e3073def6c234ddc9b8c6fa5b693aee70e80524286498c933cc4fe89dfc0ebe"
Jul 17 18:44:00.193043 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:44:00.193020    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-2gv29_odh-ai-gateway-infra(af61cb09-02e8-41a9-941a-4ed5e69be168)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-2gv29" podUID="af61cb09-02e8-41a9-941a-4ed5e69be168"
Jul 17 18:44:01.199672 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:01.199648    2572 scope.go:117] "RemoveContainer" containerID="6e3073def6c234ddc9b8c6fa5b693aee70e80524286498c933cc4fe89dfc0ebe"
Jul 17 18:44:01.200097 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:44:01.199850    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-2gv29_odh-ai-gateway-infra(af61cb09-02e8-41a9-941a-4ed5e69be168)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-2gv29" podUID="af61cb09-02e8-41a9-941a-4ed5e69be168"
Jul 17 18:44:03.553596 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:03.553560    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-sg4wx"]
Jul 17 18:44:03.553990 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:03.553953    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a517848b-2d45-4c8b-8143-a5efb985afd6" containerName="revoke-keys"
Jul 17 18:44:03.553990 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:03.553964    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a517848b-2d45-4c8b-8143-a5efb985afd6" containerName="revoke-keys"
Jul 17 18:44:03.553990 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:03.553971    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cb73fb4-f1c3-4656-87e2-4ae85a21249c" containerName="istio-proxy"
Jul 17 18:44:03.553990 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:03.553977    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cb73fb4-f1c3-4656-87e2-4ae85a21249c" containerName="istio-proxy"
Jul 17 18:44:03.558155 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:03.558134    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-sg4wx"
Jul 17 18:44:03.563340 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:03.563311    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-sg4wx"]
Jul 17 18:44:03.610801 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:03.610766    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70592cc7-1b70-4652-9a57-301cc12f7b8b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a5b144da-sg4wx\" (UID: \"70592cc7-1b70-4652-9a57-301cc12f7b8b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-sg4wx"
Jul 17 18:44:03.712050 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:03.712009    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70592cc7-1b70-4652-9a57-301cc12f7b8b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a5b144da-sg4wx\" (UID: \"70592cc7-1b70-4652-9a57-301cc12f7b8b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-sg4wx"
Jul 17 18:44:03.712720 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:03.712681    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70592cc7-1b70-4652-9a57-301cc12f7b8b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a5b144da-sg4wx\" (UID: \"70592cc7-1b70-4652-9a57-301cc12f7b8b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-sg4wx"
Jul 17 18:44:03.870790 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:03.870699    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-sg4wx"
Jul 17 18:44:04.015070 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:04.015038    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-sg4wx"]
Jul 17 18:44:04.016524 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:44:04.016483    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70592cc7_1b70_4652_9a57_301cc12f7b8b.slice/crio-9576c0d45c1f4d6f13bab2dfbd88c1ca09b7a201324508c0ca87a97929e66bba WatchSource:0}: Error finding container 9576c0d45c1f4d6f13bab2dfbd88c1ca09b7a201324508c0ca87a97929e66bba: Status 404 returned error can't find the container with id 9576c0d45c1f4d6f13bab2dfbd88c1ca09b7a201324508c0ca87a97929e66bba
Jul 17 18:44:04.215819 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:04.215766    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-sg4wx" event={"ID":"70592cc7-1b70-4652-9a57-301cc12f7b8b","Type":"ContainerStarted","Data":"f8d2c8c2431f5adaedf09156a98af38371cc523c083b3e3d7555db0125c3c7ac"}
Jul 17 18:44:04.215979 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:04.215840    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-sg4wx" event={"ID":"70592cc7-1b70-4652-9a57-301cc12f7b8b","Type":"ContainerStarted","Data":"9576c0d45c1f4d6f13bab2dfbd88c1ca09b7a201324508c0ca87a97929e66bba"}
Jul 17 18:44:04.231189 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:04.231141    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-sg4wx" podStartSLOduration=1.231127145 podStartE2EDuration="1.231127145s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:44:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:44:04.230315804 +0000 UTC m=+2871.455545113" watchObservedRunningTime="2026-07-17 18:44:04.231127145 +0000 UTC m=+2871.456356453"
Jul 17 18:44:05.222869 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:05.222835    2572 generic.go:356] "Generic (PLEG): container finished" podID="70592cc7-1b70-4652-9a57-301cc12f7b8b" containerID="f8d2c8c2431f5adaedf09156a98af38371cc523c083b3e3d7555db0125c3c7ac" exitCode=6
Jul 17 18:44:05.223310 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:05.222904    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-sg4wx" event={"ID":"70592cc7-1b70-4652-9a57-301cc12f7b8b","Type":"ContainerDied","Data":"f8d2c8c2431f5adaedf09156a98af38371cc523c083b3e3d7555db0125c3c7ac"}
Jul 17 18:44:05.223310 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:05.223131    2572 scope.go:117] "RemoveContainer" containerID="f8d2c8c2431f5adaedf09156a98af38371cc523c083b3e3d7555db0125c3c7ac"
Jul 17 18:44:05.654704 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:05.654665    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:44:05.754727 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:05.754624    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:44:06.229584 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:06.229547    2572 generic.go:356] "Generic (PLEG): container finished" podID="70592cc7-1b70-4652-9a57-301cc12f7b8b" containerID="2e83111f5158d55fc17347e78c87a7dad8437a207ce52cc66c78552457908844" exitCode=6
Jul 17 18:44:06.230056 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:06.229641    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-sg4wx" event={"ID":"70592cc7-1b70-4652-9a57-301cc12f7b8b","Type":"ContainerDied","Data":"2e83111f5158d55fc17347e78c87a7dad8437a207ce52cc66c78552457908844"}
Jul 17 18:44:06.230056 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:06.229696    2572 scope.go:117] "RemoveContainer" containerID="f8d2c8c2431f5adaedf09156a98af38371cc523c083b3e3d7555db0125c3c7ac"
Jul 17 18:44:06.230056 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:06.229839    2572 scope.go:117] "RemoveContainer" containerID="2e83111f5158d55fc17347e78c87a7dad8437a207ce52cc66c78552457908844"
Jul 17 18:44:06.230238 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:44:06.230090    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a5b144da-sg4wx_odh-ai-gateway-infra(70592cc7-1b70-4652-9a57-301cc12f7b8b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-sg4wx" podUID="70592cc7-1b70-4652-9a57-301cc12f7b8b"
Jul 17 18:44:07.236751 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:07.236720    2572 scope.go:117] "RemoveContainer" containerID="2e83111f5158d55fc17347e78c87a7dad8437a207ce52cc66c78552457908844"
Jul 17 18:44:07.237189 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:44:07.236909    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a5b144da-sg4wx_odh-ai-gateway-infra(70592cc7-1b70-4652-9a57-301cc12f7b8b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-sg4wx" podUID="70592cc7-1b70-4652-9a57-301cc12f7b8b"
Jul 17 18:44:10.485561 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:10.485523    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"]
Jul 17 18:44:10.486051 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:10.485744    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2" podUID="f377470c-84e4-4287-a00b-494c8c39e0f4" containerName="istio-proxy" containerID="cri-o://fff4782a7237394293e9d75f7c80515deb5ebef57a2c33160daab0d839d2bb8c" gracePeriod=30
Jul 17 18:44:10.688953 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:10.688917    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:44:10.789068 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:10.788958    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:44:11.092265 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.092173    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:44:11.381469 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.381374    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"]
Jul 17 18:44:11.386267 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.386243    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:11.388647 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.388625    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-a03eb5-openshift-default-dockercfg-4dlrj\""
Jul 17 18:44:11.398761 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.398728    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"]
Jul 17 18:44:11.414279 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.414248    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:44:11.483255 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.483211    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-istio-podinfo\") pod \"e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") " pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:11.483465 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.483291    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2khj\" (UniqueName: \"kubernetes.io/projected/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-kube-api-access-r2khj\") pod \"e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") " pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:11.483465 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.483323    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-istiod-ca-cert\") pod \"e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") " pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:11.483465 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.483365    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-workload-certs\") pod \"e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") " pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:11.483465 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.483394    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-istio-envoy\") pod \"e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") " pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:11.483465 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.483440    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-istio-data\") pod \"e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") " pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:11.483697 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.483485    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-credential-socket\") pod \"e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") " pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:11.483697 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.483527    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-workload-socket\") pod \"e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") " pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:11.483697 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.483554    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-istio-token\") pod \"e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") " pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:11.584246 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.584210    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-workload-socket\") pod \"e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") " pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:11.584767 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.584254    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-istio-token\") pod \"e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") " pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:11.584767 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.584356    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-istio-podinfo\") pod \"e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") " pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:11.584767 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.584392    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2khj\" (UniqueName: \"kubernetes.io/projected/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-kube-api-access-r2khj\") pod \"e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") " pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:11.584767 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.584419    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-istiod-ca-cert\") pod \"e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") " pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:11.584767 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.584461    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-workload-certs\") pod \"e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") " pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:11.584767 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.584494    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-istio-envoy\") pod \"e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") " pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:11.584767 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.584518    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-istio-data\") pod \"e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") " pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:11.584767 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.584547    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-credential-socket\") pod \"e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") " pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:11.584767 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.584667    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-workload-socket\") pod \"e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") " pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:11.585317 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.584773    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:44:11.585317 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.584858    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-workload-certs\") pod \"e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") " pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:11.585317 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.584883    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-credential-socket\") pod \"e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") " pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:11.585317 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.585189    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-istio-data\") pod \"e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") " pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:11.585462 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.585358    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-istiod-ca-cert\") pod \"e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") " pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:11.586872 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.586849    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-istio-envoy\") pod \"e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") " pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:11.587079 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.587060    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-istio-podinfo\") pod \"e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") " pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:11.592536 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.592513    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-istio-token\") pod \"e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") " pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:11.592536 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.592528    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2khj\" (UniqueName: \"kubernetes.io/projected/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-kube-api-access-r2khj\") pod \"e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") " pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:11.696372 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.696348    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:11.844907 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.844864    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"]
Jul 17 18:44:11.846713 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:44:11.846677    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf518f7ac_dff7_45f0_b35a_a15024bf1ae6.slice/crio-ab8fbd0e8eaa9f13f08d0ebea0a10c083c592bb76cfa2f552fe34bb3ff7dff65 WatchSource:0}: Error finding container ab8fbd0e8eaa9f13f08d0ebea0a10c083c592bb76cfa2f552fe34bb3ff7dff65: Status 404 returned error can't find the container with id ab8fbd0e8eaa9f13f08d0ebea0a10c083c592bb76cfa2f552fe34bb3ff7dff65
Jul 17 18:44:11.849045 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.848982    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:44:11.849141 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.849098    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:44:11.849177 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:11.849140    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:44:12.263731 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:12.263697    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj" event={"ID":"f518f7ac-dff7-45f0-b35a-a15024bf1ae6","Type":"ContainerStarted","Data":"cf4756329d658736ceebf6613d42fa54a83cb1edf2c490070982ece2bdfaaa77"}
Jul 17 18:44:12.263922 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:12.263750    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj" event={"ID":"f518f7ac-dff7-45f0-b35a-a15024bf1ae6","Type":"ContainerStarted","Data":"ab8fbd0e8eaa9f13f08d0ebea0a10c083c592bb76cfa2f552fe34bb3ff7dff65"}
Jul 17 18:44:12.285918 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:12.285858    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj" podStartSLOduration=1.285839088 podStartE2EDuration="1.285839088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:44:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:44:12.283271084 +0000 UTC m=+2879.508500398" watchObservedRunningTime="2026-07-17 18:44:12.285839088 +0000 UTC m=+2879.511068396"
Jul 17 18:44:12.696513 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:12.696480    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:12.701574 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:12.701548    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:13.269068 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:13.269034    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:13.270122 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:13.270102    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:13.962735 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:13.962703    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:44:14.060069 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:14.060029    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:44:14.235733 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:14.235696    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:44:14.313230 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:14.313200    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh"]
Jul 17 18:44:14.318710 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:14.318685    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh"
Jul 17 18:44:14.321222 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:14.321195    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-a03eb5-serving-cert\""
Jul 17 18:44:14.322927 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:14.322901    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:44:14.332205 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:14.332179    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh"]
Jul 17 18:44:14.394330 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:14.394290    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:44:14.411800 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:14.411761    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1818c7db-5419-4da1-9ebe-22847b0d5a10-maas-api-tls\") pod \"maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh\" (UID: \"1818c7db-5419-4da1-9ebe-22847b0d5a10\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh"
Jul 17 18:44:14.412676 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:14.411839    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbrbt\" (UniqueName: \"kubernetes.io/projected/1818c7db-5419-4da1-9ebe-22847b0d5a10-kube-api-access-vbrbt\") pod \"maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh\" (UID: \"1818c7db-5419-4da1-9ebe-22847b0d5a10\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh"
Jul 17 18:44:14.412676 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:14.412017    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1818c7db-5419-4da1-9ebe-22847b0d5a10-openshift-service-ca\") pod \"maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh\" (UID: \"1818c7db-5419-4da1-9ebe-22847b0d5a10\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh"
Jul 17 18:44:14.512593 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:14.512484    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1818c7db-5419-4da1-9ebe-22847b0d5a10-openshift-service-ca\") pod \"maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh\" (UID: \"1818c7db-5419-4da1-9ebe-22847b0d5a10\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh"
Jul 17 18:44:14.512593 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:14.512586    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1818c7db-5419-4da1-9ebe-22847b0d5a10-maas-api-tls\") pod \"maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh\" (UID: \"1818c7db-5419-4da1-9ebe-22847b0d5a10\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh"
Jul 17 18:44:14.512810 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:14.512616    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbrbt\" (UniqueName: \"kubernetes.io/projected/1818c7db-5419-4da1-9ebe-22847b0d5a10-kube-api-access-vbrbt\") pod \"maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh\" (UID: \"1818c7db-5419-4da1-9ebe-22847b0d5a10\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh"
Jul 17 18:44:14.513264 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:14.513238    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1818c7db-5419-4da1-9ebe-22847b0d5a10-openshift-service-ca\") pod \"maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh\" (UID: \"1818c7db-5419-4da1-9ebe-22847b0d5a10\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh"
Jul 17 18:44:14.515344 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:14.515323    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1818c7db-5419-4da1-9ebe-22847b0d5a10-maas-api-tls\") pod \"maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh\" (UID: \"1818c7db-5419-4da1-9ebe-22847b0d5a10\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh"
Jul 17 18:44:14.525322 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:14.525298    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbrbt\" (UniqueName: \"kubernetes.io/projected/1818c7db-5419-4da1-9ebe-22847b0d5a10-kube-api-access-vbrbt\") pod \"maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh\" (UID: \"1818c7db-5419-4da1-9ebe-22847b0d5a10\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh"
Jul 17 18:44:14.567633 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:14.567587    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:44:14.631734 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:14.631696    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh"
Jul 17 18:44:14.771535 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:14.771510    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh"]
Jul 17 18:44:14.773741 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:44:14.773712    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1818c7db_5419_4da1_9ebe_22847b0d5a10.slice/crio-b18a8c0e82580089b817504e2646162653b30640ac9665b7b552600fe64474e5 WatchSource:0}: Error finding container b18a8c0e82580089b817504e2646162653b30640ac9665b7b552600fe64474e5: Status 404 returned error can't find the container with id b18a8c0e82580089b817504e2646162653b30640ac9665b7b552600fe64474e5
Jul 17 18:44:14.775167 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:14.775146    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 18:44:14.912413 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:14.912381    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:44:15.280473 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:15.280437    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh" event={"ID":"1818c7db-5419-4da1-9ebe-22847b0d5a10","Type":"ContainerStarted","Data":"b18a8c0e82580089b817504e2646162653b30640ac9665b7b552600fe64474e5"}
Jul 17 18:44:15.739736 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:15.739711    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:44:15.825965 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:15.825876    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f377470c-84e4-4287-a00b-494c8c39e0f4-workload-socket\") pod \"f377470c-84e4-4287-a00b-494c8c39e0f4\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") "
Jul 17 18:44:15.825965 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:15.825924    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f377470c-84e4-4287-a00b-494c8c39e0f4-istio-podinfo\") pod \"f377470c-84e4-4287-a00b-494c8c39e0f4\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") "
Jul 17 18:44:15.826185 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:15.826066    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f377470c-84e4-4287-a00b-494c8c39e0f4-istio-data\") pod \"f377470c-84e4-4287-a00b-494c8c39e0f4\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") "
Jul 17 18:44:15.826185 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:15.826094    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgqm5\" (UniqueName: \"kubernetes.io/projected/f377470c-84e4-4287-a00b-494c8c39e0f4-kube-api-access-fgqm5\") pod \"f377470c-84e4-4287-a00b-494c8c39e0f4\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") "
Jul 17 18:44:15.826185 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:15.826140    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f377470c-84e4-4287-a00b-494c8c39e0f4-credential-socket\") pod \"f377470c-84e4-4287-a00b-494c8c39e0f4\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") "
Jul 17 18:44:15.826185 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:15.826174    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f377470c-84e4-4287-a00b-494c8c39e0f4-workload-certs\") pod \"f377470c-84e4-4287-a00b-494c8c39e0f4\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") "
Jul 17 18:44:15.826395 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:15.826195    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f377470c-84e4-4287-a00b-494c8c39e0f4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f377470c-84e4-4287-a00b-494c8c39e0f4" (UID: "f377470c-84e4-4287-a00b-494c8c39e0f4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:44:15.826395 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:15.826217    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f377470c-84e4-4287-a00b-494c8c39e0f4-istio-token\") pod \"f377470c-84e4-4287-a00b-494c8c39e0f4\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") "
Jul 17 18:44:15.826395 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:15.826261    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f377470c-84e4-4287-a00b-494c8c39e0f4-istio-envoy\") pod \"f377470c-84e4-4287-a00b-494c8c39e0f4\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") "
Jul 17 18:44:15.826395 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:15.826277    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f377470c-84e4-4287-a00b-494c8c39e0f4-istiod-ca-cert\") pod \"f377470c-84e4-4287-a00b-494c8c39e0f4\" (UID: \"f377470c-84e4-4287-a00b-494c8c39e0f4\") "
Jul 17 18:44:15.826618 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:15.826462    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f377470c-84e4-4287-a00b-494c8c39e0f4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f377470c-84e4-4287-a00b-494c8c39e0f4" (UID: "f377470c-84e4-4287-a00b-494c8c39e0f4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:44:15.826618 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:15.826481    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f377470c-84e4-4287-a00b-494c8c39e0f4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f377470c-84e4-4287-a00b-494c8c39e0f4" (UID: "f377470c-84e4-4287-a00b-494c8c39e0f4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:44:15.826728 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:15.826644    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f377470c-84e4-4287-a00b-494c8c39e0f4-credential-socket\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:44:15.826728 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:15.826663    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f377470c-84e4-4287-a00b-494c8c39e0f4-workload-certs\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:44:15.826728 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:15.826678    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f377470c-84e4-4287-a00b-494c8c39e0f4-workload-socket\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:44:15.826884 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:15.826769    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f377470c-84e4-4287-a00b-494c8c39e0f4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f377470c-84e4-4287-a00b-494c8c39e0f4" (UID: "f377470c-84e4-4287-a00b-494c8c39e0f4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:44:15.826884 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:15.826808    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f377470c-84e4-4287-a00b-494c8c39e0f4-istio-data" (OuterVolumeSpecName: "istio-data") pod "f377470c-84e4-4287-a00b-494c8c39e0f4" (UID: "f377470c-84e4-4287-a00b-494c8c39e0f4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:44:15.828296 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:15.828270    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f377470c-84e4-4287-a00b-494c8c39e0f4-kube-api-access-fgqm5" (OuterVolumeSpecName: "kube-api-access-fgqm5") pod "f377470c-84e4-4287-a00b-494c8c39e0f4" (UID: "f377470c-84e4-4287-a00b-494c8c39e0f4"). InnerVolumeSpecName "kube-api-access-fgqm5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:44:15.828465 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:15.828441    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f377470c-84e4-4287-a00b-494c8c39e0f4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f377470c-84e4-4287-a00b-494c8c39e0f4" (UID: "f377470c-84e4-4287-a00b-494c8c39e0f4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:44:15.828672 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:15.828653    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f377470c-84e4-4287-a00b-494c8c39e0f4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f377470c-84e4-4287-a00b-494c8c39e0f4" (UID: "f377470c-84e4-4287-a00b-494c8c39e0f4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 18:44:15.828672 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:15.828657    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f377470c-84e4-4287-a00b-494c8c39e0f4-istio-token" (OuterVolumeSpecName: "istio-token") pod "f377470c-84e4-4287-a00b-494c8c39e0f4" (UID: "f377470c-84e4-4287-a00b-494c8c39e0f4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:44:15.927880 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:15.927840    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f377470c-84e4-4287-a00b-494c8c39e0f4-istio-data\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:44:15.927880 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:15.927873    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgqm5\" (UniqueName: \"kubernetes.io/projected/f377470c-84e4-4287-a00b-494c8c39e0f4-kube-api-access-fgqm5\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:44:15.927880 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:15.927885    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f377470c-84e4-4287-a00b-494c8c39e0f4-istio-token\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:44:15.928161 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:15.927897    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f377470c-84e4-4287-a00b-494c8c39e0f4-istio-envoy\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:44:15.928161 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:15.927909    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f377470c-84e4-4287-a00b-494c8c39e0f4-istiod-ca-cert\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:44:15.928161 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:15.927919    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f377470c-84e4-4287-a00b-494c8c39e0f4-istio-podinfo\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:44:16.287504 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:16.287472    2572 generic.go:356] "Generic (PLEG): container finished" podID="f377470c-84e4-4287-a00b-494c8c39e0f4" containerID="fff4782a7237394293e9d75f7c80515deb5ebef57a2c33160daab0d839d2bb8c" exitCode=0
Jul 17 18:44:16.287945 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:16.287522    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"
Jul 17 18:44:16.287945 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:16.287558    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2" event={"ID":"f377470c-84e4-4287-a00b-494c8c39e0f4","Type":"ContainerDied","Data":"fff4782a7237394293e9d75f7c80515deb5ebef57a2c33160daab0d839d2bb8c"}
Jul 17 18:44:16.287945 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:16.287625    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2" event={"ID":"f377470c-84e4-4287-a00b-494c8c39e0f4","Type":"ContainerDied","Data":"2903057f5adbd5e7dc292a902c5301355b9c2d534f936a98c28ff2313a555e9b"}
Jul 17 18:44:16.287945 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:16.287660    2572 scope.go:117] "RemoveContainer" containerID="fff4782a7237394293e9d75f7c80515deb5ebef57a2c33160daab0d839d2bb8c"
Jul 17 18:44:16.296873 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:16.296852    2572 scope.go:117] "RemoveContainer" containerID="d0a047b5361a91bb149ddc9b2195b82a965c67dd982fc46eb04f3d9d69a84ddb"
Jul 17 18:44:16.305517 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:16.305497    2572 scope.go:117] "RemoveContainer" containerID="fff4782a7237394293e9d75f7c80515deb5ebef57a2c33160daab0d839d2bb8c"
Jul 17 18:44:16.305783 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:44:16.305766    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fff4782a7237394293e9d75f7c80515deb5ebef57a2c33160daab0d839d2bb8c\": container with ID starting with fff4782a7237394293e9d75f7c80515deb5ebef57a2c33160daab0d839d2bb8c not found: ID does not exist" containerID="fff4782a7237394293e9d75f7c80515deb5ebef57a2c33160daab0d839d2bb8c"
Jul 17 18:44:16.305826 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:16.305792    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fff4782a7237394293e9d75f7c80515deb5ebef57a2c33160daab0d839d2bb8c"} err="failed to get container status \"fff4782a7237394293e9d75f7c80515deb5ebef57a2c33160daab0d839d2bb8c\": rpc error: code = NotFound desc = could not find container \"fff4782a7237394293e9d75f7c80515deb5ebef57a2c33160daab0d839d2bb8c\": container with ID starting with fff4782a7237394293e9d75f7c80515deb5ebef57a2c33160daab0d839d2bb8c not found: ID does not exist"
Jul 17 18:44:16.305826 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:16.305810    2572 scope.go:117] "RemoveContainer" containerID="d0a047b5361a91bb149ddc9b2195b82a965c67dd982fc46eb04f3d9d69a84ddb"
Jul 17 18:44:16.306035 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:44:16.306019    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0a047b5361a91bb149ddc9b2195b82a965c67dd982fc46eb04f3d9d69a84ddb\": container with ID starting with d0a047b5361a91bb149ddc9b2195b82a965c67dd982fc46eb04f3d9d69a84ddb not found: ID does not exist" containerID="d0a047b5361a91bb149ddc9b2195b82a965c67dd982fc46eb04f3d9d69a84ddb"
Jul 17 18:44:16.306094 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:16.306039    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0a047b5361a91bb149ddc9b2195b82a965c67dd982fc46eb04f3d9d69a84ddb"} err="failed to get container status \"d0a047b5361a91bb149ddc9b2195b82a965c67dd982fc46eb04f3d9d69a84ddb\": rpc error: code = NotFound desc = could not find container \"d0a047b5361a91bb149ddc9b2195b82a965c67dd982fc46eb04f3d9d69a84ddb\": container with ID starting with d0a047b5361a91bb149ddc9b2195b82a965c67dd982fc46eb04f3d9d69a84ddb not found: ID does not exist"
Jul 17 18:44:16.309908 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:16.309884    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"]
Jul 17 18:44:16.313716 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:16.313694    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-3be95b-openshift-default-5c9b69fff9-qlsd2"]
Jul 17 18:44:16.466100 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:16.466067    2572 scope.go:117] "RemoveContainer" containerID="6e3073def6c234ddc9b8c6fa5b693aee70e80524286498c933cc4fe89dfc0ebe"
Jul 17 18:44:17.295582 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:17.295546    2572 generic.go:356] "Generic (PLEG): container finished" podID="af61cb09-02e8-41a9-941a-4ed5e69be168" containerID="919a57fe1a364819a09bc7bad43e938cea0f6bdaff2cc3092c9e91278b96ec7d" exitCode=6
Jul 17 18:44:17.295582 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:17.295584    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-2gv29" event={"ID":"af61cb09-02e8-41a9-941a-4ed5e69be168","Type":"ContainerDied","Data":"919a57fe1a364819a09bc7bad43e938cea0f6bdaff2cc3092c9e91278b96ec7d"}
Jul 17 18:44:17.296069 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:17.295641    2572 scope.go:117] "RemoveContainer" containerID="6e3073def6c234ddc9b8c6fa5b693aee70e80524286498c933cc4fe89dfc0ebe"
Jul 17 18:44:17.296069 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:17.295923    2572 scope.go:117] "RemoveContainer" containerID="919a57fe1a364819a09bc7bad43e938cea0f6bdaff2cc3092c9e91278b96ec7d"
Jul 17 18:44:17.296229 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:44:17.296195    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-2gv29_odh-ai-gateway-infra(af61cb09-02e8-41a9-941a-4ed5e69be168)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-2gv29" podUID="af61cb09-02e8-41a9-941a-4ed5e69be168"
Jul 17 18:44:17.471550 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:17.471514    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f377470c-84e4-4287-a00b-494c8c39e0f4" path="/var/lib/kubelet/pods/f377470c-84e4-4287-a00b-494c8c39e0f4/volumes"
Jul 17 18:44:18.325582 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:18.325539    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-2gv29"]
Jul 17 18:44:18.472910 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:18.472874    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-2gv29"
Jul 17 18:44:18.554613 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:18.554579    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af61cb09-02e8-41a9-941a-4ed5e69be168-maas-api-service-ca\") pod \"af61cb09-02e8-41a9-941a-4ed5e69be168\" (UID: \"af61cb09-02e8-41a9-941a-4ed5e69be168\") "
Jul 17 18:44:18.554947 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:18.554923    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/af61cb09-02e8-41a9-941a-4ed5e69be168-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "af61cb09-02e8-41a9-941a-4ed5e69be168" (UID: "af61cb09-02e8-41a9-941a-4ed5e69be168"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:44:18.656381 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:18.656284    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/af61cb09-02e8-41a9-941a-4ed5e69be168-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:44:19.314500 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.314464    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-2gv29"
Jul 17 18:44:19.314663 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.314470    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-2gv29" event={"ID":"af61cb09-02e8-41a9-941a-4ed5e69be168","Type":"ContainerDied","Data":"864371f21e4280592c5c0eae5222f531df58f2b4fcb69b67b62ab7d2546fc50d"}
Jul 17 18:44:19.314663 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.314606    2572 scope.go:117] "RemoveContainer" containerID="919a57fe1a364819a09bc7bad43e938cea0f6bdaff2cc3092c9e91278b96ec7d"
Jul 17 18:44:19.337215 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.337185    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-2gv29"]
Jul 17 18:44:19.342749 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.342724    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-2gv29"]
Jul 17 18:44:19.471854 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.471817    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af61cb09-02e8-41a9-941a-4ed5e69be168" path="/var/lib/kubelet/pods/af61cb09-02e8-41a9-941a-4ed5e69be168/volumes"
Jul 17 18:44:19.538595 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.538562    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"]
Jul 17 18:44:19.538991 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.538977    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f377470c-84e4-4287-a00b-494c8c39e0f4" containerName="istio-proxy"
Jul 17 18:44:19.539060 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.538992    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f377470c-84e4-4287-a00b-494c8c39e0f4" containerName="istio-proxy"
Jul 17 18:44:19.539060 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.539012    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af61cb09-02e8-41a9-941a-4ed5e69be168" containerName="revoke-keys"
Jul 17 18:44:19.539060 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.539018    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="af61cb09-02e8-41a9-941a-4ed5e69be168" containerName="revoke-keys"
Jul 17 18:44:19.539060 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.539049    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af61cb09-02e8-41a9-941a-4ed5e69be168" containerName="revoke-keys"
Jul 17 18:44:19.539060 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.539056    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="af61cb09-02e8-41a9-941a-4ed5e69be168" containerName="revoke-keys"
Jul 17 18:44:19.539276 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.539113    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f377470c-84e4-4287-a00b-494c8c39e0f4" containerName="istio-proxy"
Jul 17 18:44:19.539276 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.539125    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="af61cb09-02e8-41a9-941a-4ed5e69be168" containerName="revoke-keys"
Jul 17 18:44:19.539276 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.539138    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="af61cb09-02e8-41a9-941a-4ed5e69be168" containerName="revoke-keys"
Jul 17 18:44:19.543701 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.543681    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:19.546149 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.546126    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-9de544-openshift-default-dockercfg-sr9nn\""
Jul 17 18:44:19.557520 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.557498    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"]
Jul 17 18:44:19.665178 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.665080    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e675d7b9-c89d-4e06-bb84-d3392b01d895-workload-socket\") pod \"e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") " pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:19.665178 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.665126    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e675d7b9-c89d-4e06-bb84-d3392b01d895-istiod-ca-cert\") pod \"e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") " pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:19.665178 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.665147    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e675d7b9-c89d-4e06-bb84-d3392b01d895-istio-envoy\") pod \"e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") " pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:19.665178 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.665172    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e675d7b9-c89d-4e06-bb84-d3392b01d895-istio-data\") pod \"e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") " pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:19.665431 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.665225    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e675d7b9-c89d-4e06-bb84-d3392b01d895-workload-certs\") pod \"e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") " pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:19.665431 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.665253    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47gww\" (UniqueName: \"kubernetes.io/projected/e675d7b9-c89d-4e06-bb84-d3392b01d895-kube-api-access-47gww\") pod \"e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") " pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:19.665431 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.665286    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e675d7b9-c89d-4e06-bb84-d3392b01d895-istio-podinfo\") pod \"e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") " pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:19.665431 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.665313    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e675d7b9-c89d-4e06-bb84-d3392b01d895-credential-socket\") pod \"e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") " pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:19.665431 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.665354    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e675d7b9-c89d-4e06-bb84-d3392b01d895-istio-token\") pod \"e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") " pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:19.766224 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.766184    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e675d7b9-c89d-4e06-bb84-d3392b01d895-workload-socket\") pod \"e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") " pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:19.766224 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.766227    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e675d7b9-c89d-4e06-bb84-d3392b01d895-istiod-ca-cert\") pod \"e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") " pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:19.766499 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.766247    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e675d7b9-c89d-4e06-bb84-d3392b01d895-istio-envoy\") pod \"e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") " pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:19.766499 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.766361    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e675d7b9-c89d-4e06-bb84-d3392b01d895-istio-data\") pod \"e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") " pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:19.766499 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.766424    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e675d7b9-c89d-4e06-bb84-d3392b01d895-workload-certs\") pod \"e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") " pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:19.766499 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.766449    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47gww\" (UniqueName: \"kubernetes.io/projected/e675d7b9-c89d-4e06-bb84-d3392b01d895-kube-api-access-47gww\") pod \"e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") " pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:19.766709 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.766506    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e675d7b9-c89d-4e06-bb84-d3392b01d895-istio-podinfo\") pod \"e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") " pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:19.766709 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.766555    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e675d7b9-c89d-4e06-bb84-d3392b01d895-credential-socket\") pod \"e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") " pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:19.766709 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.766609    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e675d7b9-c89d-4e06-bb84-d3392b01d895-istio-token\") pod \"e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") " pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:19.766871 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.766718    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e675d7b9-c89d-4e06-bb84-d3392b01d895-istio-data\") pod \"e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") " pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:19.766871 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.766800    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e675d7b9-c89d-4e06-bb84-d3392b01d895-workload-certs\") pod \"e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") " pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:19.766979 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.766925    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e675d7b9-c89d-4e06-bb84-d3392b01d895-workload-socket\") pod \"e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") " pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:19.767050 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.766973    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e675d7b9-c89d-4e06-bb84-d3392b01d895-credential-socket\") pod \"e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") " pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:19.767088 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.767052    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e675d7b9-c89d-4e06-bb84-d3392b01d895-istiod-ca-cert\") pod \"e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") " pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:19.768600 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.768578    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e675d7b9-c89d-4e06-bb84-d3392b01d895-istio-envoy\") pod \"e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") " pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:19.768956 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.768936    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e675d7b9-c89d-4e06-bb84-d3392b01d895-istio-podinfo\") pod \"e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") " pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:19.774676 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.774646    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e675d7b9-c89d-4e06-bb84-d3392b01d895-istio-token\") pod \"e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") " pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:19.774815 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.774771    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47gww\" (UniqueName: \"kubernetes.io/projected/e675d7b9-c89d-4e06-bb84-d3392b01d895-kube-api-access-47gww\") pod \"e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") " pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:19.855257 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:19.855215    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:20.003754 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:20.003714    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"]
Jul 17 18:44:20.006027 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:44:20.005980    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode675d7b9_c89d_4e06_bb84_d3392b01d895.slice/crio-42cab088e7073f7501373a972752d94fe4fd7879352105d830100267da3f799e WatchSource:0}: Error finding container 42cab088e7073f7501373a972752d94fe4fd7879352105d830100267da3f799e: Status 404 returned error can't find the container with id 42cab088e7073f7501373a972752d94fe4fd7879352105d830100267da3f799e
Jul 17 18:44:20.008271 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:20.008240    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:44:20.008348 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:20.008307    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:44:20.008348 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:20.008337    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:44:20.321556 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:20.321442    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd" event={"ID":"e675d7b9-c89d-4e06-bb84-d3392b01d895","Type":"ContainerStarted","Data":"878998f02a3ed8d1f8754dc7968522e5af0accc959dc63fa9a51078bc51c3b11"}
Jul 17 18:44:20.321556 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:20.321506    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd" event={"ID":"e675d7b9-c89d-4e06-bb84-d3392b01d895","Type":"ContainerStarted","Data":"42cab088e7073f7501373a972752d94fe4fd7879352105d830100267da3f799e"}
Jul 17 18:44:20.343401 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:20.343328    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd" podStartSLOduration=1.34330391 podStartE2EDuration="1.34330391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:44:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:44:20.340211805 +0000 UTC m=+2887.565441114" watchObservedRunningTime="2026-07-17 18:44:20.34330391 +0000 UTC m=+2887.568533219"
Jul 17 18:44:20.856192 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:20.856138    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:21.465706 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:21.465668    2572 scope.go:117] "RemoveContainer" containerID="2e83111f5158d55fc17347e78c87a7dad8437a207ce52cc66c78552457908844"
Jul 17 18:44:21.861188 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:21.861148    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:22.335713 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:22.335664    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-sg4wx" event={"ID":"70592cc7-1b70-4652-9a57-301cc12f7b8b","Type":"ContainerStarted","Data":"5b3b2580cf72fbbb583979c67b90d5447aa7c5efa1a682b1e779136c9d5b0e66"}
Jul 17 18:44:22.335955 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:22.335933    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:22.337026 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:22.336986    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:22.403370 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:22.403293    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9de544-5769f86b98-lxv44"]
Jul 17 18:44:22.405424 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:22.403886    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af61cb09-02e8-41a9-941a-4ed5e69be168" containerName="revoke-keys"
Jul 17 18:44:22.405424 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:22.403908    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="af61cb09-02e8-41a9-941a-4ed5e69be168" containerName="revoke-keys"
Jul 17 18:44:22.405424 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:22.403928    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f377470c-84e4-4287-a00b-494c8c39e0f4" containerName="istio-proxy"
Jul 17 18:44:22.405424 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:22.403935    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f377470c-84e4-4287-a00b-494c8c39e0f4" containerName="istio-proxy"
Jul 17 18:44:22.405424 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:22.404043    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f377470c-84e4-4287-a00b-494c8c39e0f4" containerName="istio-proxy"
Jul 17 18:44:22.405424 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:22.404062    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="af61cb09-02e8-41a9-941a-4ed5e69be168" containerName="revoke-keys"
Jul 17 18:44:22.407694 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:22.407670    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9de544-5769f86b98-lxv44"
Jul 17 18:44:22.410883 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:22.410862    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-9de544-serving-cert\""
Jul 17 18:44:22.419247 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:22.419221    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9de544-5769f86b98-lxv44"]
Jul 17 18:44:22.503696 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:22.503652    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc57a83e-0e03-4615-a82a-29a6b86168e3-openshift-service-ca\") pod \"maas-api-e2e-api-b-9de544-5769f86b98-lxv44\" (UID: \"fc57a83e-0e03-4615-a82a-29a6b86168e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9de544-5769f86b98-lxv44"
Jul 17 18:44:22.504119 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:22.503807    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74rkw\" (UniqueName: \"kubernetes.io/projected/fc57a83e-0e03-4615-a82a-29a6b86168e3-kube-api-access-74rkw\") pod \"maas-api-e2e-api-b-9de544-5769f86b98-lxv44\" (UID: \"fc57a83e-0e03-4615-a82a-29a6b86168e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9de544-5769f86b98-lxv44"
Jul 17 18:44:22.504119 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:22.503959    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc57a83e-0e03-4615-a82a-29a6b86168e3-maas-api-tls\") pod \"maas-api-e2e-api-b-9de544-5769f86b98-lxv44\" (UID: \"fc57a83e-0e03-4615-a82a-29a6b86168e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9de544-5769f86b98-lxv44"
Jul 17 18:44:22.605386 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:22.605298    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc57a83e-0e03-4615-a82a-29a6b86168e3-maas-api-tls\") pod \"maas-api-e2e-api-b-9de544-5769f86b98-lxv44\" (UID: \"fc57a83e-0e03-4615-a82a-29a6b86168e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9de544-5769f86b98-lxv44"
Jul 17 18:44:22.605570 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:22.605390    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc57a83e-0e03-4615-a82a-29a6b86168e3-openshift-service-ca\") pod \"maas-api-e2e-api-b-9de544-5769f86b98-lxv44\" (UID: \"fc57a83e-0e03-4615-a82a-29a6b86168e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9de544-5769f86b98-lxv44"
Jul 17 18:44:22.605570 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:22.605452    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74rkw\" (UniqueName: \"kubernetes.io/projected/fc57a83e-0e03-4615-a82a-29a6b86168e3-kube-api-access-74rkw\") pod \"maas-api-e2e-api-b-9de544-5769f86b98-lxv44\" (UID: \"fc57a83e-0e03-4615-a82a-29a6b86168e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9de544-5769f86b98-lxv44"
Jul 17 18:44:22.606134 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:22.606108    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc57a83e-0e03-4615-a82a-29a6b86168e3-openshift-service-ca\") pod \"maas-api-e2e-api-b-9de544-5769f86b98-lxv44\" (UID: \"fc57a83e-0e03-4615-a82a-29a6b86168e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9de544-5769f86b98-lxv44"
Jul 17 18:44:22.607974 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:22.607943    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc57a83e-0e03-4615-a82a-29a6b86168e3-maas-api-tls\") pod \"maas-api-e2e-api-b-9de544-5769f86b98-lxv44\" (UID: \"fc57a83e-0e03-4615-a82a-29a6b86168e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9de544-5769f86b98-lxv44"
Jul 17 18:44:22.614011 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:22.613972    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74rkw\" (UniqueName: \"kubernetes.io/projected/fc57a83e-0e03-4615-a82a-29a6b86168e3-kube-api-access-74rkw\") pod \"maas-api-e2e-api-b-9de544-5769f86b98-lxv44\" (UID: \"fc57a83e-0e03-4615-a82a-29a6b86168e3\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9de544-5769f86b98-lxv44"
Jul 17 18:44:22.723304 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:22.723269    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9de544-5769f86b98-lxv44"
Jul 17 18:44:22.911605 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:22.911512    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9de544-5769f86b98-lxv44"]
Jul 17 18:44:22.913933 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:44:22.913893    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc57a83e_0e03_4615_a82a_29a6b86168e3.slice/crio-5edb600aeeed572d2f5e6ec452111b5a5c15d721fc100bf8175a44c64fd4a923 WatchSource:0}: Error finding container 5edb600aeeed572d2f5e6ec452111b5a5c15d721fc100bf8175a44c64fd4a923: Status 404 returned error can't find the container with id 5edb600aeeed572d2f5e6ec452111b5a5c15d721fc100bf8175a44c64fd4a923
Jul 17 18:44:23.343954 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:23.343166    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9de544-5769f86b98-lxv44" event={"ID":"fc57a83e-0e03-4615-a82a-29a6b86168e3","Type":"ContainerStarted","Data":"5edb600aeeed572d2f5e6ec452111b5a5c15d721fc100bf8175a44c64fd4a923"}
Jul 17 18:44:23.349218 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:23.349182    2572 generic.go:356] "Generic (PLEG): container finished" podID="70592cc7-1b70-4652-9a57-301cc12f7b8b" containerID="5b3b2580cf72fbbb583979c67b90d5447aa7c5efa1a682b1e779136c9d5b0e66" exitCode=6
Jul 17 18:44:23.350254 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:23.350208    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-sg4wx" event={"ID":"70592cc7-1b70-4652-9a57-301cc12f7b8b","Type":"ContainerDied","Data":"5b3b2580cf72fbbb583979c67b90d5447aa7c5efa1a682b1e779136c9d5b0e66"}
Jul 17 18:44:23.350499 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:23.350469    2572 scope.go:117] "RemoveContainer" containerID="2e83111f5158d55fc17347e78c87a7dad8437a207ce52cc66c78552457908844"
Jul 17 18:44:23.350909 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:23.350889    2572 scope.go:117] "RemoveContainer" containerID="5b3b2580cf72fbbb583979c67b90d5447aa7c5efa1a682b1e779136c9d5b0e66"
Jul 17 18:44:23.351320 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:44:23.351292    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-a5b144da-sg4wx_odh-ai-gateway-infra(70592cc7-1b70-4652-9a57-301cc12f7b8b)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-sg4wx" podUID="70592cc7-1b70-4652-9a57-301cc12f7b8b"
Jul 17 18:44:23.380447 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:23.378696    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-sg4wx"]
Jul 17 18:44:24.356160 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:24.356122    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9de544-5769f86b98-lxv44" event={"ID":"fc57a83e-0e03-4615-a82a-29a6b86168e3","Type":"ContainerStarted","Data":"dfcd09dfce7666a984a8b264169ada20c00c90f5fabfc971033e17f9f4250b17"}
Jul 17 18:44:24.356624 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:24.356227    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9de544-5769f86b98-lxv44"
Jul 17 18:44:24.392647 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:24.377309    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9de544-5769f86b98-lxv44" podStartSLOduration=1.965570618 podStartE2EDuration="2.377286601s" totalImagesPullingTime="411.715983ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:44:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:44:24.37544221 +0000 UTC m=+2891.600671519" watchObservedRunningTime="2026-07-17 18:44:24.377286601 +0000 UTC m=+2891.602515910"
Jul 17 18:44:24.590417 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:24.590386    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-sg4wx"
Jul 17 18:44:24.726649 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:24.726613    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70592cc7-1b70-4652-9a57-301cc12f7b8b-maas-api-service-ca\") pod \"70592cc7-1b70-4652-9a57-301cc12f7b8b\" (UID: \"70592cc7-1b70-4652-9a57-301cc12f7b8b\") "
Jul 17 18:44:24.726951 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:24.726928    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70592cc7-1b70-4652-9a57-301cc12f7b8b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "70592cc7-1b70-4652-9a57-301cc12f7b8b" (UID: "70592cc7-1b70-4652-9a57-301cc12f7b8b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:44:24.828176 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:24.828135    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/70592cc7-1b70-4652-9a57-301cc12f7b8b-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:44:24.984428 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:24.984336    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:44:25.038189 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:25.038152    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:44:25.364766 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:25.364682    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-sg4wx"
Jul 17 18:44:25.364766 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:25.364721    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-sg4wx" event={"ID":"70592cc7-1b70-4652-9a57-301cc12f7b8b","Type":"ContainerDied","Data":"9576c0d45c1f4d6f13bab2dfbd88c1ca09b7a201324508c0ca87a97929e66bba"}
Jul 17 18:44:25.365281 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:25.364782    2572 scope.go:117] "RemoveContainer" containerID="5b3b2580cf72fbbb583979c67b90d5447aa7c5efa1a682b1e779136c9d5b0e66"
Jul 17 18:44:25.387512 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:25.387477    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-sg4wx"]
Jul 17 18:44:25.390724 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:25.390696    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a5b144da-sg4wx"]
Jul 17 18:44:25.472135 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:25.472093    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70592cc7-1b70-4652-9a57-301cc12f7b8b" path="/var/lib/kubelet/pods/70592cc7-1b70-4652-9a57-301cc12f7b8b/volumes"
Jul 17 18:44:26.841687 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:26.841648    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:44:28.271255 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:28.271209    2572 patch_prober.go:28] interesting pod/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Jul 17 18:44:28.271695 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:28.271269    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj" podUID="f518f7ac-dff7-45f0-b35a-a15024bf1ae6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Jul 17 18:44:28.382919 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:28.382889    2572 generic.go:356] "Generic (PLEG): container finished" podID="f518f7ac-dff7-45f0-b35a-a15024bf1ae6" containerID="cf4756329d658736ceebf6613d42fa54a83cb1edf2c490070982ece2bdfaaa77" exitCode=0
Jul 17 18:44:28.383121 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:28.382969    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj" event={"ID":"f518f7ac-dff7-45f0-b35a-a15024bf1ae6","Type":"ContainerDied","Data":"cf4756329d658736ceebf6613d42fa54a83cb1edf2c490070982ece2bdfaaa77"}
Jul 17 18:44:28.383459 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:28.383443    2572 scope.go:117] "RemoveContainer" containerID="cf4756329d658736ceebf6613d42fa54a83cb1edf2c490070982ece2bdfaaa77"
Jul 17 18:44:28.384589 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:28.384555    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:44:28.384658 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:28.384624    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:44:28.384658 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:28.384655    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:44:29.392528 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:29.392483    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj" event={"ID":"f518f7ac-dff7-45f0-b35a-a15024bf1ae6","Type":"ContainerStarted","Data":"79aef43847f32eb23dfa39ab7544d93f394fa5f1c71fe5fbb499158ea2508e56"}
Jul 17 18:44:29.697430 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:29.697397    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:29.697694 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:29.697668    2572 patch_prober.go:28] interesting pod/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Jul 17 18:44:29.697792 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:29.697726    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj" podUID="f518f7ac-dff7-45f0-b35a-a15024bf1ae6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Jul 17 18:44:30.383314 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:30.383275    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9de544-5769f86b98-lxv44"
Jul 17 18:44:30.697230 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:30.697190    2572 patch_prober.go:28] interesting pod/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Jul 17 18:44:30.697649 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:30.697263    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj" podUID="f518f7ac-dff7-45f0-b35a-a15024bf1ae6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Jul 17 18:44:31.696756 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:31.696716    2572 patch_prober.go:28] interesting pod/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Jul 17 18:44:31.697122 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:31.696785    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj" podUID="f518f7ac-dff7-45f0-b35a-a15024bf1ae6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Jul 17 18:44:32.697234 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:32.697198    2572 patch_prober.go:28] interesting pod/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused" start-of-body=
Jul 17 18:44:32.697723 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:32.697693    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj" podUID="f518f7ac-dff7-45f0-b35a-a15024bf1ae6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.100:15021/healthz/ready\": dial tcp 10.132.0.100:15021: connect: connection refused"
Jul 17 18:44:33.701385 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:33.701352    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:33.701790 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:33.701702    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:33.702426 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:33.702406    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:44:35.679239 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:35.679202    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:44:35.780156 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:35.780118    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:44:43.467362 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:43.467325    2572 generic.go:356] "Generic (PLEG): container finished" podID="e675d7b9-c89d-4e06-bb84-d3392b01d895" containerID="878998f02a3ed8d1f8754dc7968522e5af0accc959dc63fa9a51078bc51c3b11" exitCode=0
Jul 17 18:44:43.471787 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:43.471754    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd" event={"ID":"e675d7b9-c89d-4e06-bb84-d3392b01d895","Type":"ContainerDied","Data":"878998f02a3ed8d1f8754dc7968522e5af0accc959dc63fa9a51078bc51c3b11"}
Jul 17 18:44:43.472253 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:43.472235    2572 scope.go:117] "RemoveContainer" containerID="878998f02a3ed8d1f8754dc7968522e5af0accc959dc63fa9a51078bc51c3b11"
Jul 17 18:44:43.473305 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:43.473274    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:44:43.473418 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:43.473359    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:44:43.473418 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:43.473406    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:44:44.480012 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:44.479959    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd" event={"ID":"e675d7b9-c89d-4e06-bb84-d3392b01d895","Type":"ContainerStarted","Data":"ba7795c03363b3da010572dc51de880b62cdcc2f1bcd4d0aae39eaca80c93a18"}
Jul 17 18:44:44.855662 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:44.855562    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:44.855907 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:44.855878    2572 patch_prober.go:28] interesting pod/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Jul 17 18:44:44.855964 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:44.855935    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd" podUID="e675d7b9-c89d-4e06-bb84-d3392b01d895" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Jul 17 18:44:45.070866 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:45.070822    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:44:45.172787 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:45.172681    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:44:45.856453 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:45.856406    2572 patch_prober.go:28] interesting pod/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Jul 17 18:44:45.856853 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:45.856472    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd" podUID="e675d7b9-c89d-4e06-bb84-d3392b01d895" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Jul 17 18:44:46.856411 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:46.856371    2572 patch_prober.go:28] interesting pod/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Jul 17 18:44:46.856608 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:46.856429    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd" podUID="e675d7b9-c89d-4e06-bb84-d3392b01d895" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Jul 17 18:44:47.856187 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:47.856153    2572 patch_prober.go:28] interesting pod/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused" start-of-body=
Jul 17 18:44:47.856366 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:47.856218    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd" podUID="e675d7b9-c89d-4e06-bb84-d3392b01d895" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.102:15021/healthz/ready\": dial tcp 10.132.0.102:15021: connect: connection refused"
Jul 17 18:44:48.860191 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:48.860157    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:48.860657 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:48.860564    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:48.861182 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:48.861166    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:44:56.455385 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:56.455347    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:44:56.554453 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:44:56.554412    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:45:19.092359 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:45:19.092315    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:45:19.190715 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:45:19.190668    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:45:37.847920 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:45:37.847829    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:45:38.120859 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:45:38.120764    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:46:13.653439 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:46:13.653409    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tp9qm_6c101a17-a051-4e9d-a9dd-f72c67ba2a8a/console-operator/2.log"
Jul 17 18:46:13.660079 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:46:13.660056    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5mdx_2e3bd369-576e-4df1-8a76-aebd537cde58/ovn-acl-logging/0.log"
Jul 17 18:46:13.697088 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:46:13.697066    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tp9qm_6c101a17-a051-4e9d-a9dd-f72c67ba2a8a/console-operator/2.log"
Jul 17 18:46:13.703448 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:46:13.703426    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5mdx_2e3bd369-576e-4df1-8a76-aebd537cde58/ovn-acl-logging/0.log"
Jul 17 18:46:19.664499 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:46:19.664464    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:46:35.062589 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:46:35.062549    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:46:35.163192 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:46:35.163151    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:46:45.165917 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:46:45.165879    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:49:33.175065 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:49:33.175020    2572 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/maas-api@sha256:c91b03a0d904eb33ec5027aeedd2dc70805b0587d0509b07c941ff0b628734aa: pinging container registry quay.io: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image" image="quay.io/opendatahub/maas-api@sha256:c91b03a0d904eb33ec5027aeedd2dc70805b0587d0509b07c941ff0b628734aa"
Jul 17 18:49:33.175626 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:49:33.175137    2572 kuberuntime_manager.go:1459] "Unhandled Error" err="container maas-api start failed in pod maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh_odh-ai-gateway-infra(1818c7db-5419-4da1-9ebe-22847b0d5a10): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/maas-api@sha256:c91b03a0d904eb33ec5027aeedd2dc70805b0587d0509b07c941ff0b628734aa: pinging container registry quay.io: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image" logger="UnhandledError"
Jul 17 18:49:33.175626 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:49:33.175170    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/maas-api@sha256:c91b03a0d904eb33ec5027aeedd2dc70805b0587d0509b07c941ff0b628734aa: pinging container registry quay.io: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image\"" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh" podUID="1818c7db-5419-4da1-9ebe-22847b0d5a10"
Jul 17 18:49:33.960583 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:49:33.960558    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 18:49:33.960757 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:49:33.960729    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/opendatahub/maas-api@sha256:c91b03a0d904eb33ec5027aeedd2dc70805b0587d0509b07c941ff0b628734aa\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/opendatahub/maas-api@sha256:c91b03a0d904eb33ec5027aeedd2dc70805b0587d0509b07c941ff0b628734aa: pinging container registry quay.io: received unexpected HTTP status: 502 Bad Gateway; artifact err: provided artifact is a container image\"" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh" podUID="1818c7db-5419-4da1-9ebe-22847b0d5a10"
Jul 17 18:49:45.989419 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:49:45.989370    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:49:46.076859 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:49:46.076828    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:49:47.027264 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:49:47.027227    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh" event={"ID":"1818c7db-5419-4da1-9ebe-22847b0d5a10","Type":"ContainerStarted","Data":"217dd9c97bc634d6b1c1821d9fdfbbc6eca734e0ef50f9ee1fe6e52ec473e50b"}
Jul 17 18:49:47.027688 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:49:47.027439    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh"
Jul 17 18:49:47.051231 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:49:47.051182    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh" podStartSLOduration=0.942063548 podStartE2EDuration="5m33.051166s" totalImagesPullingTime="5m32.109102452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:44:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-17 18:49:47.050160439 +0000 UTC m=+3214.275389747" watchObservedRunningTime="2026-07-17 18:49:47.051166 +0000 UTC m=+3214.276395307"
Jul 17 18:49:50.569050 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:49:50.568991    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:49:50.669715 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:49:50.669680    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:49:53.037922 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:49:53.037894    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh"
Jul 17 18:50:14.364043 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:14.363987    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:50:19.822581 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:19.822542    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:50:19.920936 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:19.920897    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:50:20.748837 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:20.748789    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:50:20.848142 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:20.848108    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:50:30.532197 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:30.532148    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh"]
Jul 17 18:50:30.532767 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:30.532459    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh" podUID="1818c7db-5419-4da1-9ebe-22847b0d5a10" containerName="maas-api" containerID="cri-o://217dd9c97bc634d6b1c1821d9fdfbbc6eca734e0ef50f9ee1fe6e52ec473e50b" gracePeriod=30
Jul 17 18:50:30.559051 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:30.558993    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:50:30.793172 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:30.793106    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh"
Jul 17 18:50:30.848631 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:30.848601    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbrbt\" (UniqueName: \"kubernetes.io/projected/1818c7db-5419-4da1-9ebe-22847b0d5a10-kube-api-access-vbrbt\") pod \"1818c7db-5419-4da1-9ebe-22847b0d5a10\" (UID: \"1818c7db-5419-4da1-9ebe-22847b0d5a10\") "
Jul 17 18:50:30.848801 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:30.848639    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1818c7db-5419-4da1-9ebe-22847b0d5a10-openshift-service-ca\") pod \"1818c7db-5419-4da1-9ebe-22847b0d5a10\" (UID: \"1818c7db-5419-4da1-9ebe-22847b0d5a10\") "
Jul 17 18:50:30.848801 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:30.848772    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1818c7db-5419-4da1-9ebe-22847b0d5a10-maas-api-tls\") pod \"1818c7db-5419-4da1-9ebe-22847b0d5a10\" (UID: \"1818c7db-5419-4da1-9ebe-22847b0d5a10\") "
Jul 17 18:50:30.849051 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:30.849026    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1818c7db-5419-4da1-9ebe-22847b0d5a10-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1818c7db-5419-4da1-9ebe-22847b0d5a10" (UID: "1818c7db-5419-4da1-9ebe-22847b0d5a10"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:50:30.849174 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:30.849148    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1818c7db-5419-4da1-9ebe-22847b0d5a10-openshift-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:50:30.850787 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:30.850763    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1818c7db-5419-4da1-9ebe-22847b0d5a10-kube-api-access-vbrbt" (OuterVolumeSpecName: "kube-api-access-vbrbt") pod "1818c7db-5419-4da1-9ebe-22847b0d5a10" (UID: "1818c7db-5419-4da1-9ebe-22847b0d5a10"). InnerVolumeSpecName "kube-api-access-vbrbt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:50:30.850903 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:30.850884    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1818c7db-5419-4da1-9ebe-22847b0d5a10-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1818c7db-5419-4da1-9ebe-22847b0d5a10" (UID: "1818c7db-5419-4da1-9ebe-22847b0d5a10"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 18:50:30.949623 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:30.949588    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbrbt\" (UniqueName: \"kubernetes.io/projected/1818c7db-5419-4da1-9ebe-22847b0d5a10-kube-api-access-vbrbt\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:50:30.949623 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:30.949617    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1818c7db-5419-4da1-9ebe-22847b0d5a10-maas-api-tls\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:50:31.247884 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:31.247848    2572 generic.go:356] "Generic (PLEG): container finished" podID="1818c7db-5419-4da1-9ebe-22847b0d5a10" containerID="217dd9c97bc634d6b1c1821d9fdfbbc6eca734e0ef50f9ee1fe6e52ec473e50b" exitCode=0
Jul 17 18:50:31.247884 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:31.247899    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh"
Jul 17 18:50:31.248224 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:31.247938    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh" event={"ID":"1818c7db-5419-4da1-9ebe-22847b0d5a10","Type":"ContainerDied","Data":"217dd9c97bc634d6b1c1821d9fdfbbc6eca734e0ef50f9ee1fe6e52ec473e50b"}
Jul 17 18:50:31.248224 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:31.248032    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh" event={"ID":"1818c7db-5419-4da1-9ebe-22847b0d5a10","Type":"ContainerDied","Data":"b18a8c0e82580089b817504e2646162653b30640ac9665b7b552600fe64474e5"}
Jul 17 18:50:31.248224 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:31.248066    2572 scope.go:117] "RemoveContainer" containerID="217dd9c97bc634d6b1c1821d9fdfbbc6eca734e0ef50f9ee1fe6e52ec473e50b"
Jul 17 18:50:31.257775 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:31.257758    2572 scope.go:117] "RemoveContainer" containerID="217dd9c97bc634d6b1c1821d9fdfbbc6eca734e0ef50f9ee1fe6e52ec473e50b"
Jul 17 18:50:31.258076 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:50:31.257993    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"217dd9c97bc634d6b1c1821d9fdfbbc6eca734e0ef50f9ee1fe6e52ec473e50b\": container with ID starting with 217dd9c97bc634d6b1c1821d9fdfbbc6eca734e0ef50f9ee1fe6e52ec473e50b not found: ID does not exist" containerID="217dd9c97bc634d6b1c1821d9fdfbbc6eca734e0ef50f9ee1fe6e52ec473e50b"
Jul 17 18:50:31.258153 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:31.258086    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"217dd9c97bc634d6b1c1821d9fdfbbc6eca734e0ef50f9ee1fe6e52ec473e50b"} err="failed to get container status \"217dd9c97bc634d6b1c1821d9fdfbbc6eca734e0ef50f9ee1fe6e52ec473e50b\": rpc error: code = NotFound desc = could not find container \"217dd9c97bc634d6b1c1821d9fdfbbc6eca734e0ef50f9ee1fe6e52ec473e50b\": container with ID starting with 217dd9c97bc634d6b1c1821d9fdfbbc6eca734e0ef50f9ee1fe6e52ec473e50b not found: ID does not exist"
Jul 17 18:50:31.269628 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:31.269604    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh"]
Jul 17 18:50:31.272760 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:31.272737    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a03eb5-975548bcd-sqtrh"]
Jul 17 18:50:31.471669 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:31.471633    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1818c7db-5419-4da1-9ebe-22847b0d5a10" path="/var/lib/kubelet/pods/1818c7db-5419-4da1-9ebe-22847b0d5a10/volumes"
Jul 17 18:50:35.189721 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:35.189680    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:50:41.020124 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:41.020072    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:50:41.081200 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:41.081170    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:50:45.854609 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:45.854572    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"]
Jul 17 18:50:45.855139 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:45.854815    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj" podUID="f518f7ac-dff7-45f0-b35a-a15024bf1ae6" containerName="istio-proxy" containerID="cri-o://79aef43847f32eb23dfa39ab7544d93f394fa5f1c71fe5fbb499158ea2508e56" gracePeriod=30
Jul 17 18:50:45.879842 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:45.879798    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:50:46.127023 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:46.126893    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:50:46.753985 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:46.753947    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:50:46.854767 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:46.854732    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:50:48.704225 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:48.704185    2572 patch_prober.go:28] interesting pod/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 18:50:48.704640 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:48.704266    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj" podUID="f518f7ac-dff7-45f0-b35a-a15024bf1ae6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 18:50:51.119307 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.119242    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:50:51.246186 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.246152    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-istio-envoy\") pod \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") "
Jul 17 18:50:51.246186 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.246191    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-workload-certs\") pod \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") "
Jul 17 18:50:51.246422 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.246213    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-istio-token\") pod \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") "
Jul 17 18:50:51.246422 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.246254    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-istio-podinfo\") pod \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") "
Jul 17 18:50:51.246422 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.246284    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-workload-socket\") pod \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") "
Jul 17 18:50:51.246422 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.246326    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2khj\" (UniqueName: \"kubernetes.io/projected/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-kube-api-access-r2khj\") pod \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") "
Jul 17 18:50:51.246422 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.246395    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-istio-data\") pod \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") "
Jul 17 18:50:51.246694 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.246424    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-istiod-ca-cert\") pod \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") "
Jul 17 18:50:51.246694 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.246462    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-credential-socket\") pod \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\" (UID: \"f518f7ac-dff7-45f0-b35a-a15024bf1ae6\") "
Jul 17 18:50:51.246694 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.246532    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f518f7ac-dff7-45f0-b35a-a15024bf1ae6" (UID: "f518f7ac-dff7-45f0-b35a-a15024bf1ae6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:50:51.246872 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.246779    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f518f7ac-dff7-45f0-b35a-a15024bf1ae6" (UID: "f518f7ac-dff7-45f0-b35a-a15024bf1ae6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:50:51.246872 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.246826    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-workload-certs\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:50:51.247081 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.247058    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f518f7ac-dff7-45f0-b35a-a15024bf1ae6" (UID: "f518f7ac-dff7-45f0-b35a-a15024bf1ae6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:50:51.247188 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.247097    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f518f7ac-dff7-45f0-b35a-a15024bf1ae6" (UID: "f518f7ac-dff7-45f0-b35a-a15024bf1ae6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:50:51.247466 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.247444    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-istio-data" (OuterVolumeSpecName: "istio-data") pod "f518f7ac-dff7-45f0-b35a-a15024bf1ae6" (UID: "f518f7ac-dff7-45f0-b35a-a15024bf1ae6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:50:51.248802 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.248769    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-kube-api-access-r2khj" (OuterVolumeSpecName: "kube-api-access-r2khj") pod "f518f7ac-dff7-45f0-b35a-a15024bf1ae6" (UID: "f518f7ac-dff7-45f0-b35a-a15024bf1ae6"). InnerVolumeSpecName "kube-api-access-r2khj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:50:51.248802 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.248786    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f518f7ac-dff7-45f0-b35a-a15024bf1ae6" (UID: "f518f7ac-dff7-45f0-b35a-a15024bf1ae6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:50:51.248973 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.248958    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f518f7ac-dff7-45f0-b35a-a15024bf1ae6" (UID: "f518f7ac-dff7-45f0-b35a-a15024bf1ae6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 18:50:51.249048 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.248985    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-istio-token" (OuterVolumeSpecName: "istio-token") pod "f518f7ac-dff7-45f0-b35a-a15024bf1ae6" (UID: "f518f7ac-dff7-45f0-b35a-a15024bf1ae6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:50:51.347776 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.347744    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-istio-data\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:50:51.347776 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.347769    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-istiod-ca-cert\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:50:51.347776 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.347779    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-credential-socket\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:50:51.348058 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.347789    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-istio-envoy\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:50:51.348058 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.347797    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-istio-token\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:50:51.348058 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.347804    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-istio-podinfo\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:50:51.348058 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.347812    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-workload-socket\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:50:51.348058 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.347820    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2khj\" (UniqueName: \"kubernetes.io/projected/f518f7ac-dff7-45f0-b35a-a15024bf1ae6-kube-api-access-r2khj\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:50:51.352152 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.352125    2572 generic.go:356] "Generic (PLEG): container finished" podID="f518f7ac-dff7-45f0-b35a-a15024bf1ae6" containerID="79aef43847f32eb23dfa39ab7544d93f394fa5f1c71fe5fbb499158ea2508e56" exitCode=0
Jul 17 18:50:51.352288 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.352178    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"
Jul 17 18:50:51.352288 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.352188    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj" event={"ID":"f518f7ac-dff7-45f0-b35a-a15024bf1ae6","Type":"ContainerDied","Data":"79aef43847f32eb23dfa39ab7544d93f394fa5f1c71fe5fbb499158ea2508e56"}
Jul 17 18:50:51.352288 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.352230    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj" event={"ID":"f518f7ac-dff7-45f0-b35a-a15024bf1ae6","Type":"ContainerDied","Data":"ab8fbd0e8eaa9f13f08d0ebea0a10c083c592bb76cfa2f552fe34bb3ff7dff65"}
Jul 17 18:50:51.352288 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.352251    2572 scope.go:117] "RemoveContainer" containerID="79aef43847f32eb23dfa39ab7544d93f394fa5f1c71fe5fbb499158ea2508e56"
Jul 17 18:50:51.361720 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.361698    2572 scope.go:117] "RemoveContainer" containerID="cf4756329d658736ceebf6613d42fa54a83cb1edf2c490070982ece2bdfaaa77"
Jul 17 18:50:51.370390 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.370370    2572 scope.go:117] "RemoveContainer" containerID="79aef43847f32eb23dfa39ab7544d93f394fa5f1c71fe5fbb499158ea2508e56"
Jul 17 18:50:51.370676 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:50:51.370658    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79aef43847f32eb23dfa39ab7544d93f394fa5f1c71fe5fbb499158ea2508e56\": container with ID starting with 79aef43847f32eb23dfa39ab7544d93f394fa5f1c71fe5fbb499158ea2508e56 not found: ID does not exist" containerID="79aef43847f32eb23dfa39ab7544d93f394fa5f1c71fe5fbb499158ea2508e56"
Jul 17 18:50:51.370721 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.370686    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79aef43847f32eb23dfa39ab7544d93f394fa5f1c71fe5fbb499158ea2508e56"} err="failed to get container status \"79aef43847f32eb23dfa39ab7544d93f394fa5f1c71fe5fbb499158ea2508e56\": rpc error: code = NotFound desc = could not find container \"79aef43847f32eb23dfa39ab7544d93f394fa5f1c71fe5fbb499158ea2508e56\": container with ID starting with 79aef43847f32eb23dfa39ab7544d93f394fa5f1c71fe5fbb499158ea2508e56 not found: ID does not exist"
Jul 17 18:50:51.370721 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.370705    2572 scope.go:117] "RemoveContainer" containerID="cf4756329d658736ceebf6613d42fa54a83cb1edf2c490070982ece2bdfaaa77"
Jul 17 18:50:51.370943 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:50:51.370921    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf4756329d658736ceebf6613d42fa54a83cb1edf2c490070982ece2bdfaaa77\": container with ID starting with cf4756329d658736ceebf6613d42fa54a83cb1edf2c490070982ece2bdfaaa77 not found: ID does not exist" containerID="cf4756329d658736ceebf6613d42fa54a83cb1edf2c490070982ece2bdfaaa77"
Jul 17 18:50:51.371010 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.370951    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf4756329d658736ceebf6613d42fa54a83cb1edf2c490070982ece2bdfaaa77"} err="failed to get container status \"cf4756329d658736ceebf6613d42fa54a83cb1edf2c490070982ece2bdfaaa77\": rpc error: code = NotFound desc = could not find container \"cf4756329d658736ceebf6613d42fa54a83cb1edf2c490070982ece2bdfaaa77\": container with ID starting with cf4756329d658736ceebf6613d42fa54a83cb1edf2c490070982ece2bdfaaa77 not found: ID does not exist"
Jul 17 18:50:51.374360 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.374327    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"]
Jul 17 18:50:51.377239 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.377218    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-a03eb5-openshift-default-6c4b56bcff-r5jrj"]
Jul 17 18:50:51.471368 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:51.471338    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f518f7ac-dff7-45f0-b35a-a15024bf1ae6" path="/var/lib/kubelet/pods/f518f7ac-dff7-45f0-b35a-a15024bf1ae6/volumes"
Jul 17 18:50:56.665965 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:56.665927    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9de544-5769f86b98-lxv44"]
Jul 17 18:50:56.666434 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:56.666178    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9de544-5769f86b98-lxv44" podUID="fc57a83e-0e03-4615-a82a-29a6b86168e3" containerName="maas-api" containerID="cri-o://dfcd09dfce7666a984a8b264169ada20c00c90f5fabfc971033e17f9f4250b17" gracePeriod=30
Jul 17 18:50:56.696247 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:56.696216    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:50:56.920485 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:56.920422    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9de544-5769f86b98-lxv44"
Jul 17 18:50:57.001434 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:57.001387    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc57a83e-0e03-4615-a82a-29a6b86168e3-maas-api-tls\") pod \"fc57a83e-0e03-4615-a82a-29a6b86168e3\" (UID: \"fc57a83e-0e03-4615-a82a-29a6b86168e3\") "
Jul 17 18:50:57.001646 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:57.001463    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc57a83e-0e03-4615-a82a-29a6b86168e3-openshift-service-ca\") pod \"fc57a83e-0e03-4615-a82a-29a6b86168e3\" (UID: \"fc57a83e-0e03-4615-a82a-29a6b86168e3\") "
Jul 17 18:50:57.001646 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:57.001497    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74rkw\" (UniqueName: \"kubernetes.io/projected/fc57a83e-0e03-4615-a82a-29a6b86168e3-kube-api-access-74rkw\") pod \"fc57a83e-0e03-4615-a82a-29a6b86168e3\" (UID: \"fc57a83e-0e03-4615-a82a-29a6b86168e3\") "
Jul 17 18:50:57.001847 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:57.001822    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc57a83e-0e03-4615-a82a-29a6b86168e3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fc57a83e-0e03-4615-a82a-29a6b86168e3" (UID: "fc57a83e-0e03-4615-a82a-29a6b86168e3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:50:57.003580 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:57.003553    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc57a83e-0e03-4615-a82a-29a6b86168e3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fc57a83e-0e03-4615-a82a-29a6b86168e3" (UID: "fc57a83e-0e03-4615-a82a-29a6b86168e3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 18:50:57.003694 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:57.003623    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc57a83e-0e03-4615-a82a-29a6b86168e3-kube-api-access-74rkw" (OuterVolumeSpecName: "kube-api-access-74rkw") pod "fc57a83e-0e03-4615-a82a-29a6b86168e3" (UID: "fc57a83e-0e03-4615-a82a-29a6b86168e3"). InnerVolumeSpecName "kube-api-access-74rkw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:50:57.102779 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:57.102746    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fc57a83e-0e03-4615-a82a-29a6b86168e3-maas-api-tls\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:50:57.102779 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:57.102776    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fc57a83e-0e03-4615-a82a-29a6b86168e3-openshift-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:50:57.102779 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:57.102786    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74rkw\" (UniqueName: \"kubernetes.io/projected/fc57a83e-0e03-4615-a82a-29a6b86168e3-kube-api-access-74rkw\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:50:57.383469 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:57.383435    2572 generic.go:356] "Generic (PLEG): container finished" podID="fc57a83e-0e03-4615-a82a-29a6b86168e3" containerID="dfcd09dfce7666a984a8b264169ada20c00c90f5fabfc971033e17f9f4250b17" exitCode=0
Jul 17 18:50:57.383652 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:57.383487    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9de544-5769f86b98-lxv44"
Jul 17 18:50:57.383652 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:57.383522    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9de544-5769f86b98-lxv44" event={"ID":"fc57a83e-0e03-4615-a82a-29a6b86168e3","Type":"ContainerDied","Data":"dfcd09dfce7666a984a8b264169ada20c00c90f5fabfc971033e17f9f4250b17"}
Jul 17 18:50:57.383652 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:57.383587    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9de544-5769f86b98-lxv44" event={"ID":"fc57a83e-0e03-4615-a82a-29a6b86168e3","Type":"ContainerDied","Data":"5edb600aeeed572d2f5e6ec452111b5a5c15d721fc100bf8175a44c64fd4a923"}
Jul 17 18:50:57.383652 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:57.383618    2572 scope.go:117] "RemoveContainer" containerID="dfcd09dfce7666a984a8b264169ada20c00c90f5fabfc971033e17f9f4250b17"
Jul 17 18:50:57.392950 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:57.392933    2572 scope.go:117] "RemoveContainer" containerID="dfcd09dfce7666a984a8b264169ada20c00c90f5fabfc971033e17f9f4250b17"
Jul 17 18:50:57.393291 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:50:57.393267    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfcd09dfce7666a984a8b264169ada20c00c90f5fabfc971033e17f9f4250b17\": container with ID starting with dfcd09dfce7666a984a8b264169ada20c00c90f5fabfc971033e17f9f4250b17 not found: ID does not exist" containerID="dfcd09dfce7666a984a8b264169ada20c00c90f5fabfc971033e17f9f4250b17"
Jul 17 18:50:57.393372 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:57.393300    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfcd09dfce7666a984a8b264169ada20c00c90f5fabfc971033e17f9f4250b17"} err="failed to get container status \"dfcd09dfce7666a984a8b264169ada20c00c90f5fabfc971033e17f9f4250b17\": rpc error: code = NotFound desc = could not find container \"dfcd09dfce7666a984a8b264169ada20c00c90f5fabfc971033e17f9f4250b17\": container with ID starting with dfcd09dfce7666a984a8b264169ada20c00c90f5fabfc971033e17f9f4250b17 not found: ID does not exist"
Jul 17 18:50:57.404605 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:57.404577    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9de544-5769f86b98-lxv44"]
Jul 17 18:50:57.409897 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:57.409872    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9de544-5769f86b98-lxv44"]
Jul 17 18:50:57.472115 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:50:57.472085    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc57a83e-0e03-4615-a82a-29a6b86168e3" path="/var/lib/kubelet/pods/fc57a83e-0e03-4615-a82a-29a6b86168e3/volumes"
Jul 17 18:51:01.339675 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:01.339645    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:51:08.256907 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:08.256848    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:51:08.353615 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:08.353574    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:51:12.034424 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:12.034381    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"]
Jul 17 18:51:12.034855 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:12.034655    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd" podUID="e675d7b9-c89d-4e06-bb84-d3392b01d895" containerName="istio-proxy" containerID="cri-o://ba7795c03363b3da010572dc51de880b62cdcc2f1bcd4d0aae39eaca80c93a18" gracePeriod=30
Jul 17 18:51:12.056203 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:12.056157    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:51:12.552061 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:12.551982    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:51:12.672901 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:12.672827    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:51:12.971072 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:12.971029    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"]
Jul 17 18:51:12.971454 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:12.971435    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f518f7ac-dff7-45f0-b35a-a15024bf1ae6" containerName="istio-proxy"
Jul 17 18:51:12.971454 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:12.971453    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f518f7ac-dff7-45f0-b35a-a15024bf1ae6" containerName="istio-proxy"
Jul 17 18:51:12.971629 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:12.971464    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70592cc7-1b70-4652-9a57-301cc12f7b8b" containerName="revoke-keys"
Jul 17 18:51:12.971629 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:12.971470    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="70592cc7-1b70-4652-9a57-301cc12f7b8b" containerName="revoke-keys"
Jul 17 18:51:12.971629 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:12.971476    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc57a83e-0e03-4615-a82a-29a6b86168e3" containerName="maas-api"
Jul 17 18:51:12.971629 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:12.971482    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc57a83e-0e03-4615-a82a-29a6b86168e3" containerName="maas-api"
Jul 17 18:51:12.971629 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:12.971493    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1818c7db-5419-4da1-9ebe-22847b0d5a10" containerName="maas-api"
Jul 17 18:51:12.971629 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:12.971500    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1818c7db-5419-4da1-9ebe-22847b0d5a10" containerName="maas-api"
Jul 17 18:51:12.971629 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:12.971517    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70592cc7-1b70-4652-9a57-301cc12f7b8b" containerName="revoke-keys"
Jul 17 18:51:12.971629 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:12.971527    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="70592cc7-1b70-4652-9a57-301cc12f7b8b" containerName="revoke-keys"
Jul 17 18:51:12.971629 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:12.971606    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="70592cc7-1b70-4652-9a57-301cc12f7b8b" containerName="revoke-keys"
Jul 17 18:51:12.971629 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:12.971616    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="70592cc7-1b70-4652-9a57-301cc12f7b8b" containerName="revoke-keys"
Jul 17 18:51:12.971629 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:12.971621    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f518f7ac-dff7-45f0-b35a-a15024bf1ae6" containerName="istio-proxy"
Jul 17 18:51:12.971629 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:12.971629    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1818c7db-5419-4da1-9ebe-22847b0d5a10" containerName="maas-api"
Jul 17 18:51:12.971629 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:12.971635    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f518f7ac-dff7-45f0-b35a-a15024bf1ae6" containerName="istio-proxy"
Jul 17 18:51:12.972317 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:12.971641    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc57a83e-0e03-4615-a82a-29a6b86168e3" containerName="maas-api"
Jul 17 18:51:12.976450 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:12.976426    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:12.978791 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:12.978769    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-7d6f90-openshift-default-dockercfg-lwcn2\""
Jul 17 18:51:12.987293 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:12.987225    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"]
Jul 17 18:51:13.007431 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.007397    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:51:13.056422 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.056390    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-credential-socket\") pod \"e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") " pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:13.056824 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.056444    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-istiod-ca-cert\") pod \"e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") " pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:13.056824 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.056513    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-workload-certs\") pod \"e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") " pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:13.056824 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.056551    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-istio-envoy\") pod \"e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") " pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:13.056824 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.056578    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-workload-socket\") pod \"e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") " pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:13.056824 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.056637    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-istio-data\") pod \"e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") " pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:13.056824 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.056662    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-istio-token\") pod \"e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") " pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:13.056824 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.056704    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4876\" (UniqueName: \"kubernetes.io/projected/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-kube-api-access-z4876\") pod \"e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") " pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:13.056824 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.056737    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-istio-podinfo\") pod \"e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") " pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:13.157935 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.157899    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4876\" (UniqueName: \"kubernetes.io/projected/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-kube-api-access-z4876\") pod \"e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") " pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:13.157935 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.157940    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-istio-podinfo\") pod \"e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") " pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:13.158206 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.157983    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-credential-socket\") pod \"e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") " pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:13.158206 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.158030    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-istiod-ca-cert\") pod \"e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") " pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:13.158206 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.158057    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-workload-certs\") pod \"e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") " pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:13.158206 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.158084    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-istio-envoy\") pod \"e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") " pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:13.158206 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.158100    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-workload-socket\") pod \"e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") " pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:13.158451 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.158127    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-istio-data\") pod \"e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") " pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:13.158451 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.158316    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-istio-token\") pod \"e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") " pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:13.158612 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.158580    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-workload-certs\") pod \"e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") " pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:13.158746 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.158691    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-credential-socket\") pod \"e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") " pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:13.158746 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.158731    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-workload-socket\") pod \"e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") " pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:13.158852 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.158798    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-istio-data\") pod \"e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") " pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:13.158944 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.158925    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-istiod-ca-cert\") pod \"e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") " pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:13.160537 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.160511    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-istio-envoy\") pod \"e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") " pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:13.160641 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.160609    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-istio-podinfo\") pod \"e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") " pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:13.166772 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.166737    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-istio-token\") pod \"e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") " pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:13.167127 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.167104    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4876\" (UniqueName: \"kubernetes.io/projected/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-kube-api-access-z4876\") pod \"e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") " pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:13.193274 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.193227    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:51:13.288838 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.288741    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:13.433613 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.433587    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"]
Jul 17 18:51:13.435594 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:51:13.435564    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3bfe354_ed35_4322_bf5f_e8ec4491cedf.slice/crio-82fe1f4c1afa78169dbe9bb31126c3775aceb3752c1bf0de2c02a5a03d4c6091 WatchSource:0}: Error finding container 82fe1f4c1afa78169dbe9bb31126c3775aceb3752c1bf0de2c02a5a03d4c6091: Status 404 returned error can't find the container with id 82fe1f4c1afa78169dbe9bb31126c3775aceb3752c1bf0de2c02a5a03d4c6091
Jul 17 18:51:13.437877 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.437838    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:51:13.437945 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.437925    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:51:13.438041 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.437983    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:51:13.471235 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.471207    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt" event={"ID":"b3bfe354-ed35-4322-bf5f-e8ec4491cedf","Type":"ContainerStarted","Data":"82fe1f4c1afa78169dbe9bb31126c3775aceb3752c1bf0de2c02a5a03d4c6091"}
Jul 17 18:51:13.691074 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.691046    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tp9qm_6c101a17-a051-4e9d-a9dd-f72c67ba2a8a/console-operator/2.log"
Jul 17 18:51:13.698706 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.698678    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5mdx_2e3bd369-576e-4df1-8a76-aebd537cde58/ovn-acl-logging/0.log"
Jul 17 18:51:13.729779 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.729753    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tp9qm_6c101a17-a051-4e9d-a9dd-f72c67ba2a8a/console-operator/2.log"
Jul 17 18:51:13.735922 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:13.735901    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5mdx_2e3bd369-576e-4df1-8a76-aebd537cde58/ovn-acl-logging/0.log"
Jul 17 18:51:14.471303 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:14.471266    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt" event={"ID":"b3bfe354-ed35-4322-bf5f-e8ec4491cedf","Type":"ContainerStarted","Data":"f0e19435a05ebe2648e80ec2f3aa73ca69d9957d0c291af18a5c1b47208edfca"}
Jul 17 18:51:14.490676 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:14.490618    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt" podStartSLOduration=2.490600893 podStartE2EDuration="2.490600893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:51:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:51:14.488832549 +0000 UTC m=+3301.714061856" watchObservedRunningTime="2026-07-17 18:51:14.490600893 +0000 UTC m=+3301.715830201"
Jul 17 18:51:15.289497 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:15.289456    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:15.294826 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:15.294794    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:15.475604 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:15.475568    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:15.476629 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:15.476609    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:16.472131 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:16.472101    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:51:16.571549 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:16.571516    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:51:16.634266 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:16.634225    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74"]
Jul 17 18:51:16.634810 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:16.634793    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70592cc7-1b70-4652-9a57-301cc12f7b8b" containerName="revoke-keys"
Jul 17 18:51:16.634880 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:16.634814    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="70592cc7-1b70-4652-9a57-301cc12f7b8b" containerName="revoke-keys"
Jul 17 18:51:16.634880 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:16.634845    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f518f7ac-dff7-45f0-b35a-a15024bf1ae6" containerName="istio-proxy"
Jul 17 18:51:16.634880 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:16.634854    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f518f7ac-dff7-45f0-b35a-a15024bf1ae6" containerName="istio-proxy"
Jul 17 18:51:16.635050 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:16.634949    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="70592cc7-1b70-4652-9a57-301cc12f7b8b" containerName="revoke-keys"
Jul 17 18:51:16.639501 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:16.639478    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74"
Jul 17 18:51:16.641951 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:16.641927    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-7d6f90-serving-cert\""
Jul 17 18:51:16.648984 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:16.648955    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74"]
Jul 17 18:51:16.670119 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:16.670077    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:51:16.792715 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:16.792619    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxwct\" (UniqueName: \"kubernetes.io/projected/86422ed7-a22a-450a-b098-bc123aeb4714-kube-api-access-qxwct\") pod \"maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74\" (UID: \"86422ed7-a22a-450a-b098-bc123aeb4714\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74"
Jul 17 18:51:16.792715 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:16.792682    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86422ed7-a22a-450a-b098-bc123aeb4714-openshift-service-ca\") pod \"maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74\" (UID: \"86422ed7-a22a-450a-b098-bc123aeb4714\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74"
Jul 17 18:51:16.792922 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:16.792729    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86422ed7-a22a-450a-b098-bc123aeb4714-maas-api-tls\") pod \"maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74\" (UID: \"86422ed7-a22a-450a-b098-bc123aeb4714\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74"
Jul 17 18:51:16.870051 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:16.869985    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:51:16.893394 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:16.893354    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxwct\" (UniqueName: \"kubernetes.io/projected/86422ed7-a22a-450a-b098-bc123aeb4714-kube-api-access-qxwct\") pod \"maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74\" (UID: \"86422ed7-a22a-450a-b098-bc123aeb4714\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74"
Jul 17 18:51:16.893595 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:16.893419    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86422ed7-a22a-450a-b098-bc123aeb4714-openshift-service-ca\") pod \"maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74\" (UID: \"86422ed7-a22a-450a-b098-bc123aeb4714\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74"
Jul 17 18:51:16.893595 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:16.893448    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86422ed7-a22a-450a-b098-bc123aeb4714-maas-api-tls\") pod \"maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74\" (UID: \"86422ed7-a22a-450a-b098-bc123aeb4714\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74"
Jul 17 18:51:16.894381 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:16.894350    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86422ed7-a22a-450a-b098-bc123aeb4714-openshift-service-ca\") pod \"maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74\" (UID: \"86422ed7-a22a-450a-b098-bc123aeb4714\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74"
Jul 17 18:51:16.895880 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:16.895856    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86422ed7-a22a-450a-b098-bc123aeb4714-maas-api-tls\") pod \"maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74\" (UID: \"86422ed7-a22a-450a-b098-bc123aeb4714\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74"
Jul 17 18:51:16.901812 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:16.901788    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxwct\" (UniqueName: \"kubernetes.io/projected/86422ed7-a22a-450a-b098-bc123aeb4714-kube-api-access-qxwct\") pod \"maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74\" (UID: \"86422ed7-a22a-450a-b098-bc123aeb4714\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74"
Jul 17 18:51:16.954178 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:16.954134    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74"
Jul 17 18:51:17.124860 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.124823    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74"]
Jul 17 18:51:17.127965 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:51:17.127936    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86422ed7_a22a_450a_b098_bc123aeb4714.slice/crio-d4dc2d612cd6f62a4ed95e1e9743d222a920b6fc8597f6f1dffdb1b6564c3a80 WatchSource:0}: Error finding container d4dc2d612cd6f62a4ed95e1e9743d222a920b6fc8597f6f1dffdb1b6564c3a80: Status 404 returned error can't find the container with id d4dc2d612cd6f62a4ed95e1e9743d222a920b6fc8597f6f1dffdb1b6564c3a80
Jul 17 18:51:17.213907 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.213874    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:51:17.272980 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.272952    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:51:17.319376 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.319290    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:51:17.397833 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.397797    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e675d7b9-c89d-4e06-bb84-d3392b01d895-istio-envoy\") pod \"e675d7b9-c89d-4e06-bb84-d3392b01d895\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") "
Jul 17 18:51:17.398030 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.397857    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e675d7b9-c89d-4e06-bb84-d3392b01d895-credential-socket\") pod \"e675d7b9-c89d-4e06-bb84-d3392b01d895\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") "
Jul 17 18:51:17.398030 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.397900    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e675d7b9-c89d-4e06-bb84-d3392b01d895-istio-data\") pod \"e675d7b9-c89d-4e06-bb84-d3392b01d895\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") "
Jul 17 18:51:17.398030 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.397931    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e675d7b9-c89d-4e06-bb84-d3392b01d895-istiod-ca-cert\") pod \"e675d7b9-c89d-4e06-bb84-d3392b01d895\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") "
Jul 17 18:51:17.398030 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.397972    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e675d7b9-c89d-4e06-bb84-d3392b01d895-istio-podinfo\") pod \"e675d7b9-c89d-4e06-bb84-d3392b01d895\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") "
Jul 17 18:51:17.398030 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.398018    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e675d7b9-c89d-4e06-bb84-d3392b01d895-workload-socket\") pod \"e675d7b9-c89d-4e06-bb84-d3392b01d895\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") "
Jul 17 18:51:17.398295 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.398084    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47gww\" (UniqueName: \"kubernetes.io/projected/e675d7b9-c89d-4e06-bb84-d3392b01d895-kube-api-access-47gww\") pod \"e675d7b9-c89d-4e06-bb84-d3392b01d895\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") "
Jul 17 18:51:17.398295 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.398126    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e675d7b9-c89d-4e06-bb84-d3392b01d895-workload-certs\") pod \"e675d7b9-c89d-4e06-bb84-d3392b01d895\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") "
Jul 17 18:51:17.398295 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.398201    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e675d7b9-c89d-4e06-bb84-d3392b01d895-istio-token\") pod \"e675d7b9-c89d-4e06-bb84-d3392b01d895\" (UID: \"e675d7b9-c89d-4e06-bb84-d3392b01d895\") "
Jul 17 18:51:17.398295 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.398265    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e675d7b9-c89d-4e06-bb84-d3392b01d895-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e675d7b9-c89d-4e06-bb84-d3392b01d895" (UID: "e675d7b9-c89d-4e06-bb84-d3392b01d895"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:51:17.398577 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.398407    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e675d7b9-c89d-4e06-bb84-d3392b01d895-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e675d7b9-c89d-4e06-bb84-d3392b01d895" (UID: "e675d7b9-c89d-4e06-bb84-d3392b01d895"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:51:17.398577 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.398446    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e675d7b9-c89d-4e06-bb84-d3392b01d895-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e675d7b9-c89d-4e06-bb84-d3392b01d895" (UID: "e675d7b9-c89d-4e06-bb84-d3392b01d895"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:51:17.398728 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.398608    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e675d7b9-c89d-4e06-bb84-d3392b01d895-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e675d7b9-c89d-4e06-bb84-d3392b01d895" (UID: "e675d7b9-c89d-4e06-bb84-d3392b01d895"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:51:17.398728 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.398717    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e675d7b9-c89d-4e06-bb84-d3392b01d895-istiod-ca-cert\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:51:17.398844 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.398738    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e675d7b9-c89d-4e06-bb84-d3392b01d895-workload-socket\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:51:17.398844 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.398753    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e675d7b9-c89d-4e06-bb84-d3392b01d895-workload-certs\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:51:17.398844 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.398767    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e675d7b9-c89d-4e06-bb84-d3392b01d895-credential-socket\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:51:17.398844 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.398809    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e675d7b9-c89d-4e06-bb84-d3392b01d895-istio-data" (OuterVolumeSpecName: "istio-data") pod "e675d7b9-c89d-4e06-bb84-d3392b01d895" (UID: "e675d7b9-c89d-4e06-bb84-d3392b01d895"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:51:17.400224 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.400201    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e675d7b9-c89d-4e06-bb84-d3392b01d895-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e675d7b9-c89d-4e06-bb84-d3392b01d895" (UID: "e675d7b9-c89d-4e06-bb84-d3392b01d895"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:51:17.400346 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.400331    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e675d7b9-c89d-4e06-bb84-d3392b01d895-istio-token" (OuterVolumeSpecName: "istio-token") pod "e675d7b9-c89d-4e06-bb84-d3392b01d895" (UID: "e675d7b9-c89d-4e06-bb84-d3392b01d895"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:51:17.400811 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.400789    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e675d7b9-c89d-4e06-bb84-d3392b01d895-kube-api-access-47gww" (OuterVolumeSpecName: "kube-api-access-47gww") pod "e675d7b9-c89d-4e06-bb84-d3392b01d895" (UID: "e675d7b9-c89d-4e06-bb84-d3392b01d895"). InnerVolumeSpecName "kube-api-access-47gww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:51:17.400863 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.400792    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e675d7b9-c89d-4e06-bb84-d3392b01d895-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e675d7b9-c89d-4e06-bb84-d3392b01d895" (UID: "e675d7b9-c89d-4e06-bb84-d3392b01d895"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 18:51:17.486212 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.486180    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74" event={"ID":"86422ed7-a22a-450a-b098-bc123aeb4714","Type":"ContainerStarted","Data":"d4dc2d612cd6f62a4ed95e1e9743d222a920b6fc8597f6f1dffdb1b6564c3a80"}
Jul 17 18:51:17.487844 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.487815    2572 generic.go:356] "Generic (PLEG): container finished" podID="e675d7b9-c89d-4e06-bb84-d3392b01d895" containerID="ba7795c03363b3da010572dc51de880b62cdcc2f1bcd4d0aae39eaca80c93a18" exitCode=0
Jul 17 18:51:17.488022 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.487866    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"
Jul 17 18:51:17.488022 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.487893    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd" event={"ID":"e675d7b9-c89d-4e06-bb84-d3392b01d895","Type":"ContainerDied","Data":"ba7795c03363b3da010572dc51de880b62cdcc2f1bcd4d0aae39eaca80c93a18"}
Jul 17 18:51:17.488022 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.487935    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd" event={"ID":"e675d7b9-c89d-4e06-bb84-d3392b01d895","Type":"ContainerDied","Data":"42cab088e7073f7501373a972752d94fe4fd7879352105d830100267da3f799e"}
Jul 17 18:51:17.488022 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.487958    2572 scope.go:117] "RemoveContainer" containerID="ba7795c03363b3da010572dc51de880b62cdcc2f1bcd4d0aae39eaca80c93a18"
Jul 17 18:51:17.497209 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.497191    2572 scope.go:117] "RemoveContainer" containerID="878998f02a3ed8d1f8754dc7968522e5af0accc959dc63fa9a51078bc51c3b11"
Jul 17 18:51:17.499726 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.499700    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e675d7b9-c89d-4e06-bb84-d3392b01d895-istio-podinfo\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:51:17.499811 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.499730    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47gww\" (UniqueName: \"kubernetes.io/projected/e675d7b9-c89d-4e06-bb84-d3392b01d895-kube-api-access-47gww\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:51:17.499811 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.499748    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e675d7b9-c89d-4e06-bb84-d3392b01d895-istio-token\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:51:17.499811 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.499761    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e675d7b9-c89d-4e06-bb84-d3392b01d895-istio-envoy\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:51:17.499811 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.499773    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e675d7b9-c89d-4e06-bb84-d3392b01d895-istio-data\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:51:17.504648 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.504626    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"]
Jul 17 18:51:17.505932 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.505906    2572 scope.go:117] "RemoveContainer" containerID="ba7795c03363b3da010572dc51de880b62cdcc2f1bcd4d0aae39eaca80c93a18"
Jul 17 18:51:17.506511 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:51:17.506481    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba7795c03363b3da010572dc51de880b62cdcc2f1bcd4d0aae39eaca80c93a18\": container with ID starting with ba7795c03363b3da010572dc51de880b62cdcc2f1bcd4d0aae39eaca80c93a18 not found: ID does not exist" containerID="ba7795c03363b3da010572dc51de880b62cdcc2f1bcd4d0aae39eaca80c93a18"
Jul 17 18:51:17.506608 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.506536    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba7795c03363b3da010572dc51de880b62cdcc2f1bcd4d0aae39eaca80c93a18"} err="failed to get container status \"ba7795c03363b3da010572dc51de880b62cdcc2f1bcd4d0aae39eaca80c93a18\": rpc error: code = NotFound desc = could not find container \"ba7795c03363b3da010572dc51de880b62cdcc2f1bcd4d0aae39eaca80c93a18\": container with ID starting with ba7795c03363b3da010572dc51de880b62cdcc2f1bcd4d0aae39eaca80c93a18 not found: ID does not exist"
Jul 17 18:51:17.506608 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.506562    2572 scope.go:117] "RemoveContainer" containerID="878998f02a3ed8d1f8754dc7968522e5af0accc959dc63fa9a51078bc51c3b11"
Jul 17 18:51:17.506972 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:51:17.506947    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"878998f02a3ed8d1f8754dc7968522e5af0accc959dc63fa9a51078bc51c3b11\": container with ID starting with 878998f02a3ed8d1f8754dc7968522e5af0accc959dc63fa9a51078bc51c3b11 not found: ID does not exist" containerID="878998f02a3ed8d1f8754dc7968522e5af0accc959dc63fa9a51078bc51c3b11"
Jul 17 18:51:17.507356 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.506981    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"878998f02a3ed8d1f8754dc7968522e5af0accc959dc63fa9a51078bc51c3b11"} err="failed to get container status \"878998f02a3ed8d1f8754dc7968522e5af0accc959dc63fa9a51078bc51c3b11\": rpc error: code = NotFound desc = could not find container \"878998f02a3ed8d1f8754dc7968522e5af0accc959dc63fa9a51078bc51c3b11\": container with ID starting with 878998f02a3ed8d1f8754dc7968522e5af0accc959dc63fa9a51078bc51c3b11 not found: ID does not exist"
Jul 17 18:51:17.512025 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.509733    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-9de544-openshift-default-67cc59774c-p4hwd"]
Jul 17 18:51:17.869825 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.869780    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-hjzzc"]
Jul 17 18:51:17.870442 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.870418    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e675d7b9-c89d-4e06-bb84-d3392b01d895" containerName="istio-proxy"
Jul 17 18:51:17.870442 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.870444    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e675d7b9-c89d-4e06-bb84-d3392b01d895" containerName="istio-proxy"
Jul 17 18:51:17.870607 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.870477    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e675d7b9-c89d-4e06-bb84-d3392b01d895" containerName="istio-proxy"
Jul 17 18:51:17.870607 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.870487    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e675d7b9-c89d-4e06-bb84-d3392b01d895" containerName="istio-proxy"
Jul 17 18:51:17.870607 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.870591    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e675d7b9-c89d-4e06-bb84-d3392b01d895" containerName="istio-proxy"
Jul 17 18:51:17.870607 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.870605    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e675d7b9-c89d-4e06-bb84-d3392b01d895" containerName="istio-proxy"
Jul 17 18:51:17.874224 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.874203    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-hjzzc"
Jul 17 18:51:17.877379 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.877337    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:51:17.878724 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:17.878695    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-hjzzc"]
Jul 17 18:51:18.005306 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:18.005205    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01f43240-3be7-49ab-bb6d-b5973f78c1aa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-hjzzc\" (UID: \"01f43240-3be7-49ab-bb6d-b5973f78c1aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-hjzzc"
Jul 17 18:51:18.106879 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:18.106833    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01f43240-3be7-49ab-bb6d-b5973f78c1aa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-hjzzc\" (UID: \"01f43240-3be7-49ab-bb6d-b5973f78c1aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-hjzzc"
Jul 17 18:51:18.107473 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:18.107452    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01f43240-3be7-49ab-bb6d-b5973f78c1aa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-02bfc37f-hjzzc\" (UID: \"01f43240-3be7-49ab-bb6d-b5973f78c1aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-hjzzc"
Jul 17 18:51:18.187810 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:18.187771    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-hjzzc"
Jul 17 18:51:18.323486 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:18.323457    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-hjzzc"]
Jul 17 18:51:18.329255 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:51:18.329217    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01f43240_3be7_49ab_bb6d_b5973f78c1aa.slice/crio-b1da10f93bff65fbc9dba3e3e7ea31633706bbec940f34fa1ab50454417dd0fc WatchSource:0}: Error finding container b1da10f93bff65fbc9dba3e3e7ea31633706bbec940f34fa1ab50454417dd0fc: Status 404 returned error can't find the container with id b1da10f93bff65fbc9dba3e3e7ea31633706bbec940f34fa1ab50454417dd0fc
Jul 17 18:51:18.495143 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:18.495109    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74" event={"ID":"86422ed7-a22a-450a-b098-bc123aeb4714","Type":"ContainerStarted","Data":"b5efe56e68c21dc15f7d53a0a2a8f136862da345191871bbbeb13739d1589a9d"}
Jul 17 18:51:18.495343 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:18.495169    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74"
Jul 17 18:51:18.497203 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:18.497176    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-hjzzc" event={"ID":"01f43240-3be7-49ab-bb6d-b5973f78c1aa","Type":"ContainerStarted","Data":"b1da10f93bff65fbc9dba3e3e7ea31633706bbec940f34fa1ab50454417dd0fc"}
Jul 17 18:51:18.512679 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:18.512624    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74" podStartSLOduration=1.910363889 podStartE2EDuration="2.51260855s" totalImagesPullingTime="602.244661ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:51:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:51:18.510835867 +0000 UTC m=+3305.736065187" watchObservedRunningTime="2026-07-17 18:51:18.51260855 +0000 UTC m=+3305.737837862"
Jul 17 18:51:19.472335 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:19.472304    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e675d7b9-c89d-4e06-bb84-d3392b01d895" path="/var/lib/kubelet/pods/e675d7b9-c89d-4e06-bb84-d3392b01d895/volumes"
Jul 17 18:51:19.503984 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:19.503950    2572 generic.go:356] "Generic (PLEG): container finished" podID="01f43240-3be7-49ab-bb6d-b5973f78c1aa" containerID="dd9f359aedcd8a58b54b2292d1024404753b04f90f843af34a3ec2349cdbbc57" exitCode=6
Jul 17 18:51:19.503984 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:19.503981    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-hjzzc" event={"ID":"01f43240-3be7-49ab-bb6d-b5973f78c1aa","Type":"ContainerDied","Data":"dd9f359aedcd8a58b54b2292d1024404753b04f90f843af34a3ec2349cdbbc57"}
Jul 17 18:51:19.504228 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:19.504214    2572 scope.go:117] "RemoveContainer" containerID="dd9f359aedcd8a58b54b2292d1024404753b04f90f843af34a3ec2349cdbbc57"
Jul 17 18:51:20.512415 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:20.512383    2572 generic.go:356] "Generic (PLEG): container finished" podID="01f43240-3be7-49ab-bb6d-b5973f78c1aa" containerID="c816339fe661f838ede07e4df76f1141adc9da63893af35660ab70583f3a9982" exitCode=6
Jul 17 18:51:20.512838 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:20.512466    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-hjzzc" event={"ID":"01f43240-3be7-49ab-bb6d-b5973f78c1aa","Type":"ContainerDied","Data":"c816339fe661f838ede07e4df76f1141adc9da63893af35660ab70583f3a9982"}
Jul 17 18:51:20.512838 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:20.512522    2572 scope.go:117] "RemoveContainer" containerID="dd9f359aedcd8a58b54b2292d1024404753b04f90f843af34a3ec2349cdbbc57"
Jul 17 18:51:20.512838 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:20.512625    2572 scope.go:117] "RemoveContainer" containerID="c816339fe661f838ede07e4df76f1141adc9da63893af35660ab70583f3a9982"
Jul 17 18:51:20.512971 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:51:20.512876    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-hjzzc_odh-ai-gateway-infra(01f43240-3be7-49ab-bb6d-b5973f78c1aa)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-hjzzc" podUID="01f43240-3be7-49ab-bb6d-b5973f78c1aa"
Jul 17 18:51:21.002230 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:21.002191    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:51:21.519584 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:21.519559    2572 scope.go:117] "RemoveContainer" containerID="c816339fe661f838ede07e4df76f1141adc9da63893af35660ab70583f3a9982"
Jul 17 18:51:21.520014 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:51:21.519754    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-hjzzc_odh-ai-gateway-infra(01f43240-3be7-49ab-bb6d-b5973f78c1aa)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-hjzzc" podUID="01f43240-3be7-49ab-bb6d-b5973f78c1aa"
Jul 17 18:51:21.621968 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:21.621925    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"]
Jul 17 18:51:21.627151 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:21.627124    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:21.629526 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:21.629502    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-52fc47-openshift-default-dockercfg-hmx69\""
Jul 17 18:51:21.646131 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:21.646091    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"]
Jul 17 18:51:21.744478 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:21.744433    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/672e7c92-b47f-49dd-849d-3524dc8b9edc-istio-envoy\") pod \"e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") " pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:21.744697 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:21.744497    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/672e7c92-b47f-49dd-849d-3524dc8b9edc-workload-socket\") pod \"e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") " pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:21.744697 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:21.744554    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/672e7c92-b47f-49dd-849d-3524dc8b9edc-istio-token\") pod \"e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") " pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:21.744697 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:21.744622    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/672e7c92-b47f-49dd-849d-3524dc8b9edc-credential-socket\") pod \"e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") " pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:21.744899 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:21.744697    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/672e7c92-b47f-49dd-849d-3524dc8b9edc-istio-data\") pod \"e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") " pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:21.744899 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:21.744749    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/672e7c92-b47f-49dd-849d-3524dc8b9edc-workload-certs\") pod \"e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") " pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:21.744899 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:21.744787    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/672e7c92-b47f-49dd-849d-3524dc8b9edc-istio-podinfo\") pod \"e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") " pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:21.744899 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:21.744878    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/672e7c92-b47f-49dd-849d-3524dc8b9edc-istiod-ca-cert\") pod \"e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") " pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:21.745126 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:21.744919    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bcl2\" (UniqueName: \"kubernetes.io/projected/672e7c92-b47f-49dd-849d-3524dc8b9edc-kube-api-access-9bcl2\") pod \"e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") " pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:21.846267 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:21.846164    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/672e7c92-b47f-49dd-849d-3524dc8b9edc-workload-socket\") pod \"e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") " pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:21.846267 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:21.846212    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/672e7c92-b47f-49dd-849d-3524dc8b9edc-istio-token\") pod \"e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") " pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:21.846507 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:21.846277    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/672e7c92-b47f-49dd-849d-3524dc8b9edc-credential-socket\") pod \"e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") " pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:21.846507 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:21.846299    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/672e7c92-b47f-49dd-849d-3524dc8b9edc-istio-data\") pod \"e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") " pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:21.846507 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:21.846321    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/672e7c92-b47f-49dd-849d-3524dc8b9edc-workload-certs\") pod \"e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") " pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:21.846507 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:21.846351    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/672e7c92-b47f-49dd-849d-3524dc8b9edc-istio-podinfo\") pod \"e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") " pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:21.846507 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:21.846398    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/672e7c92-b47f-49dd-849d-3524dc8b9edc-istiod-ca-cert\") pod \"e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") " pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:21.846507 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:21.846427    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bcl2\" (UniqueName: \"kubernetes.io/projected/672e7c92-b47f-49dd-849d-3524dc8b9edc-kube-api-access-9bcl2\") pod \"e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") " pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:21.846507 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:21.846491    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/672e7c92-b47f-49dd-849d-3524dc8b9edc-istio-envoy\") pod \"e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") " pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:21.846826 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:21.846636    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/672e7c92-b47f-49dd-849d-3524dc8b9edc-workload-socket\") pod \"e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") " pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:21.846826 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:21.846711    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/672e7c92-b47f-49dd-849d-3524dc8b9edc-istio-data\") pod \"e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") " pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:21.846826 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:21.846794    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/672e7c92-b47f-49dd-849d-3524dc8b9edc-workload-certs\") pod \"e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") " pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:21.846991 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:21.846969    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/672e7c92-b47f-49dd-849d-3524dc8b9edc-credential-socket\") pod \"e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") " pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:21.847231 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:21.847212    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/672e7c92-b47f-49dd-849d-3524dc8b9edc-istiod-ca-cert\") pod \"e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") " pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:21.848752 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:21.848726    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/672e7c92-b47f-49dd-849d-3524dc8b9edc-istio-envoy\") pod \"e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") " pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:21.849519 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:21.849501    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/672e7c92-b47f-49dd-849d-3524dc8b9edc-istio-podinfo\") pod \"e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") " pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:21.853627 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:21.853596    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/672e7c92-b47f-49dd-849d-3524dc8b9edc-istio-token\") pod \"e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") " pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:21.853782 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:21.853765    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bcl2\" (UniqueName: \"kubernetes.io/projected/672e7c92-b47f-49dd-849d-3524dc8b9edc-kube-api-access-9bcl2\") pod \"e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") " pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:21.942908 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:21.942870    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:22.142207 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:22.142182    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"]
Jul 17 18:51:22.145651 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:51:22.145627    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod672e7c92_b47f_49dd_849d_3524dc8b9edc.slice/crio-0e7d1543b7f7766a6850695cd3f028b4719879f5566f7999cf626dc0a6096e35 WatchSource:0}: Error finding container 0e7d1543b7f7766a6850695cd3f028b4719879f5566f7999cf626dc0a6096e35: Status 404 returned error can't find the container with id 0e7d1543b7f7766a6850695cd3f028b4719879f5566f7999cf626dc0a6096e35
Jul 17 18:51:22.148457 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:22.148419    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:51:22.148545 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:22.148511    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:51:22.148593 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:22.148555    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:51:22.384160 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:22.384114    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:51:22.526868 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:22.526827    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8" event={"ID":"672e7c92-b47f-49dd-849d-3524dc8b9edc","Type":"ContainerStarted","Data":"5f18060f21da796867cf8a0beb6ec85cf4ee946bfef2d52f27dd03db7cc336b8"}
Jul 17 18:51:22.527273 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:22.526933    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8" event={"ID":"672e7c92-b47f-49dd-849d-3524dc8b9edc","Type":"ContainerStarted","Data":"0e7d1543b7f7766a6850695cd3f028b4719879f5566f7999cf626dc0a6096e35"}
Jul 17 18:51:22.546542 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:22.546495    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8" podStartSLOduration=1.546480452 podStartE2EDuration="1.546480452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:51:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:51:22.545504929 +0000 UTC m=+3309.770734237" watchObservedRunningTime="2026-07-17 18:51:22.546480452 +0000 UTC m=+3309.771709759"
Jul 17 18:51:22.944022 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:22.943978    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:23.949184 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:23.949142    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:24.465526 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:24.465485    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:51:24.511629 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:24.511600    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74"
Jul 17 18:51:24.536183 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:24.536144    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:51:24.537308 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:24.537287    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:24.538401 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:24.538384    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:24.754744 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:24.754667    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm"]
Jul 17 18:51:24.759029 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:24.758972    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm"
Jul 17 18:51:24.761537 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:24.761511    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-52fc47-serving-cert\""
Jul 17 18:51:24.771927 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:24.771895    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm"]
Jul 17 18:51:24.795150 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:24.795115    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:51:24.895505 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:24.895468    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjxfg\" (UniqueName: \"kubernetes.io/projected/a7132a05-73d8-4873-8d5f-c9c14b96c384-kube-api-access-vjxfg\") pod \"maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm\" (UID: \"a7132a05-73d8-4873-8d5f-c9c14b96c384\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm"
Jul 17 18:51:24.895706 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:24.895531    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7132a05-73d8-4873-8d5f-c9c14b96c384-maas-api-tls\") pod \"maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm\" (UID: \"a7132a05-73d8-4873-8d5f-c9c14b96c384\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm"
Jul 17 18:51:24.895706 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:24.895651    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7132a05-73d8-4873-8d5f-c9c14b96c384-openshift-service-ca\") pod \"maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm\" (UID: \"a7132a05-73d8-4873-8d5f-c9c14b96c384\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm"
Jul 17 18:51:24.997028 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:24.996963    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7132a05-73d8-4873-8d5f-c9c14b96c384-maas-api-tls\") pod \"maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm\" (UID: \"a7132a05-73d8-4873-8d5f-c9c14b96c384\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm"
Jul 17 18:51:24.997506 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:24.997088    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7132a05-73d8-4873-8d5f-c9c14b96c384-openshift-service-ca\") pod \"maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm\" (UID: \"a7132a05-73d8-4873-8d5f-c9c14b96c384\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm"
Jul 17 18:51:24.997506 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:51:24.997137    2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-52fc47-serving-cert: secret "maas-api-e2e-shared-b-52fc47-serving-cert" not found
Jul 17 18:51:24.997506 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:24.997154    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjxfg\" (UniqueName: \"kubernetes.io/projected/a7132a05-73d8-4873-8d5f-c9c14b96c384-kube-api-access-vjxfg\") pod \"maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm\" (UID: \"a7132a05-73d8-4873-8d5f-c9c14b96c384\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm"
Jul 17 18:51:24.997506 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:51:24.997212    2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7132a05-73d8-4873-8d5f-c9c14b96c384-maas-api-tls podName:a7132a05-73d8-4873-8d5f-c9c14b96c384 nodeName:}" failed. No retries permitted until 2026-07-17 18:51:25.497195938 +0000 UTC m=+3312.722425224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a7132a05-73d8-4873-8d5f-c9c14b96c384-maas-api-tls") pod "maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm" (UID: "a7132a05-73d8-4873-8d5f-c9c14b96c384") : secret "maas-api-e2e-shared-b-52fc47-serving-cert" not found
Jul 17 18:51:24.997764 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:24.997745    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7132a05-73d8-4873-8d5f-c9c14b96c384-openshift-service-ca\") pod \"maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm\" (UID: \"a7132a05-73d8-4873-8d5f-c9c14b96c384\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm"
Jul 17 18:51:25.005436 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:25.005371    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjxfg\" (UniqueName: \"kubernetes.io/projected/a7132a05-73d8-4873-8d5f-c9c14b96c384-kube-api-access-vjxfg\") pod \"maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm\" (UID: \"a7132a05-73d8-4873-8d5f-c9c14b96c384\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm"
Jul 17 18:51:25.087308 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:25.087266    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:51:25.502806 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:25.502766    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7132a05-73d8-4873-8d5f-c9c14b96c384-maas-api-tls\") pod \"maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm\" (UID: \"a7132a05-73d8-4873-8d5f-c9c14b96c384\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm"
Jul 17 18:51:25.504381 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:25.504301    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:51:25.505431 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:25.505409    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7132a05-73d8-4873-8d5f-c9c14b96c384-maas-api-tls\") pod \"maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm\" (UID: \"a7132a05-73d8-4873-8d5f-c9c14b96c384\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm"
Jul 17 18:51:25.601263 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:25.601221    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:51:25.704830 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:25.704792    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm"
Jul 17 18:51:25.887029 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:25.885819    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm"]
Jul 17 18:51:25.893648 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:51:25.893616    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7132a05_73d8_4873_8d5f_c9c14b96c384.slice/crio-cda04612a4771af8e1c67a622e2f14f809ed074aa7d7abe6dbac102f1b5df5be WatchSource:0}: Error finding container cda04612a4771af8e1c67a622e2f14f809ed074aa7d7abe6dbac102f1b5df5be: Status 404 returned error can't find the container with id cda04612a4771af8e1c67a622e2f14f809ed074aa7d7abe6dbac102f1b5df5be
Jul 17 18:51:26.550160 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:26.550122    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm" event={"ID":"a7132a05-73d8-4873-8d5f-c9c14b96c384","Type":"ContainerStarted","Data":"255e78ee521bbd09c479d3cc63410477308409b3eb0fc51280a986295dddae5a"}
Jul 17 18:51:26.550573 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:26.550185    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm" event={"ID":"a7132a05-73d8-4873-8d5f-c9c14b96c384","Type":"ContainerStarted","Data":"cda04612a4771af8e1c67a622e2f14f809ed074aa7d7abe6dbac102f1b5df5be"}
Jul 17 18:51:26.550573 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:26.550349    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm"
Jul 17 18:51:26.568666 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:26.568617    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm" podStartSLOduration=2.18821733 podStartE2EDuration="2.568595187s" totalImagesPullingTime="380.377857ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:51:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:51:26.567293011 +0000 UTC m=+3313.792522320" watchObservedRunningTime="2026-07-17 18:51:26.568595187 +0000 UTC m=+3313.793824519"
Jul 17 18:51:28.987846 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:28.987809    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:51:29.575032 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:29.574979    2572 generic.go:356] "Generic (PLEG): container finished" podID="b3bfe354-ed35-4322-bf5f-e8ec4491cedf" containerID="f0e19435a05ebe2648e80ec2f3aa73ca69d9957d0c291af18a5c1b47208edfca" exitCode=0
Jul 17 18:51:29.575230 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:29.575038    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt" event={"ID":"b3bfe354-ed35-4322-bf5f-e8ec4491cedf","Type":"ContainerDied","Data":"f0e19435a05ebe2648e80ec2f3aa73ca69d9957d0c291af18a5c1b47208edfca"}
Jul 17 18:51:29.575474 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:29.575458    2572 scope.go:117] "RemoveContainer" containerID="f0e19435a05ebe2648e80ec2f3aa73ca69d9957d0c291af18a5c1b47208edfca"
Jul 17 18:51:29.576570 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:29.576544    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:51:29.576626 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:29.576614    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:51:29.576662 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:29.576647    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:51:30.475713 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:30.475675    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:30.586203 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:30.586156    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt" event={"ID":"b3bfe354-ed35-4322-bf5f-e8ec4491cedf","Type":"ContainerStarted","Data":"9009ac9a0707875a0e6e3483a0501cf87f38b6d44f759f71de34df4bbbeaef94"}
Jul 17 18:51:31.289804 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:31.289765    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:31.291120 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:31.291089    2572 patch_prober.go:28] interesting pod/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Jul 17 18:51:31.291257 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:31.291144    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt" podUID="b3bfe354-ed35-4322-bf5f-e8ec4491cedf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Jul 17 18:51:32.289376 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:32.289336    2572 patch_prober.go:28] interesting pod/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Jul 17 18:51:32.289790 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:32.289397    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt" podUID="b3bfe354-ed35-4322-bf5f-e8ec4491cedf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Jul 17 18:51:32.562877 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:32.562775    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm"
Jul 17 18:51:33.289544 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:33.289504    2572 patch_prober.go:28] interesting pod/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Jul 17 18:51:33.290082 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:33.289965    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt" podUID="b3bfe354-ed35-4322-bf5f-e8ec4491cedf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Jul 17 18:51:34.289571 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:34.289530    2572 patch_prober.go:28] interesting pod/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused" start-of-body=
Jul 17 18:51:34.290189 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:34.290155    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt" podUID="b3bfe354-ed35-4322-bf5f-e8ec4491cedf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.104:15021/healthz/ready\": dial tcp 10.132.0.104:15021: connect: connection refused"
Jul 17 18:51:35.294082 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:35.293983    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:35.294510 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:35.294490    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:35.295167 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:35.295144    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:51:35.465775 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:35.465737    2572 scope.go:117] "RemoveContainer" containerID="c816339fe661f838ede07e4df76f1141adc9da63893af35660ab70583f3a9982"
Jul 17 18:51:36.630806 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:36.630771    2572 generic.go:356] "Generic (PLEG): container finished" podID="01f43240-3be7-49ab-bb6d-b5973f78c1aa" containerID="8c880fe8266b68129619c88d381056bf7041662717689f5ae70eacbdfa42af5e" exitCode=6
Jul 17 18:51:36.631311 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:36.630843    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-hjzzc" event={"ID":"01f43240-3be7-49ab-bb6d-b5973f78c1aa","Type":"ContainerDied","Data":"8c880fe8266b68129619c88d381056bf7041662717689f5ae70eacbdfa42af5e"}
Jul 17 18:51:36.631311 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:36.630902    2572 scope.go:117] "RemoveContainer" containerID="c816339fe661f838ede07e4df76f1141adc9da63893af35660ab70583f3a9982"
Jul 17 18:51:36.631438 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:36.631341    2572 scope.go:117] "RemoveContainer" containerID="8c880fe8266b68129619c88d381056bf7041662717689f5ae70eacbdfa42af5e"
Jul 17 18:51:36.631643 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:51:36.631615    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-02bfc37f-hjzzc_odh-ai-gateway-infra(01f43240-3be7-49ab-bb6d-b5973f78c1aa)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-hjzzc" podUID="01f43240-3be7-49ab-bb6d-b5973f78c1aa"
Jul 17 18:51:37.655787 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:37.655737    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-hjzzc"]
Jul 17 18:51:37.838626 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:37.838591    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-hjzzc"
Jul 17 18:51:37.938669 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:37.938627    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01f43240-3be7-49ab-bb6d-b5973f78c1aa-maas-api-service-ca\") pod \"01f43240-3be7-49ab-bb6d-b5973f78c1aa\" (UID: \"01f43240-3be7-49ab-bb6d-b5973f78c1aa\") "
Jul 17 18:51:37.939125 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:37.939093    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01f43240-3be7-49ab-bb6d-b5973f78c1aa-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "01f43240-3be7-49ab-bb6d-b5973f78c1aa" (UID: "01f43240-3be7-49ab-bb6d-b5973f78c1aa"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:51:37.966798 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:37.966767    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:51:38.039463 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:38.039432    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/01f43240-3be7-49ab-bb6d-b5973f78c1aa-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:51:38.063823 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:38.063793    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:51:38.645788 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:38.645756    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-hjzzc"
Jul 17 18:51:38.646030 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:38.645753    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-hjzzc" event={"ID":"01f43240-3be7-49ab-bb6d-b5973f78c1aa","Type":"ContainerDied","Data":"b1da10f93bff65fbc9dba3e3e7ea31633706bbec940f34fa1ab50454417dd0fc"}
Jul 17 18:51:38.646030 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:38.645894    2572 scope.go:117] "RemoveContainer" containerID="8c880fe8266b68129619c88d381056bf7041662717689f5ae70eacbdfa42af5e"
Jul 17 18:51:38.673412 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:38.673373    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-hjzzc"]
Jul 17 18:51:38.675845 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:38.675814    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-02bfc37f-hjzzc"]
Jul 17 18:51:39.472834 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:39.472799    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01f43240-3be7-49ab-bb6d-b5973f78c1aa" path="/var/lib/kubelet/pods/01f43240-3be7-49ab-bb6d-b5973f78c1aa/volumes"
Jul 17 18:51:39.613832 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:39.613791    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:51:40.511244 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:40.509749    2572 patch_prober.go:28] interesting pod/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": read tcp 10.132.0.2:39242->10.132.0.107:15021: read: connection reset by peer" start-of-body=
Jul 17 18:51:40.511244 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:40.509811    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8" podUID="672e7c92-b47f-49dd-849d-3524dc8b9edc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": read tcp 10.132.0.2:39242->10.132.0.107:15021: read: connection reset by peer"
Jul 17 18:51:40.658606 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:40.658570    2572 generic.go:356] "Generic (PLEG): container finished" podID="672e7c92-b47f-49dd-849d-3524dc8b9edc" containerID="5f18060f21da796867cf8a0beb6ec85cf4ee946bfef2d52f27dd03db7cc336b8" exitCode=0
Jul 17 18:51:40.658817 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:40.658648    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8" event={"ID":"672e7c92-b47f-49dd-849d-3524dc8b9edc","Type":"ContainerDied","Data":"5f18060f21da796867cf8a0beb6ec85cf4ee946bfef2d52f27dd03db7cc336b8"}
Jul 17 18:51:40.659197 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:40.659179    2572 scope.go:117] "RemoveContainer" containerID="5f18060f21da796867cf8a0beb6ec85cf4ee946bfef2d52f27dd03db7cc336b8"
Jul 17 18:51:40.660249 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:40.660222    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:51:40.660343 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:40.660305    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:51:40.660406 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:40.660349    2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 17 18:51:41.665778 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:41.665742    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8" event={"ID":"672e7c92-b47f-49dd-849d-3524dc8b9edc","Type":"ContainerStarted","Data":"26863e4e90bd34158349ee2b3c0c557320902c4d1d9b73b165d6af910260e965"}
Jul 17 18:51:41.943886 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:41.943859    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:41.944092 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:41.944067    2572 patch_prober.go:28] interesting pod/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Jul 17 18:51:41.944152 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:41.944118    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8" podUID="672e7c92-b47f-49dd-849d-3524dc8b9edc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Jul 17 18:51:42.944332 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:42.944289    2572 patch_prober.go:28] interesting pod/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Jul 17 18:51:42.944761 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:42.944365    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8" podUID="672e7c92-b47f-49dd-849d-3524dc8b9edc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Jul 17 18:51:43.943976 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:43.943935    2572 patch_prober.go:28] interesting pod/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Jul 17 18:51:43.944209 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:43.944033    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8" podUID="672e7c92-b47f-49dd-849d-3524dc8b9edc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Jul 17 18:51:44.943307 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:44.943270    2572 patch_prober.go:28] interesting pod/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Jul 17 18:51:44.943741 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:44.943333    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8" podUID="672e7c92-b47f-49dd-849d-3524dc8b9edc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Jul 17 18:51:45.943381 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:45.943341    2572 patch_prober.go:28] interesting pod/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused" start-of-body=
Jul 17 18:51:45.943795 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:45.943403    2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8" podUID="672e7c92-b47f-49dd-849d-3524dc8b9edc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.107:15021/healthz/ready\": dial tcp 10.132.0.107:15021: connect: connection refused"
Jul 17 18:51:46.289699 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:46.289595    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:51:46.390475 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:46.390440    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:51:46.946926 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:46.946897    2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:46.947428 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:46.947364    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:51:46.947964 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:51:46.947943    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:52:04.692105 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:52:04.692072    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:53:25.879079 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:53:25.879042    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:53:48.222481 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:53:48.222443    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:53:48.323099 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:53:48.323060    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:54:05.991264 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:54:05.991225    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:54:10.446870 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:54:10.446832    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:54:11.430334 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:54:11.430303    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:54:29.504911 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:54:29.504871    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:54:29.605730 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:54:29.605694    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:54:37.329630 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:54:37.329547    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:54:59.628339 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:54:59.628301    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:54:59.690319 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:54:59.684656    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:20.661847 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:55:20.661803    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:20.759263 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:55:20.759225    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:50.248583 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:55:50.248544    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:55:51.123058 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:55:51.123017    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:09.608381 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:56:09.608347    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:13.723461 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:56:13.723434    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tp9qm_6c101a17-a051-4e9d-a9dd-f72c67ba2a8a/console-operator/2.log"
Jul 17 18:56:13.729893 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:56:13.729867    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5mdx_2e3bd369-576e-4df1-8a76-aebd537cde58/ovn-acl-logging/0.log"
Jul 17 18:56:13.760895 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:56:13.760867    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tp9qm_6c101a17-a051-4e9d-a9dd-f72c67ba2a8a/console-operator/2.log"
Jul 17 18:56:13.767079 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:56:13.767058    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-v5mdx_2e3bd369-576e-4df1-8a76-aebd537cde58/ovn-acl-logging/0.log"
Jul 17 18:56:35.024972 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:56:35.024935    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:38.704056 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:56:38.704022    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:38.804579 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:56:38.804532    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:47.039168 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:56:47.039123    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:56:47.139699 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:56:47.139663    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:57:04.346469 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:57:04.346431    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:57:04.446749 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:57:04.446716    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:57:30.438917 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:57:30.438884    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:57:31.400775 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:57:31.400740    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:57:50.722033 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:57:50.721938    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:57:50.821160 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:57:50.821125    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:58:00.874181 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:00.874143    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74"]
Jul 17 18:58:00.874753 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:00.874348    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74" podUID="86422ed7-a22a-450a-b098-bc123aeb4714" containerName="maas-api" containerID="cri-o://b5efe56e68c21dc15f7d53a0a2a8f136862da345191871bbbeb13739d1589a9d" gracePeriod=30
Jul 17 18:58:00.928230 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:00.928197    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:58:01.133616 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:01.133552    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74"
Jul 17 18:58:01.254411 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:01.254370    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86422ed7-a22a-450a-b098-bc123aeb4714-openshift-service-ca\") pod \"86422ed7-a22a-450a-b098-bc123aeb4714\" (UID: \"86422ed7-a22a-450a-b098-bc123aeb4714\") "
Jul 17 18:58:01.254593 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:01.254455    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxwct\" (UniqueName: \"kubernetes.io/projected/86422ed7-a22a-450a-b098-bc123aeb4714-kube-api-access-qxwct\") pod \"86422ed7-a22a-450a-b098-bc123aeb4714\" (UID: \"86422ed7-a22a-450a-b098-bc123aeb4714\") "
Jul 17 18:58:01.254593 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:01.254501    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86422ed7-a22a-450a-b098-bc123aeb4714-maas-api-tls\") pod \"86422ed7-a22a-450a-b098-bc123aeb4714\" (UID: \"86422ed7-a22a-450a-b098-bc123aeb4714\") "
Jul 17 18:58:01.254829 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:01.254799    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86422ed7-a22a-450a-b098-bc123aeb4714-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "86422ed7-a22a-450a-b098-bc123aeb4714" (UID: "86422ed7-a22a-450a-b098-bc123aeb4714"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:58:01.256656 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:01.256626    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86422ed7-a22a-450a-b098-bc123aeb4714-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "86422ed7-a22a-450a-b098-bc123aeb4714" (UID: "86422ed7-a22a-450a-b098-bc123aeb4714"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 18:58:01.256656 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:01.256629    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86422ed7-a22a-450a-b098-bc123aeb4714-kube-api-access-qxwct" (OuterVolumeSpecName: "kube-api-access-qxwct") pod "86422ed7-a22a-450a-b098-bc123aeb4714" (UID: "86422ed7-a22a-450a-b098-bc123aeb4714"). InnerVolumeSpecName "kube-api-access-qxwct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:58:01.355229 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:01.355193    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxwct\" (UniqueName: \"kubernetes.io/projected/86422ed7-a22a-450a-b098-bc123aeb4714-kube-api-access-qxwct\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:58:01.355229 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:01.355223    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86422ed7-a22a-450a-b098-bc123aeb4714-maas-api-tls\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:58:01.355229 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:01.355233    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86422ed7-a22a-450a-b098-bc123aeb4714-openshift-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:58:01.621110 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:01.621073    2572 generic.go:356] "Generic (PLEG): container finished" podID="86422ed7-a22a-450a-b098-bc123aeb4714" containerID="b5efe56e68c21dc15f7d53a0a2a8f136862da345191871bbbeb13739d1589a9d" exitCode=0
Jul 17 18:58:01.621288 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:01.621133    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74"
Jul 17 18:58:01.621288 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:01.621128    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74" event={"ID":"86422ed7-a22a-450a-b098-bc123aeb4714","Type":"ContainerDied","Data":"b5efe56e68c21dc15f7d53a0a2a8f136862da345191871bbbeb13739d1589a9d"}
Jul 17 18:58:01.621288 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:01.621246    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74" event={"ID":"86422ed7-a22a-450a-b098-bc123aeb4714","Type":"ContainerDied","Data":"d4dc2d612cd6f62a4ed95e1e9743d222a920b6fc8597f6f1dffdb1b6564c3a80"}
Jul 17 18:58:01.621288 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:01.621275    2572 scope.go:117] "RemoveContainer" containerID="b5efe56e68c21dc15f7d53a0a2a8f136862da345191871bbbeb13739d1589a9d"
Jul 17 18:58:01.630530 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:01.630511    2572 scope.go:117] "RemoveContainer" containerID="b5efe56e68c21dc15f7d53a0a2a8f136862da345191871bbbeb13739d1589a9d"
Jul 17 18:58:01.630828 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:58:01.630809    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5efe56e68c21dc15f7d53a0a2a8f136862da345191871bbbeb13739d1589a9d\": container with ID starting with b5efe56e68c21dc15f7d53a0a2a8f136862da345191871bbbeb13739d1589a9d not found: ID does not exist" containerID="b5efe56e68c21dc15f7d53a0a2a8f136862da345191871bbbeb13739d1589a9d"
Jul 17 18:58:01.630874 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:01.630836    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5efe56e68c21dc15f7d53a0a2a8f136862da345191871bbbeb13739d1589a9d"} err="failed to get container status \"b5efe56e68c21dc15f7d53a0a2a8f136862da345191871bbbeb13739d1589a9d\": rpc error: code = NotFound desc = could not find container \"b5efe56e68c21dc15f7d53a0a2a8f136862da345191871bbbeb13739d1589a9d\": container with ID starting with b5efe56e68c21dc15f7d53a0a2a8f136862da345191871bbbeb13739d1589a9d not found: ID does not exist"
Jul 17 18:58:01.656223 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:01.656189    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74"]
Jul 17 18:58:01.661722 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:01.661686    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7d6f90-6bfbb48885-wqx74"]
Jul 17 18:58:03.472257 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:03.472222    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86422ed7-a22a-450a-b098-bc123aeb4714" path="/var/lib/kubelet/pods/86422ed7-a22a-450a-b098-bc123aeb4714/volumes"
Jul 17 18:58:05.268867 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:05.268831    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:58:12.739043 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:12.738986    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:58:12.891901 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:12.891853    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:58:16.096494 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:16.096455    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"]
Jul 17 18:58:16.097259 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:16.096695    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt" podUID="b3bfe354-ed35-4322-bf5f-e8ec4491cedf" containerName="istio-proxy" containerID="cri-o://9009ac9a0707875a0e6e3483a0501cf87f38b6d44f759f71de34df4bbbeaef94" gracePeriod=30
Jul 17 18:58:16.162312 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:16.162278    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:58:16.375537 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:16.375446    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:58:17.464036 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:17.463977    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:58:17.638793 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:17.638749    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:58:20.297083 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:20.297048    2572 patch_prober.go:28] interesting pod/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 18:58:20.297482 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:20.297113    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt" podUID="b3bfe354-ed35-4322-bf5f-e8ec4491cedf" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 18:58:21.363091 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.363020    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:58:21.556290 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.556256    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-istio-envoy\") pod \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") "
Jul 17 18:58:21.556482 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.556311    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-workload-certs\") pod \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") "
Jul 17 18:58:21.556482 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.556335    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-credential-socket\") pod \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") "
Jul 17 18:58:21.556482 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.556357    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-istio-podinfo\") pod \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") "
Jul 17 18:58:21.556482 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.556410    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-workload-socket\") pod \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") "
Jul 17 18:58:21.556482 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.556439    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-istio-token\") pod \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") "
Jul 17 18:58:21.556758 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.556499    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-istio-data\") pod \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") "
Jul 17 18:58:21.556758 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.556546    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4876\" (UniqueName: \"kubernetes.io/projected/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-kube-api-access-z4876\") pod \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") "
Jul 17 18:58:21.556758 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.556593    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-istiod-ca-cert\") pod \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\" (UID: \"b3bfe354-ed35-4322-bf5f-e8ec4491cedf\") "
Jul 17 18:58:21.556758 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.556638    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b3bfe354-ed35-4322-bf5f-e8ec4491cedf" (UID: "b3bfe354-ed35-4322-bf5f-e8ec4491cedf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:58:21.556758 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.556689    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b3bfe354-ed35-4322-bf5f-e8ec4491cedf" (UID: "b3bfe354-ed35-4322-bf5f-e8ec4491cedf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:58:21.556758 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.556741    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b3bfe354-ed35-4322-bf5f-e8ec4491cedf" (UID: "b3bfe354-ed35-4322-bf5f-e8ec4491cedf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:58:21.557106 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.557062    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-workload-socket\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:58:21.557106 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.557073    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b3bfe354-ed35-4322-bf5f-e8ec4491cedf" (UID: "b3bfe354-ed35-4322-bf5f-e8ec4491cedf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:58:21.557106 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.557101    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-workload-certs\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:58:21.557273 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.557117    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-credential-socket\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:58:21.557725 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.557692    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-istio-data" (OuterVolumeSpecName: "istio-data") pod "b3bfe354-ed35-4322-bf5f-e8ec4491cedf" (UID: "b3bfe354-ed35-4322-bf5f-e8ec4491cedf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:58:21.558640 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.558607    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b3bfe354-ed35-4322-bf5f-e8ec4491cedf" (UID: "b3bfe354-ed35-4322-bf5f-e8ec4491cedf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 18:58:21.558640 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.558630    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b3bfe354-ed35-4322-bf5f-e8ec4491cedf" (UID: "b3bfe354-ed35-4322-bf5f-e8ec4491cedf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:58:21.558769 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.558677    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-istio-token" (OuterVolumeSpecName: "istio-token") pod "b3bfe354-ed35-4322-bf5f-e8ec4491cedf" (UID: "b3bfe354-ed35-4322-bf5f-e8ec4491cedf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:58:21.558876 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.558857    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-kube-api-access-z4876" (OuterVolumeSpecName: "kube-api-access-z4876") pod "b3bfe354-ed35-4322-bf5f-e8ec4491cedf" (UID: "b3bfe354-ed35-4322-bf5f-e8ec4491cedf"). InnerVolumeSpecName "kube-api-access-z4876". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:58:21.658239 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.658140    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-istio-token\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:58:21.658239 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.658174    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-istio-data\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:58:21.658239 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.658186    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4876\" (UniqueName: \"kubernetes.io/projected/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-kube-api-access-z4876\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:58:21.658239 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.658196    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-istiod-ca-cert\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:58:21.658239 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.658204    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-istio-envoy\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:58:21.658239 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.658211    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3bfe354-ed35-4322-bf5f-e8ec4491cedf-istio-podinfo\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:58:21.732255 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.732223    2572 generic.go:356] "Generic (PLEG): container finished" podID="b3bfe354-ed35-4322-bf5f-e8ec4491cedf" containerID="9009ac9a0707875a0e6e3483a0501cf87f38b6d44f759f71de34df4bbbeaef94" exitCode=0
Jul 17 18:58:21.732432 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.732269    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt" event={"ID":"b3bfe354-ed35-4322-bf5f-e8ec4491cedf","Type":"ContainerDied","Data":"9009ac9a0707875a0e6e3483a0501cf87f38b6d44f759f71de34df4bbbeaef94"}
Jul 17 18:58:21.732432 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.732314    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt" event={"ID":"b3bfe354-ed35-4322-bf5f-e8ec4491cedf","Type":"ContainerDied","Data":"82fe1f4c1afa78169dbe9bb31126c3775aceb3752c1bf0de2c02a5a03d4c6091"}
Jul 17 18:58:21.732432 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.732342    2572 scope.go:117] "RemoveContainer" containerID="9009ac9a0707875a0e6e3483a0501cf87f38b6d44f759f71de34df4bbbeaef94"
Jul 17 18:58:21.732432 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.732271    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"
Jul 17 18:58:21.742545 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.742526    2572 scope.go:117] "RemoveContainer" containerID="f0e19435a05ebe2648e80ec2f3aa73ca69d9957d0c291af18a5c1b47208edfca"
Jul 17 18:58:21.750885 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.750859    2572 scope.go:117] "RemoveContainer" containerID="9009ac9a0707875a0e6e3483a0501cf87f38b6d44f759f71de34df4bbbeaef94"
Jul 17 18:58:21.751248 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:58:21.751225    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9009ac9a0707875a0e6e3483a0501cf87f38b6d44f759f71de34df4bbbeaef94\": container with ID starting with 9009ac9a0707875a0e6e3483a0501cf87f38b6d44f759f71de34df4bbbeaef94 not found: ID does not exist" containerID="9009ac9a0707875a0e6e3483a0501cf87f38b6d44f759f71de34df4bbbeaef94"
Jul 17 18:58:21.751340 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.751260    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9009ac9a0707875a0e6e3483a0501cf87f38b6d44f759f71de34df4bbbeaef94"} err="failed to get container status \"9009ac9a0707875a0e6e3483a0501cf87f38b6d44f759f71de34df4bbbeaef94\": rpc error: code = NotFound desc = could not find container \"9009ac9a0707875a0e6e3483a0501cf87f38b6d44f759f71de34df4bbbeaef94\": container with ID starting with 9009ac9a0707875a0e6e3483a0501cf87f38b6d44f759f71de34df4bbbeaef94 not found: ID does not exist"
Jul 17 18:58:21.751340 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.751286    2572 scope.go:117] "RemoveContainer" containerID="f0e19435a05ebe2648e80ec2f3aa73ca69d9957d0c291af18a5c1b47208edfca"
Jul 17 18:58:21.751583 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:58:21.751563    2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0e19435a05ebe2648e80ec2f3aa73ca69d9957d0c291af18a5c1b47208edfca\": container with ID starting with f0e19435a05ebe2648e80ec2f3aa73ca69d9957d0c291af18a5c1b47208edfca not found: ID does not exist" containerID="f0e19435a05ebe2648e80ec2f3aa73ca69d9957d0c291af18a5c1b47208edfca"
Jul 17 18:58:21.751627 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.751589    2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0e19435a05ebe2648e80ec2f3aa73ca69d9957d0c291af18a5c1b47208edfca"} err="failed to get container status \"f0e19435a05ebe2648e80ec2f3aa73ca69d9957d0c291af18a5c1b47208edfca\": rpc error: code = NotFound desc = could not find container \"f0e19435a05ebe2648e80ec2f3aa73ca69d9957d0c291af18a5c1b47208edfca\": container with ID starting with f0e19435a05ebe2648e80ec2f3aa73ca69d9957d0c291af18a5c1b47208edfca not found: ID does not exist"
Jul 17 18:58:21.767066 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.767034    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"]
Jul 17 18:58:21.787683 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:21.784870    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-7d6f90-openshift-default-67dcf6cc9-8rsdt"]
Jul 17 18:58:23.472372 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:23.472334    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3bfe354-ed35-4322-bf5f-e8ec4491cedf" path="/var/lib/kubelet/pods/b3bfe354-ed35-4322-bf5f-e8ec4491cedf/volumes"
Jul 17 18:58:27.533335 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:27.533300    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm"]
Jul 17 18:58:27.533748 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:27.533504    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm" podUID="a7132a05-73d8-4873-8d5f-c9c14b96c384" containerName="maas-api" containerID="cri-o://255e78ee521bbd09c479d3cc63410477308409b3eb0fc51280a986295dddae5a" gracePeriod=30
Jul 17 18:58:27.556977 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:27.556946    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm" podUID="a7132a05-73d8-4873-8d5f-c9c14b96c384" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.108:8443/health\": dial tcp 10.132.0.108:8443: connect: connection refused"
Jul 17 18:58:27.580572 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:27.580539    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:58:27.764762 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:27.764730    2572 generic.go:356] "Generic (PLEG): container finished" podID="a7132a05-73d8-4873-8d5f-c9c14b96c384" containerID="255e78ee521bbd09c479d3cc63410477308409b3eb0fc51280a986295dddae5a" exitCode=0
Jul 17 18:58:27.764925 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:27.764793    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm" event={"ID":"a7132a05-73d8-4873-8d5f-c9c14b96c384","Type":"ContainerDied","Data":"255e78ee521bbd09c479d3cc63410477308409b3eb0fc51280a986295dddae5a"}
Jul 17 18:58:27.789700 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:27.789636    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm"
Jul 17 18:58:27.803673 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:27.803646    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vjxfg\" (UniqueName: \"kubernetes.io/projected/a7132a05-73d8-4873-8d5f-c9c14b96c384-kube-api-access-vjxfg\") pod \"a7132a05-73d8-4873-8d5f-c9c14b96c384\" (UID: \"a7132a05-73d8-4873-8d5f-c9c14b96c384\") "
Jul 17 18:58:27.803806 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:27.803704    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7132a05-73d8-4873-8d5f-c9c14b96c384-openshift-service-ca\") pod \"a7132a05-73d8-4873-8d5f-c9c14b96c384\" (UID: \"a7132a05-73d8-4873-8d5f-c9c14b96c384\") "
Jul 17 18:58:27.803806 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:27.803742    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7132a05-73d8-4873-8d5f-c9c14b96c384-maas-api-tls\") pod \"a7132a05-73d8-4873-8d5f-c9c14b96c384\" (UID: \"a7132a05-73d8-4873-8d5f-c9c14b96c384\") "
Jul 17 18:58:27.804084 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:27.804058    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7132a05-73d8-4873-8d5f-c9c14b96c384-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a7132a05-73d8-4873-8d5f-c9c14b96c384" (UID: "a7132a05-73d8-4873-8d5f-c9c14b96c384"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:58:27.805825 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:27.805797    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7132a05-73d8-4873-8d5f-c9c14b96c384-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a7132a05-73d8-4873-8d5f-c9c14b96c384" (UID: "a7132a05-73d8-4873-8d5f-c9c14b96c384"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 17 18:58:27.805920 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:27.805812    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7132a05-73d8-4873-8d5f-c9c14b96c384-kube-api-access-vjxfg" (OuterVolumeSpecName: "kube-api-access-vjxfg") pod "a7132a05-73d8-4873-8d5f-c9c14b96c384" (UID: "a7132a05-73d8-4873-8d5f-c9c14b96c384"). InnerVolumeSpecName "kube-api-access-vjxfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:58:27.904765 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:27.904726    2572 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7132a05-73d8-4873-8d5f-c9c14b96c384-openshift-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:58:27.904765 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:27.904760    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7132a05-73d8-4873-8d5f-c9c14b96c384-maas-api-tls\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:58:27.904765 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:27.904769    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vjxfg\" (UniqueName: \"kubernetes.io/projected/a7132a05-73d8-4873-8d5f-c9c14b96c384-kube-api-access-vjxfg\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:58:28.771111 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:28.771071    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm"
Jul 17 18:58:28.771111 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:28.771100    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm" event={"ID":"a7132a05-73d8-4873-8d5f-c9c14b96c384","Type":"ContainerDied","Data":"cda04612a4771af8e1c67a622e2f14f809ed074aa7d7abe6dbac102f1b5df5be"}
Jul 17 18:58:28.771601 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:28.771163    2572 scope.go:117] "RemoveContainer" containerID="255e78ee521bbd09c479d3cc63410477308409b3eb0fc51280a986295dddae5a"
Jul 17 18:58:28.812171 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:28.812127    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm"]
Jul 17 18:58:28.822948 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:28.822913    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-52fc47-5d84fccfdf-trglm"]
Jul 17 18:58:29.471331 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:29.471299    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7132a05-73d8-4873-8d5f-c9c14b96c384" path="/var/lib/kubelet/pods/a7132a05-73d8-4873-8d5f-c9c14b96c384/volumes"
Jul 17 18:58:31.849313 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:31.849279    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:58:40.106182 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:40.106139    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:58:42.721229 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:42.721192    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"]
Jul 17 18:58:42.721750 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:42.721403    2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8" podUID="672e7c92-b47f-49dd-849d-3524dc8b9edc" containerName="istio-proxy" containerID="cri-o://26863e4e90bd34158349ee2b3c0c557320902c4d1d9b73b165d6af910260e965" gracePeriod=30
Jul 17 18:58:42.796913 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:42.796857    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:58:43.071815 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:43.071722    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:58:46.950034 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:46.949982    2572 patch_prober.go:28] interesting pod/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 17 18:58:46.950420 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:46.950067    2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8" podUID="672e7c92-b47f-49dd-849d-3524dc8b9edc" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 17 18:58:47.879588 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:47.879552    2572 generic.go:356] "Generic (PLEG): container finished" podID="672e7c92-b47f-49dd-849d-3524dc8b9edc" containerID="26863e4e90bd34158349ee2b3c0c557320902c4d1d9b73b165d6af910260e965" exitCode=0
Jul 17 18:58:47.879754 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:47.879612    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8" event={"ID":"672e7c92-b47f-49dd-849d-3524dc8b9edc","Type":"ContainerDied","Data":"26863e4e90bd34158349ee2b3c0c557320902c4d1d9b73b165d6af910260e965"}
Jul 17 18:58:47.879754 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:47.879674    2572 scope.go:117] "RemoveContainer" containerID="5f18060f21da796867cf8a0beb6ec85cf4ee946bfef2d52f27dd03db7cc336b8"
Jul 17 18:58:47.981727 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:47.981646    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:58:48.088784 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:48.088745    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/672e7c92-b47f-49dd-849d-3524dc8b9edc-istio-token\") pod \"672e7c92-b47f-49dd-849d-3524dc8b9edc\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") "
Jul 17 18:58:48.088784 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:48.088788    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/672e7c92-b47f-49dd-849d-3524dc8b9edc-istio-podinfo\") pod \"672e7c92-b47f-49dd-849d-3524dc8b9edc\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") "
Jul 17 18:58:48.089104 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:48.088825    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/672e7c92-b47f-49dd-849d-3524dc8b9edc-istio-envoy\") pod \"672e7c92-b47f-49dd-849d-3524dc8b9edc\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") "
Jul 17 18:58:48.089104 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:48.088888    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/672e7c92-b47f-49dd-849d-3524dc8b9edc-istiod-ca-cert\") pod \"672e7c92-b47f-49dd-849d-3524dc8b9edc\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") "
Jul 17 18:58:48.089104 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:48.088927    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/672e7c92-b47f-49dd-849d-3524dc8b9edc-workload-socket\") pod \"672e7c92-b47f-49dd-849d-3524dc8b9edc\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") "
Jul 17 18:58:48.089104 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:48.088962    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bcl2\" (UniqueName: \"kubernetes.io/projected/672e7c92-b47f-49dd-849d-3524dc8b9edc-kube-api-access-9bcl2\") pod \"672e7c92-b47f-49dd-849d-3524dc8b9edc\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") "
Jul 17 18:58:48.089104 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:48.089041    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/672e7c92-b47f-49dd-849d-3524dc8b9edc-workload-certs\") pod \"672e7c92-b47f-49dd-849d-3524dc8b9edc\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") "
Jul 17 18:58:48.089360 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:48.089107    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/672e7c92-b47f-49dd-849d-3524dc8b9edc-credential-socket\") pod \"672e7c92-b47f-49dd-849d-3524dc8b9edc\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") "
Jul 17 18:58:48.089360 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:48.089138    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/672e7c92-b47f-49dd-849d-3524dc8b9edc-istio-data\") pod \"672e7c92-b47f-49dd-849d-3524dc8b9edc\" (UID: \"672e7c92-b47f-49dd-849d-3524dc8b9edc\") "
Jul 17 18:58:48.089360 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:48.089325    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/672e7c92-b47f-49dd-849d-3524dc8b9edc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "672e7c92-b47f-49dd-849d-3524dc8b9edc" (UID: "672e7c92-b47f-49dd-849d-3524dc8b9edc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:58:48.089533 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:48.089412    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/672e7c92-b47f-49dd-849d-3524dc8b9edc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "672e7c92-b47f-49dd-849d-3524dc8b9edc" (UID: "672e7c92-b47f-49dd-849d-3524dc8b9edc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:58:48.089533 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:48.089432    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/672e7c92-b47f-49dd-849d-3524dc8b9edc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "672e7c92-b47f-49dd-849d-3524dc8b9edc" (UID: "672e7c92-b47f-49dd-849d-3524dc8b9edc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:58:48.089649 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:48.089603    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/672e7c92-b47f-49dd-849d-3524dc8b9edc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "672e7c92-b47f-49dd-849d-3524dc8b9edc" (UID: "672e7c92-b47f-49dd-849d-3524dc8b9edc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:58:48.089730 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:48.089709    2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/672e7c92-b47f-49dd-849d-3524dc8b9edc-workload-socket\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:58:48.089788 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:48.089733    2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/672e7c92-b47f-49dd-849d-3524dc8b9edc-workload-certs\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:58:48.089788 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:48.089746    2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/672e7c92-b47f-49dd-849d-3524dc8b9edc-istiod-ca-cert\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:58:48.090050 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:48.090023    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/672e7c92-b47f-49dd-849d-3524dc8b9edc-istio-data" (OuterVolumeSpecName: "istio-data") pod "672e7c92-b47f-49dd-849d-3524dc8b9edc" (UID: "672e7c92-b47f-49dd-849d-3524dc8b9edc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:58:48.091349 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:48.091328    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/672e7c92-b47f-49dd-849d-3524dc8b9edc-istio-token" (OuterVolumeSpecName: "istio-token") pod "672e7c92-b47f-49dd-849d-3524dc8b9edc" (UID: "672e7c92-b47f-49dd-849d-3524dc8b9edc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:58:48.091672 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:48.091655    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/672e7c92-b47f-49dd-849d-3524dc8b9edc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "672e7c92-b47f-49dd-849d-3524dc8b9edc" (UID: "672e7c92-b47f-49dd-849d-3524dc8b9edc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 17 18:58:48.091743 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:48.091665    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/672e7c92-b47f-49dd-849d-3524dc8b9edc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "672e7c92-b47f-49dd-849d-3524dc8b9edc" (UID: "672e7c92-b47f-49dd-849d-3524dc8b9edc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 17 18:58:48.091743 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:48.091717    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/672e7c92-b47f-49dd-849d-3524dc8b9edc-kube-api-access-9bcl2" (OuterVolumeSpecName: "kube-api-access-9bcl2") pod "672e7c92-b47f-49dd-849d-3524dc8b9edc" (UID: "672e7c92-b47f-49dd-849d-3524dc8b9edc"). InnerVolumeSpecName "kube-api-access-9bcl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 17 18:58:48.190635 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:48.190595    2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bcl2\" (UniqueName: \"kubernetes.io/projected/672e7c92-b47f-49dd-849d-3524dc8b9edc-kube-api-access-9bcl2\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:58:48.190635 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:48.190627    2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/672e7c92-b47f-49dd-849d-3524dc8b9edc-credential-socket\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:58:48.190635 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:48.190638    2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/672e7c92-b47f-49dd-849d-3524dc8b9edc-istio-data\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:58:48.190635 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:48.190647    2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/672e7c92-b47f-49dd-849d-3524dc8b9edc-istio-token\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:58:48.190914 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:48.190655    2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/672e7c92-b47f-49dd-849d-3524dc8b9edc-istio-podinfo\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:58:48.190914 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:48.190663    2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/672e7c92-b47f-49dd-849d-3524dc8b9edc-istio-envoy\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:58:48.892668 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:48.892628    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"
Jul 17 18:58:48.892668 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:48.892658    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8" event={"ID":"672e7c92-b47f-49dd-849d-3524dc8b9edc","Type":"ContainerDied","Data":"0e7d1543b7f7766a6850695cd3f028b4719879f5566f7999cf626dc0a6096e35"}
Jul 17 18:58:48.892893 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:48.892747    2572 scope.go:117] "RemoveContainer" containerID="26863e4e90bd34158349ee2b3c0c557320902c4d1d9b73b165d6af910260e965"
Jul 17 18:58:48.934537 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:48.934507    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"]
Jul 17 18:58:48.947043 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:48.947011    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-52fc47-openshift-default-6b7f58999f-wzfx8"]
Jul 17 18:58:49.472293 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:49.472258    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="672e7c92-b47f-49dd-849d-3524dc8b9edc" path="/var/lib/kubelet/pods/672e7c92-b47f-49dd-849d-3524dc8b9edc/volumes"
Jul 17 18:58:50.078735 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:50.078705    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7bd9bf478b-lr6df_538faa02-ec5b-40f6-b1b7-d0f347c3fde6/manager/0.log"
Jul 17 18:58:50.493236 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:50.493205    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d8bdcf84-2h9jr_9c4f73f4-d262-4108-8364-8ef043ef62b2/copy-manifests/0.log"
Jul 17 18:58:50.508089 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:50.508056    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d8bdcf84-2h9jr_9c4f73f4-d262-4108-8364-8ef043ef62b2/manager/0.log"
Jul 17 18:58:51.225479 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:51.225445    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-54f756bdb9-lhfj7_7a3a01ba-9893-4f8a-8504-08d3f49624fc/maas-api/0.log"
Jul 17 18:58:52.302547 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:52.302515    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-186d6157-7mv2t_b94cc690-99d6-464b-941a-c8f1ebb8cf21/revoke-keys/0.log"
Jul 17 18:58:52.458987 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:52.458953    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-89d8005f-ttq7b_bb1d7e03-4955-4dfd-a9bd-cfd52ddf304f/revoke-keys/0.log"
Jul 17 18:58:52.851130 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:52.851105    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-g4wgb_7120cfdb-5cf3-4c51-8777-4d241b4d01f3/postgres/0.log"
Jul 17 18:58:55.754625 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:55.754597    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678gcx8b_fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f/istio-proxy/0.log"
Jul 17 18:58:56.291955 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:56.291920    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-782cg_14cc383a-23f0-4842-8d03-2fb3f65d95dc/istio-proxy/1.log"
Jul 17 18:58:56.568531 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:56.568446    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-5f4bx_7e0015f8-1c3d-49e1-92f8-647fd7b44ac8/payload-processing/0.log"
Jul 17 18:58:56.702259 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:56.702219    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66554f4bf4-w2s2r_a940a062-485b-4183-91ea-b6c674362b0a/router/0.log"
Jul 17 18:58:57.064964 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:57.064934    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-fgrnh_45cabb45-79ad-486b-9df7-a45df257d999/main/0.log"
Jul 17 18:58:57.453970 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:58:57.453943    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86db2k8g6_a7f848a7-2315-4b0a-be4c-71eb4a4960a9/main/0.log"
Jul 17 18:59:01.865178 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:01.865134    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-ppkc5"]
Jul 17 18:59:01.865576 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:01.865494    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="672e7c92-b47f-49dd-849d-3524dc8b9edc" containerName="istio-proxy"
Jul 17 18:59:01.865576 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:01.865505    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="672e7c92-b47f-49dd-849d-3524dc8b9edc" containerName="istio-proxy"
Jul 17 18:59:01.865576 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:01.865518    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86422ed7-a22a-450a-b098-bc123aeb4714" containerName="maas-api"
Jul 17 18:59:01.865576 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:01.865524    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="86422ed7-a22a-450a-b098-bc123aeb4714" containerName="maas-api"
Jul 17 18:59:01.865576 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:01.865531    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3bfe354-ed35-4322-bf5f-e8ec4491cedf" containerName="istio-proxy"
Jul 17 18:59:01.865576 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:01.865536    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3bfe354-ed35-4322-bf5f-e8ec4491cedf" containerName="istio-proxy"
Jul 17 18:59:01.865576 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:01.865549    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01f43240-3be7-49ab-bb6d-b5973f78c1aa" containerName="revoke-keys"
Jul 17 18:59:01.865576 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:01.865555    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="01f43240-3be7-49ab-bb6d-b5973f78c1aa" containerName="revoke-keys"
Jul 17 18:59:01.865576 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:01.865566    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01f43240-3be7-49ab-bb6d-b5973f78c1aa" containerName="revoke-keys"
Jul 17 18:59:01.865576 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:01.865572    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="01f43240-3be7-49ab-bb6d-b5973f78c1aa" containerName="revoke-keys"
Jul 17 18:59:01.865885 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:01.865583    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7132a05-73d8-4873-8d5f-c9c14b96c384" containerName="maas-api"
Jul 17 18:59:01.865885 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:01.865590    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7132a05-73d8-4873-8d5f-c9c14b96c384" containerName="maas-api"
Jul 17 18:59:01.865885 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:01.865646    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="672e7c92-b47f-49dd-849d-3524dc8b9edc" containerName="istio-proxy"
Jul 17 18:59:01.865885 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:01.865652    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="672e7c92-b47f-49dd-849d-3524dc8b9edc" containerName="istio-proxy"
Jul 17 18:59:01.865885 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:01.865658    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="01f43240-3be7-49ab-bb6d-b5973f78c1aa" containerName="revoke-keys"
Jul 17 18:59:01.865885 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:01.865664    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="01f43240-3be7-49ab-bb6d-b5973f78c1aa" containerName="revoke-keys"
Jul 17 18:59:01.865885 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:01.865671    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="86422ed7-a22a-450a-b098-bc123aeb4714" containerName="maas-api"
Jul 17 18:59:01.865885 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:01.865677    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3bfe354-ed35-4322-bf5f-e8ec4491cedf" containerName="istio-proxy"
Jul 17 18:59:01.865885 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:01.865684    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7132a05-73d8-4873-8d5f-c9c14b96c384" containerName="maas-api"
Jul 17 18:59:01.865885 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:01.865689    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3bfe354-ed35-4322-bf5f-e8ec4491cedf" containerName="istio-proxy"
Jul 17 18:59:01.868716 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:01.868698    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-ppkc5"
Jul 17 18:59:01.872826 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:01.872803    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:59:01.885588 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:01.885549    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-ppkc5"]
Jul 17 18:59:02.017316 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:02.017282    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b96bdf00-5869-48e5-9a7a-7ef829b51f61-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-df78e9c5-ppkc5\" (UID: \"b96bdf00-5869-48e5-9a7a-7ef829b51f61\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-ppkc5"
Jul 17 18:59:02.118879 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:02.118781    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b96bdf00-5869-48e5-9a7a-7ef829b51f61-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-df78e9c5-ppkc5\" (UID: \"b96bdf00-5869-48e5-9a7a-7ef829b51f61\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-ppkc5"
Jul 17 18:59:02.119501 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:02.119474    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b96bdf00-5869-48e5-9a7a-7ef829b51f61-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-df78e9c5-ppkc5\" (UID: \"b96bdf00-5869-48e5-9a7a-7ef829b51f61\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-ppkc5"
Jul 17 18:59:02.179317 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:02.179281    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-ppkc5"
Jul 17 18:59:02.335936 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:02.335906    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-ppkc5"]
Jul 17 18:59:02.339050 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:59:02.338992    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb96bdf00_5869_48e5_9a7a_7ef829b51f61.slice/crio-069308a5fd9f3d591e0b7940b4a07d10ebc77303aa6144f1eb73bdf33e9bfb3f WatchSource:0}: Error finding container 069308a5fd9f3d591e0b7940b4a07d10ebc77303aa6144f1eb73bdf33e9bfb3f: Status 404 returned error can't find the container with id 069308a5fd9f3d591e0b7940b4a07d10ebc77303aa6144f1eb73bdf33e9bfb3f
Jul 17 18:59:02.964236 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:02.964195    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-ppkc5" event={"ID":"b96bdf00-5869-48e5-9a7a-7ef829b51f61","Type":"ContainerStarted","Data":"5df376e564da1a7b65c15a676b10be50e95e09879699f3d6d8f7f4d92148ae3e"}
Jul 17 18:59:02.964749 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:02.964257    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-ppkc5" event={"ID":"b96bdf00-5869-48e5-9a7a-7ef829b51f61","Type":"ContainerStarted","Data":"069308a5fd9f3d591e0b7940b4a07d10ebc77303aa6144f1eb73bdf33e9bfb3f"}
Jul 17 18:59:02.998716 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:02.998658    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-ppkc5" podStartSLOduration=1.99863447 podStartE2EDuration="1.99863447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:59:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:59:02.997369294 +0000 UTC m=+3770.222598601" watchObservedRunningTime="2026-07-17 18:59:02.99863447 +0000 UTC m=+3770.223863782"
Jul 17 18:59:03.970915 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:03.970876    2572 generic.go:356] "Generic (PLEG): container finished" podID="b96bdf00-5869-48e5-9a7a-7ef829b51f61" containerID="5df376e564da1a7b65c15a676b10be50e95e09879699f3d6d8f7f4d92148ae3e" exitCode=6
Jul 17 18:59:03.971337 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:03.970957    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-ppkc5" event={"ID":"b96bdf00-5869-48e5-9a7a-7ef829b51f61","Type":"ContainerDied","Data":"5df376e564da1a7b65c15a676b10be50e95e09879699f3d6d8f7f4d92148ae3e"}
Jul 17 18:59:03.971337 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:03.971164    2572 scope.go:117] "RemoveContainer" containerID="5df376e564da1a7b65c15a676b10be50e95e09879699f3d6d8f7f4d92148ae3e"
Jul 17 18:59:04.360437 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:04.360402    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lz7w4/must-gather-wn2cc"]
Jul 17 18:59:04.360827 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:04.360813    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="672e7c92-b47f-49dd-849d-3524dc8b9edc" containerName="istio-proxy"
Jul 17 18:59:04.360879 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:04.360829    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="672e7c92-b47f-49dd-849d-3524dc8b9edc" containerName="istio-proxy"
Jul 17 18:59:04.360879 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:04.360847    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3bfe354-ed35-4322-bf5f-e8ec4491cedf" containerName="istio-proxy"
Jul 17 18:59:04.360879 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:04.360856    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3bfe354-ed35-4322-bf5f-e8ec4491cedf" containerName="istio-proxy"
Jul 17 18:59:04.360879 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:04.360867    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01f43240-3be7-49ab-bb6d-b5973f78c1aa" containerName="revoke-keys"
Jul 17 18:59:04.360879 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:04.360873    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="01f43240-3be7-49ab-bb6d-b5973f78c1aa" containerName="revoke-keys"
Jul 17 18:59:04.361053 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:04.360966    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="01f43240-3be7-49ab-bb6d-b5973f78c1aa" containerName="revoke-keys"
Jul 17 18:59:04.364272 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:04.364253    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lz7w4/must-gather-wn2cc"
Jul 17 18:59:04.375983 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:04.375953    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:59:04.379628 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:04.379611    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lz7w4\"/\"openshift-service-ca.crt\""
Jul 17 18:59:04.379862 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:04.379845    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lz7w4\"/\"default-dockercfg-ft9qh\""
Jul 17 18:59:04.382473 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:04.382455    2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lz7w4\"/\"kube-root-ca.crt\""
Jul 17 18:59:04.417959 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:04.417926    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lz7w4/must-gather-wn2cc"]
Jul 17 18:59:04.440309 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:04.440271    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bd045242-57bc-4e76-94e2-f75cc58acbdd-must-gather-output\") pod \"must-gather-wn2cc\" (UID: \"bd045242-57bc-4e76-94e2-f75cc58acbdd\") " pod="openshift-must-gather-lz7w4/must-gather-wn2cc"
Jul 17 18:59:04.440501 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:04.440376    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rkf5\" (UniqueName: \"kubernetes.io/projected/bd045242-57bc-4e76-94e2-f75cc58acbdd-kube-api-access-2rkf5\") pod \"must-gather-wn2cc\" (UID: \"bd045242-57bc-4e76-94e2-f75cc58acbdd\") " pod="openshift-must-gather-lz7w4/must-gather-wn2cc"
Jul 17 18:59:04.541227 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:04.541125    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rkf5\" (UniqueName: \"kubernetes.io/projected/bd045242-57bc-4e76-94e2-f75cc58acbdd-kube-api-access-2rkf5\") pod \"must-gather-wn2cc\" (UID: \"bd045242-57bc-4e76-94e2-f75cc58acbdd\") " pod="openshift-must-gather-lz7w4/must-gather-wn2cc"
Jul 17 18:59:04.541385 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:04.541262    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bd045242-57bc-4e76-94e2-f75cc58acbdd-must-gather-output\") pod \"must-gather-wn2cc\" (UID: \"bd045242-57bc-4e76-94e2-f75cc58acbdd\") " pod="openshift-must-gather-lz7w4/must-gather-wn2cc"
Jul 17 18:59:04.541575 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:04.541559    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bd045242-57bc-4e76-94e2-f75cc58acbdd-must-gather-output\") pod \"must-gather-wn2cc\" (UID: \"bd045242-57bc-4e76-94e2-f75cc58acbdd\") " pod="openshift-must-gather-lz7w4/must-gather-wn2cc"
Jul 17 18:59:04.574968 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:04.574931    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rkf5\" (UniqueName: \"kubernetes.io/projected/bd045242-57bc-4e76-94e2-f75cc58acbdd-kube-api-access-2rkf5\") pod \"must-gather-wn2cc\" (UID: \"bd045242-57bc-4e76-94e2-f75cc58acbdd\") " pod="openshift-must-gather-lz7w4/must-gather-wn2cc"
Jul 17 18:59:04.674192 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:04.674151    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lz7w4/must-gather-wn2cc"
Jul 17 18:59:04.746047 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:04.745971    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024
Jul 17 18:59:04.854072 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:04.853957    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lz7w4/must-gather-wn2cc"]
Jul 17 18:59:04.858285 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:59:04.858251    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbd045242_57bc_4e76_94e2_f75cc58acbdd.slice/crio-2e648315df5f90bb6b4888a551c3e11ddbe046ac1afe44b462d3471212822296 WatchSource:0}: Error finding container 2e648315df5f90bb6b4888a551c3e11ddbe046ac1afe44b462d3471212822296: Status 404 returned error can't find the container with id 2e648315df5f90bb6b4888a551c3e11ddbe046ac1afe44b462d3471212822296
Jul 17 18:59:04.860402 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:04.860381    2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 17 18:59:04.977169 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:04.977136    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lz7w4/must-gather-wn2cc" event={"ID":"bd045242-57bc-4e76-94e2-f75cc58acbdd","Type":"ContainerStarted","Data":"2e648315df5f90bb6b4888a551c3e11ddbe046ac1afe44b462d3471212822296"}
Jul 17 18:59:04.979019 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:04.978975    2572 generic.go:356] "Generic (PLEG): container finished" podID="b96bdf00-5869-48e5-9a7a-7ef829b51f61" containerID="e11d22ba8993e508dc43f131090807acf5ab204aaf95941d05503797d4c4971d" exitCode=6
Jul 17 18:59:04.979160 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:04.979024    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-ppkc5" event={"ID":"b96bdf00-5869-48e5-9a7a-7ef829b51f61","Type":"ContainerDied","Data":"e11d22ba8993e508dc43f131090807acf5ab204aaf95941d05503797d4c4971d"}
Jul 17 18:59:04.979160 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:04.979083    2572 scope.go:117] "RemoveContainer" containerID="5df376e564da1a7b65c15a676b10be50e95e09879699f3d6d8f7f4d92148ae3e"
Jul 17 18:59:04.979352 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:04.979331    2572 scope.go:117] "RemoveContainer" containerID="e11d22ba8993e508dc43f131090807acf5ab204aaf95941d05503797d4c4971d"
Jul 17 18:59:04.979585 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:59:04.979559    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-df78e9c5-ppkc5_odh-ai-gateway-infra(b96bdf00-5869-48e5-9a7a-7ef829b51f61)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-ppkc5" podUID="b96bdf00-5869-48e5-9a7a-7ef829b51f61"
Jul 17 18:59:05.987653 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:05.987623    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lz7w4/must-gather-wn2cc" event={"ID":"bd045242-57bc-4e76-94e2-f75cc58acbdd","Type":"ContainerStarted","Data":"c4a1d1c2f8be3a78eead8374cc2f006e9c9396ad5730bbb84e04ace5ea6007ea"}
Jul 17 18:59:05.989701 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:05.989681    2572 scope.go:117] "RemoveContainer" containerID="e11d22ba8993e508dc43f131090807acf5ab204aaf95941d05503797d4c4971d"
Jul 17 18:59:05.989918 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:59:05.989896    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-df78e9c5-ppkc5_odh-ai-gateway-infra(b96bdf00-5869-48e5-9a7a-7ef829b51f61)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-ppkc5" podUID="b96bdf00-5869-48e5-9a7a-7ef829b51f61"
Jul 17 18:59:06.996494 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:06.996459    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lz7w4/must-gather-wn2cc" event={"ID":"bd045242-57bc-4e76-94e2-f75cc58acbdd","Type":"ContainerStarted","Data":"4d3b203868ca2fed3edb5db3680073bbc92824b34234a23ed6ea8506d5d7977f"}
Jul 17 18:59:07.040301 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:07.040248    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lz7w4/must-gather-wn2cc" podStartSLOduration=2.011751748 podStartE2EDuration="3.040232968s" totalImagesPullingTime="1.02848122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:59:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:59:07.038877531 +0000 UTC m=+3774.264106838" watchObservedRunningTime="2026-07-17 18:59:07.040232968 +0000 UTC m=+3774.265462276"
Jul 17 18:59:08.134389 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:08.134360    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ldrq9_7403c99b-bdb6-4595-916c-b4b8d138f4d0/global-pull-secret-syncer/0.log"
Jul 17 18:59:08.484608 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:08.484560    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log"
Jul 17 18:59:08.691326 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:08.691301    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-226.ec2.internal_8bfbaed7d32901437b702fd04e14392e/haproxy/0.log"
Jul 17 18:59:16.654143 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:16.654111    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-76cf8966f8-724gg_64492602-a837-4470-a8e1-0dba2157232d/cluster-monitoring-operator/0.log"
Jul 17 18:59:16.941475 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:16.941448    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f7m5g_4cd14467-3251-4512-9c15-3b76bce4243a/node-exporter/0.log"
Jul 17 18:59:17.040771 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:17.040741    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f7m5g_4cd14467-3251-4512-9c15-3b76bce4243a/kube-rbac-proxy/0.log"
Jul 17 18:59:17.097590 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:17.097560    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-f7m5g_4cd14467-3251-4512-9c15-3b76bce4243a/init-textfile/0.log"
Jul 17 18:59:17.608660 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:17.608623    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lz7w4/perf-node-gather-daemonset-5s8tk"]
Jul 17 18:59:17.614816 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:17.614789    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lz7w4/perf-node-gather-daemonset-5s8tk"
Jul 17 18:59:17.640381 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:17.640334    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lz7w4/perf-node-gather-daemonset-5s8tk"]
Jul 17 18:59:17.673089 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:17.672615    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a814e20-fcf2-4823-a36a-c281e0bacdd3-podres\") pod \"perf-node-gather-daemonset-5s8tk\" (UID: \"3a814e20-fcf2-4823-a36a-c281e0bacdd3\") " pod="openshift-must-gather-lz7w4/perf-node-gather-daemonset-5s8tk"
Jul 17 18:59:17.673089 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:17.672676    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a814e20-fcf2-4823-a36a-c281e0bacdd3-proc\") pod \"perf-node-gather-daemonset-5s8tk\" (UID: \"3a814e20-fcf2-4823-a36a-c281e0bacdd3\") " pod="openshift-must-gather-lz7w4/perf-node-gather-daemonset-5s8tk"
Jul 17 18:59:17.673089 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:17.672728    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a814e20-fcf2-4823-a36a-c281e0bacdd3-sys\") pod \"perf-node-gather-daemonset-5s8tk\" (UID: \"3a814e20-fcf2-4823-a36a-c281e0bacdd3\") " pod="openshift-must-gather-lz7w4/perf-node-gather-daemonset-5s8tk"
Jul 17 18:59:17.673089 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:17.672759    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a814e20-fcf2-4823-a36a-c281e0bacdd3-lib-modules\") pod \"perf-node-gather-daemonset-5s8tk\" (UID: \"3a814e20-fcf2-4823-a36a-c281e0bacdd3\") " pod="openshift-must-gather-lz7w4/perf-node-gather-daemonset-5s8tk"
Jul 17 18:59:17.673089 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:17.672830    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68x7d\" (UniqueName: \"kubernetes.io/projected/3a814e20-fcf2-4823-a36a-c281e0bacdd3-kube-api-access-68x7d\") pod \"perf-node-gather-daemonset-5s8tk\" (UID: \"3a814e20-fcf2-4823-a36a-c281e0bacdd3\") " pod="openshift-must-gather-lz7w4/perf-node-gather-daemonset-5s8tk"
Jul 17 18:59:17.773454 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:17.773408    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a814e20-fcf2-4823-a36a-c281e0bacdd3-sys\") pod \"perf-node-gather-daemonset-5s8tk\" (UID: \"3a814e20-fcf2-4823-a36a-c281e0bacdd3\") " pod="openshift-must-gather-lz7w4/perf-node-gather-daemonset-5s8tk"
Jul 17 18:59:17.773659 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:17.773464    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a814e20-fcf2-4823-a36a-c281e0bacdd3-lib-modules\") pod \"perf-node-gather-daemonset-5s8tk\" (UID: \"3a814e20-fcf2-4823-a36a-c281e0bacdd3\") " pod="openshift-must-gather-lz7w4/perf-node-gather-daemonset-5s8tk"
Jul 17 18:59:17.773659 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:17.773531    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68x7d\" (UniqueName: \"kubernetes.io/projected/3a814e20-fcf2-4823-a36a-c281e0bacdd3-kube-api-access-68x7d\") pod \"perf-node-gather-daemonset-5s8tk\" (UID: \"3a814e20-fcf2-4823-a36a-c281e0bacdd3\") " pod="openshift-must-gather-lz7w4/perf-node-gather-daemonset-5s8tk"
Jul 17 18:59:17.773659 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:17.773637    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a814e20-fcf2-4823-a36a-c281e0bacdd3-podres\") pod \"perf-node-gather-daemonset-5s8tk\" (UID: \"3a814e20-fcf2-4823-a36a-c281e0bacdd3\") " pod="openshift-must-gather-lz7w4/perf-node-gather-daemonset-5s8tk"
Jul 17 18:59:17.773814 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:17.773660    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a814e20-fcf2-4823-a36a-c281e0bacdd3-proc\") pod \"perf-node-gather-daemonset-5s8tk\" (UID: \"3a814e20-fcf2-4823-a36a-c281e0bacdd3\") " pod="openshift-must-gather-lz7w4/perf-node-gather-daemonset-5s8tk"
Jul 17 18:59:17.773814 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:17.773766    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3a814e20-fcf2-4823-a36a-c281e0bacdd3-proc\") pod \"perf-node-gather-daemonset-5s8tk\" (UID: \"3a814e20-fcf2-4823-a36a-c281e0bacdd3\") " pod="openshift-must-gather-lz7w4/perf-node-gather-daemonset-5s8tk"
Jul 17 18:59:17.773959 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:17.773825    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3a814e20-fcf2-4823-a36a-c281e0bacdd3-sys\") pod \"perf-node-gather-daemonset-5s8tk\" (UID: \"3a814e20-fcf2-4823-a36a-c281e0bacdd3\") " pod="openshift-must-gather-lz7w4/perf-node-gather-daemonset-5s8tk"
Jul 17 18:59:17.773959 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:17.773936    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3a814e20-fcf2-4823-a36a-c281e0bacdd3-lib-modules\") pod \"perf-node-gather-daemonset-5s8tk\" (UID: \"3a814e20-fcf2-4823-a36a-c281e0bacdd3\") " pod="openshift-must-gather-lz7w4/perf-node-gather-daemonset-5s8tk"
Jul 17 18:59:17.774362 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:17.774334    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3a814e20-fcf2-4823-a36a-c281e0bacdd3-podres\") pod \"perf-node-gather-daemonset-5s8tk\" (UID: \"3a814e20-fcf2-4823-a36a-c281e0bacdd3\") " pod="openshift-must-gather-lz7w4/perf-node-gather-daemonset-5s8tk"
Jul 17 18:59:17.795221 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:17.795189    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-68x7d\" (UniqueName: \"kubernetes.io/projected/3a814e20-fcf2-4823-a36a-c281e0bacdd3-kube-api-access-68x7d\") pod \"perf-node-gather-daemonset-5s8tk\" (UID: \"3a814e20-fcf2-4823-a36a-c281e0bacdd3\") " pod="openshift-must-gather-lz7w4/perf-node-gather-daemonset-5s8tk"
Jul 17 18:59:17.927762 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:17.927665    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lz7w4/perf-node-gather-daemonset-5s8tk"
Jul 17 18:59:18.101958 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:18.101925    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lz7w4/perf-node-gather-daemonset-5s8tk"]
Jul 17 18:59:18.103982 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:59:18.103938    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3a814e20_fcf2_4823_a36a_c281e0bacdd3.slice/crio-d820cfb0626c77cea601bb5b49b00458745bc4a7c28e0c600fb6b7fb63bbc4e5 WatchSource:0}: Error finding container d820cfb0626c77cea601bb5b49b00458745bc4a7c28e0c600fb6b7fb63bbc4e5: Status 404 returned error can't find the container with id d820cfb0626c77cea601bb5b49b00458745bc4a7c28e0c600fb6b7fb63bbc4e5
Jul 17 18:59:18.561267 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:18.561144    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-85574b5f49-jm4nt_15418031-8434-4b11-aeec-f204858ccece/prometheus-operator-admission-webhook/0.log"
Jul 17 18:59:19.096476 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:19.096434    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lz7w4/perf-node-gather-daemonset-5s8tk" event={"ID":"3a814e20-fcf2-4823-a36a-c281e0bacdd3","Type":"ContainerStarted","Data":"ab6f286ac0182246f8e600e3c6f6316460f7be1f74aca098b1e6631ec6d5438c"}
Jul 17 18:59:19.096986 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:19.096501    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lz7w4/perf-node-gather-daemonset-5s8tk" event={"ID":"3a814e20-fcf2-4823-a36a-c281e0bacdd3","Type":"ContainerStarted","Data":"d820cfb0626c77cea601bb5b49b00458745bc4a7c28e0c600fb6b7fb63bbc4e5"}
Jul 17 18:59:19.096986 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:19.096733    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lz7w4/perf-node-gather-daemonset-5s8tk"
Jul 17 18:59:19.126487 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:19.126422    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lz7w4/perf-node-gather-daemonset-5s8tk" podStartSLOduration=2.1264007129999998 podStartE2EDuration="2.126400713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-17 18:59:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:59:19.123802943 +0000 UTC m=+3786.349032252" watchObservedRunningTime="2026-07-17 18:59:19.126400713 +0000 UTC m=+3786.351630022"
Jul 17 18:59:19.466159 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:19.466124    2572 scope.go:117] "RemoveContainer" containerID="e11d22ba8993e508dc43f131090807acf5ab204aaf95941d05503797d4c4971d"
Jul 17 18:59:20.105230 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:20.105138    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-ppkc5" event={"ID":"b96bdf00-5869-48e5-9a7a-7ef829b51f61","Type":"ContainerStarted","Data":"70bf2aaf827b96659aba3e9a2f207e506969d7e03f9819f5c016d4b639f9ca1a"}
Jul 17 18:59:20.154287 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:20.154259    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-2bl9v_9dbae37d-620b-45a5-a903-177293265c8d/networking-console-plugin/0.log"
Jul 17 18:59:20.810931 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:20.810895    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tp9qm_6c101a17-a051-4e9d-a9dd-f72c67ba2a8a/console-operator/2.log"
Jul 17 18:59:20.816173 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:20.816131    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-565b7b569d-tp9qm_6c101a17-a051-4e9d-a9dd-f72c67ba2a8a/console-operator/3.log"
Jul 17 18:59:21.113671 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:21.113589    2572 generic.go:356] "Generic (PLEG): container finished" podID="b96bdf00-5869-48e5-9a7a-7ef829b51f61" containerID="70bf2aaf827b96659aba3e9a2f207e506969d7e03f9819f5c016d4b639f9ca1a" exitCode=6
Jul 17 18:59:21.113671 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:21.113658    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-ppkc5" event={"ID":"b96bdf00-5869-48e5-9a7a-7ef829b51f61","Type":"ContainerDied","Data":"70bf2aaf827b96659aba3e9a2f207e506969d7e03f9819f5c016d4b639f9ca1a"}
Jul 17 18:59:21.114226 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:21.113719    2572 scope.go:117] "RemoveContainer" containerID="e11d22ba8993e508dc43f131090807acf5ab204aaf95941d05503797d4c4971d"
Jul 17 18:59:21.114226 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:21.114112    2572 scope.go:117] "RemoveContainer" containerID="70bf2aaf827b96659aba3e9a2f207e506969d7e03f9819f5c016d4b639f9ca1a"
Jul 17 18:59:21.114342 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:59:21.114287    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 20s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-df78e9c5-ppkc5_odh-ai-gateway-infra(b96bdf00-5869-48e5-9a7a-7ef829b51f61)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-ppkc5" podUID="b96bdf00-5869-48e5-9a7a-7ef829b51f61"
Jul 17 18:59:21.150547 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:21.150500    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-ppkc5"]
Jul 17 18:59:22.080819 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:22.080771    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78cf4c6f6-4szzt_483a6489-148d-4543-8831-c7be5d84e40b/volume-data-source-validator/0.log"
Jul 17 18:59:22.333017 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:22.332918    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-ppkc5"
Jul 17 18:59:22.423334 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:22.423291    2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b96bdf00-5869-48e5-9a7a-7ef829b51f61-maas-api-service-ca\") pod \"b96bdf00-5869-48e5-9a7a-7ef829b51f61\" (UID: \"b96bdf00-5869-48e5-9a7a-7ef829b51f61\") "
Jul 17 18:59:22.423761 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:22.423726    2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b96bdf00-5869-48e5-9a7a-7ef829b51f61-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b96bdf00-5869-48e5-9a7a-7ef829b51f61" (UID: "b96bdf00-5869-48e5-9a7a-7ef829b51f61"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 17 18:59:22.527143 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:22.527097    2572 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b96bdf00-5869-48e5-9a7a-7ef829b51f61-maas-api-service-ca\") on node \"ip-10-0-132-226.ec2.internal\" DevicePath \"\""
Jul 17 18:59:23.133376 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:23.132285    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-ppkc5" event={"ID":"b96bdf00-5869-48e5-9a7a-7ef829b51f61","Type":"ContainerDied","Data":"069308a5fd9f3d591e0b7940b4a07d10ebc77303aa6144f1eb73bdf33e9bfb3f"}
Jul 17 18:59:23.133376 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:23.132354    2572 scope.go:117] "RemoveContainer" containerID="70bf2aaf827b96659aba3e9a2f207e506969d7e03f9819f5c016d4b639f9ca1a"
Jul 17 18:59:23.133376 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:23.132484    2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-ppkc5"
Jul 17 18:59:23.166614 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:23.166584    2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-ppkc5"]
Jul 17 18:59:23.169350 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:23.169326    2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-df78e9c5-ppkc5"]
Jul 17 18:59:23.474529 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:23.474491    2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b96bdf00-5869-48e5-9a7a-7ef829b51f61" path="/var/lib/kubelet/pods/b96bdf00-5869-48e5-9a7a-7ef829b51f61/volumes"
Jul 17 18:59:23.538483 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:23.538454    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r5w6h_51fe56fe-81e6-4151-99cc-4bc2192ef182/dns/0.log"
Jul 17 18:59:23.564754 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:23.564729    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r5w6h_51fe56fe-81e6-4151-99cc-4bc2192ef182/kube-rbac-proxy/0.log"
Jul 17 18:59:23.621462 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:23.621431    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rnhqt_cd3b555f-c848-4492-a111-1a007f3d469d/dns-node-resolver/0.log"
Jul 17 18:59:24.273290 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:24.273265    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-b4t9q_1e914c47-eaed-4241-b5f8-9c3d2f0a3be8/node-ca/0.log"
Jul 17 18:59:25.116355 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:25.116327    2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lz7w4/perf-node-gather-daemonset-5s8tk"
Jul 17 18:59:25.544406 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:25.544370    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678gcx8b_fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f/istio-proxy/0.log"
Jul 17 18:59:25.786270 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:25.786229    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-782cg_14cc383a-23f0-4842-8d03-2fb3f65d95dc/istio-proxy/0.log"
Jul 17 18:59:25.831475 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:25.830850    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-782cg_14cc383a-23f0-4842-8d03-2fb3f65d95dc/istio-proxy/1.log"
Jul 17 18:59:25.917127 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:25.917094    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-5f4bx_7e0015f8-1c3d-49e1-92f8-647fd7b44ac8/payload-processing/0.log"
Jul 17 18:59:25.950992 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:25.950961    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66554f4bf4-w2s2r_a940a062-485b-4183-91ea-b6c674362b0a/router/0.log"
Jul 17 18:59:26.228826 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:26.228793    2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lpxgk"]
Jul 17 18:59:26.229269 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:26.229249    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b96bdf00-5869-48e5-9a7a-7ef829b51f61" containerName="revoke-keys"
Jul 17 18:59:26.229336 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:26.229274    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b96bdf00-5869-48e5-9a7a-7ef829b51f61" containerName="revoke-keys"
Jul 17 18:59:26.229336 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:26.229292    2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b96bdf00-5869-48e5-9a7a-7ef829b51f61" containerName="revoke-keys"
Jul 17 18:59:26.229336 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:26.229300    2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b96bdf00-5869-48e5-9a7a-7ef829b51f61" containerName="revoke-keys"
Jul 17 18:59:26.229447 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:26.229406    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b96bdf00-5869-48e5-9a7a-7ef829b51f61" containerName="revoke-keys"
Jul 17 18:59:26.229447 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:26.229420    2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b96bdf00-5869-48e5-9a7a-7ef829b51f61" containerName="revoke-keys"
Jul 17 18:59:26.235052 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:26.235028    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lpxgk"
Jul 17 18:59:26.238233 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:26.238210    2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-8m6gj\""
Jul 17 18:59:26.253461 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:26.253402    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lpxgk"]
Jul 17 18:59:26.277091 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:26.277053    2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0df5c0d2-f1b9-4536-acbe-d88986a8f89e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35dc36c4-lpxgk\" (UID: \"0df5c0d2-f1b9-4536-acbe-d88986a8f89e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lpxgk"
Jul 17 18:59:26.378422 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:26.378382    2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0df5c0d2-f1b9-4536-acbe-d88986a8f89e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35dc36c4-lpxgk\" (UID: \"0df5c0d2-f1b9-4536-acbe-d88986a8f89e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lpxgk"
Jul 17 18:59:26.379501 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:26.379473    2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0df5c0d2-f1b9-4536-acbe-d88986a8f89e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-35dc36c4-lpxgk\" (UID: \"0df5c0d2-f1b9-4536-acbe-d88986a8f89e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lpxgk"
Jul 17 18:59:26.547083 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:26.546961    2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lpxgk"
Jul 17 18:59:26.757334 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:26.755838    2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lpxgk"]
Jul 17 18:59:26.762759 ip-10-0-132-226 kubenswrapper[2572]: W0717 18:59:26.762684    2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0df5c0d2_f1b9_4536_acbe_d88986a8f89e.slice/crio-7f539f2b687513a957c204f67a70e805a250d0adb07de25dd0b448aae8729db5 WatchSource:0}: Error finding container 7f539f2b687513a957c204f67a70e805a250d0adb07de25dd0b448aae8729db5: Status 404 returned error can't find the container with id 7f539f2b687513a957c204f67a70e805a250d0adb07de25dd0b448aae8729db5
Jul 17 18:59:27.036780 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:27.036738    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rlgvg_b62cc888-90b6-4004-ac3b-ea40641b8d41/serve-healthcheck-canary/0.log"
Jul 17 18:59:27.162416 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:27.162369    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lpxgk" event={"ID":"0df5c0d2-f1b9-4536-acbe-d88986a8f89e","Type":"ContainerStarted","Data":"05b6fd147d854928fa74e8468cb511631a1cdcad5d7778a0c6c0a18d0597f32a"}
Jul 17 18:59:27.162612 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:27.162449    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lpxgk" event={"ID":"0df5c0d2-f1b9-4536-acbe-d88986a8f89e","Type":"ContainerStarted","Data":"7f539f2b687513a957c204f67a70e805a250d0adb07de25dd0b448aae8729db5"}
Jul 17 18:59:27.185846 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:27.185777    2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lpxgk" podStartSLOduration=1.185753652 podStartE2EDuration="1.185753652s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-17 18:59:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-17 18:59:27.183075268 +0000 UTC m=+3794.408304579" watchObservedRunningTime="2026-07-17 18:59:27.185753652 +0000 UTC m=+3794.410982962"
Jul 17 18:59:27.799207 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:27.799171    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-vdxt4_af512024-2ccd-4dfd-8a9d-c5b12ab13655/insights-operator/0.log"
Jul 17 18:59:27.799882 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:27.799859    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-555d9d7885-vdxt4_af512024-2ccd-4dfd-8a9d-c5b12ab13655/insights-operator/1.log"
Jul 17 18:59:27.927378 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:27.927346    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kkl4n_dcf5ab59-2a15-44b3-84b7-3f6facab15b9/kube-rbac-proxy/0.log"
Jul 17 18:59:27.984518 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:27.984426    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kkl4n_dcf5ab59-2a15-44b3-84b7-3f6facab15b9/exporter/0.log"
Jul 17 18:59:28.024431 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:28.024393    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kkl4n_dcf5ab59-2a15-44b3-84b7-3f6facab15b9/extractor/0.log"
Jul 17 18:59:28.171125 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:28.171069    2572 generic.go:356] "Generic (PLEG): container finished" podID="0df5c0d2-f1b9-4536-acbe-d88986a8f89e" containerID="05b6fd147d854928fa74e8468cb511631a1cdcad5d7778a0c6c0a18d0597f32a" exitCode=6
Jul 17 18:59:28.171388 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:28.171262    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lpxgk" event={"ID":"0df5c0d2-f1b9-4536-acbe-d88986a8f89e","Type":"ContainerDied","Data":"05b6fd147d854928fa74e8468cb511631a1cdcad5d7778a0c6c0a18d0597f32a"}
Jul 17 18:59:28.171388 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:28.171374    2572 scope.go:117] "RemoveContainer" containerID="05b6fd147d854928fa74e8468cb511631a1cdcad5d7778a0c6c0a18d0597f32a"
Jul 17 18:59:28.700139 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:28.700105    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678gcx8b_fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f/istio-proxy/0.log"
Jul 17 18:59:28.873715 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:28.873686    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-782cg_14cc383a-23f0-4842-8d03-2fb3f65d95dc/istio-proxy/0.log"
Jul 17 18:59:28.918014 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:28.917962    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-782cg_14cc383a-23f0-4842-8d03-2fb3f65d95dc/istio-proxy/1.log"
Jul 17 18:59:28.973574 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:28.973529    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-5f4bx_7e0015f8-1c3d-49e1-92f8-647fd7b44ac8/payload-processing/0.log"
Jul 17 18:59:28.994806 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:28.994773    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66554f4bf4-w2s2r_a940a062-485b-4183-91ea-b6c674362b0a/router/0.log"
Jul 17 18:59:29.178969 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:29.178929    2572 generic.go:356] "Generic (PLEG): container finished" podID="0df5c0d2-f1b9-4536-acbe-d88986a8f89e" containerID="fe382ff0a62df83c60a647f86b609c07819dc0d9bd8bc90406c4e034b3cd6f4a" exitCode=6
Jul 17 18:59:29.179166 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:29.179036    2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lpxgk" event={"ID":"0df5c0d2-f1b9-4536-acbe-d88986a8f89e","Type":"ContainerDied","Data":"fe382ff0a62df83c60a647f86b609c07819dc0d9bd8bc90406c4e034b3cd6f4a"}
Jul 17 18:59:29.179263 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:29.179143    2572 scope.go:117] "RemoveContainer" containerID="05b6fd147d854928fa74e8468cb511631a1cdcad5d7778a0c6c0a18d0597f32a"
Jul 17 18:59:29.179449 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:29.179424    2572 scope.go:117] "RemoveContainer" containerID="fe382ff0a62df83c60a647f86b609c07819dc0d9bd8bc90406c4e034b3cd6f4a"
Jul 17 18:59:29.179729 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:59:29.179696    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-35dc36c4-lpxgk_odh-ai-gateway-infra(0df5c0d2-f1b9-4536-acbe-d88986a8f89e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lpxgk" podUID="0df5c0d2-f1b9-4536-acbe-d88986a8f89e"
Jul 17 18:59:30.184357 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:30.184274    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678gcx8b_fdb91a0f-bb1f-44e9-9f02-87f8d60ccd8f/istio-proxy/0.log"
Jul 17 18:59:30.190702 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:30.187973    2572 scope.go:117] "RemoveContainer" containerID="fe382ff0a62df83c60a647f86b609c07819dc0d9bd8bc90406c4e034b3cd6f4a"
Jul 17 18:59:30.190702 ip-10-0-132-226 kubenswrapper[2572]: E0717 18:59:30.188321    2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-35dc36c4-lpxgk_odh-ai-gateway-infra(0df5c0d2-f1b9-4536-acbe-d88986a8f89e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-35dc36c4-lpxgk" podUID="0df5c0d2-f1b9-4536-acbe-d88986a8f89e"
Jul 17 18:59:30.362667 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:30.362625    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-782cg_14cc383a-23f0-4842-8d03-2fb3f65d95dc/istio-proxy/0.log"
Jul 17 18:59:30.402772 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:30.402725    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-782cg_14cc383a-23f0-4842-8d03-2fb3f65d95dc/istio-proxy/1.log"
Jul 17 18:59:30.492908 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:30.492881    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-5f4bx_7e0015f8-1c3d-49e1-92f8-647fd7b44ac8/payload-processing/0.log"
Jul 17 18:59:30.513080 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:30.513051    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-66554f4bf4-w2s2r_a940a062-485b-4183-91ea-b6c674362b0a/router/0.log"
Jul 17 18:59:30.947150 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:30.947100    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7bd9bf478b-lr6df_538faa02-ec5b-40f6-b1b7-d0f347c3fde6/manager/0.log"
Jul 17 18:59:31.232540 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:31.232454    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d8bdcf84-2h9jr_9c4f73f4-d262-4108-8364-8ef043ef62b2/manager/0.log"
Jul 17 18:59:31.273844 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:31.273816    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d8bdcf84-2h9jr_9c4f73f4-d262-4108-8364-8ef043ef62b2/copy-manifests/0.log"
Jul 17 18:59:32.569815 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:32.569773    2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-f76c48b9d-mdnxp_bbaccd60-ce7a-43a9-8a8d-f41b85544908/manager/0.log"
Jul 17 18:59:32.895650 ip-10-0-132-226 kubenswrapper[2572]: I0717 18:59:32.895548    2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h9rs6_6bb964cd-6c2c-4997-b5c5-558b890f6277/konnectivity-agent/0.log" limit=1024