Sep 07 12:59:31.638141 ip-10-0-142-74 systemd[1]: Starting Kubernetes Kubelet...
Sep 07 12:59:31.993779 ip-10-0-142-74 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 12:59:31.993779 ip-10-0-142-74 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 07 12:59:31.993779 ip-10-0-142-74 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 12:59:31.993779 ip-10-0-142-74 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 07 12:59:31.993779 ip-10-0-142-74 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 07 12:59:31.994692 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:31.994610    2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 07 12:59:31.999226 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999210    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 12:59:31.999226 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999227    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 12:59:31.999290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999231    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 12:59:31.999290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999233    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 12:59:31.999290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999236    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 12:59:31.999290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999240    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 12:59:31.999290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999244    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 12:59:31.999290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999247    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 12:59:31.999290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999250    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 12:59:31.999290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999252    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 12:59:31.999290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999255    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 12:59:31.999290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999258    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 12:59:31.999290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999260    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 12:59:31.999290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999263    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 12:59:31.999290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999265    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 12:59:31.999290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999268    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 12:59:31.999290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999271    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 12:59:31.999290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999274    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 12:59:31.999290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999276    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 12:59:31.999290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999279    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 12:59:31.999290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999281    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 12:59:31.999290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999284    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 12:59:31.999762 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999292    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 12:59:31.999762 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999295    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 12:59:31.999762 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999298    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 12:59:31.999762 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999301    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 12:59:31.999762 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999304    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 12:59:31.999762 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999309    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 12:59:31.999762 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999312    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 12:59:31.999762 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999316    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 12:59:31.999762 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999320    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 12:59:31.999762 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999323    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 12:59:31.999762 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999326    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 12:59:31.999762 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999329    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 12:59:31.999762 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999332    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 12:59:31.999762 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999335    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 12:59:31.999762 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999337    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 12:59:31.999762 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999340    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 12:59:31.999762 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999343    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 12:59:31.999762 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999345    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 12:59:31.999762 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999348    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 12:59:32.000257 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999350    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 12:59:32.000257 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999352    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 12:59:32.000257 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999355    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 12:59:32.000257 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999357    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 12:59:32.000257 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999360    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 12:59:32.000257 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999363    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 12:59:32.000257 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999365    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 12:59:32.000257 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999368    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 12:59:32.000257 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999371    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 12:59:32.000257 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999375    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 12:59:32.000257 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999377    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 12:59:32.000257 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999380    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 12:59:32.000257 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999382    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 12:59:32.000257 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999385    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 12:59:32.000257 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999388    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 12:59:32.000257 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999390    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 12:59:32.000257 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999394    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 12:59:32.000257 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999398    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 12:59:32.000257 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999400    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 12:59:32.000754 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999404    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 12:59:32.000754 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999406    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 12:59:32.000754 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999409    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 12:59:32.000754 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999412    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 12:59:32.000754 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999415    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 12:59:32.000754 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999417    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 12:59:32.000754 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999420    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 12:59:32.000754 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999423    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 12:59:32.000754 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999425    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 12:59:32.000754 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999428    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 12:59:32.000754 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999430    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 12:59:32.000754 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999433    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 12:59:32.000754 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999435    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 12:59:32.000754 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999438    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 12:59:32.000754 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999441    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 12:59:32.000754 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999443    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 12:59:32.000754 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999445    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 12:59:32.000754 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999448    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 12:59:32.000754 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999451    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 12:59:32.000754 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999454    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 12:59:32.001282 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999457    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 12:59:32.001282 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999459    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 12:59:32.001282 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999462    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 12:59:32.001282 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999464    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 12:59:32.001282 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999467    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 12:59:32.001282 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999469    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 12:59:32.001282 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999472    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 12:59:32.001282 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999474    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 12:59:32.001282 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999477    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 12:59:32.001282 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999479    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 12:59:32.001282 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999482    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 12:59:32.001282 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999484    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 12:59:32.001282 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999486    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 12:59:32.001282 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999489    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 12:59:32.001282 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999491    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 12:59:32.001282 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999494    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 12:59:32.001282 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999496    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 12:59:32.001282 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999498    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 12:59:32.001282 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:31.999501    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 12:59:32.001282 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001151    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 12:59:32.001781 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001159    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 12:59:32.001781 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001162    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 12:59:32.001781 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001165    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 12:59:32.001781 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001168    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 12:59:32.001781 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001171    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 12:59:32.001781 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001174    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 12:59:32.001781 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001177    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 12:59:32.001781 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001180    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 12:59:32.001781 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001183    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 12:59:32.001781 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001185    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 12:59:32.001781 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001188    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 12:59:32.001781 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001190    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 12:59:32.001781 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001198    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 12:59:32.001781 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001201    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 12:59:32.001781 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001204    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 12:59:32.001781 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001206    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 12:59:32.001781 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001209    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 12:59:32.001781 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001211    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 12:59:32.001781 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001214    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 12:59:32.001781 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001217    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 12:59:32.002308 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001219    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 12:59:32.002308 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001222    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 12:59:32.002308 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001224    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 12:59:32.002308 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001227    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 12:59:32.002308 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001230    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 12:59:32.002308 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001234    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 12:59:32.002308 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001238    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 12:59:32.002308 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001240    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 12:59:32.002308 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001242    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 12:59:32.002308 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001245    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 12:59:32.002308 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001248    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 12:59:32.002308 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001250    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 12:59:32.002308 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001252    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 12:59:32.002308 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001255    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 12:59:32.002308 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001257    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 12:59:32.002308 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001260    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 12:59:32.002308 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001262    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 12:59:32.002308 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001264    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 12:59:32.002308 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001266    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 12:59:32.002767 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001269    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 12:59:32.002767 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001271    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 12:59:32.002767 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001274    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 12:59:32.002767 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001277    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 12:59:32.002767 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001279    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 12:59:32.002767 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001282    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 12:59:32.002767 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001290    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 12:59:32.002767 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001293    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 12:59:32.002767 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001296    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 12:59:32.002767 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001298    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 12:59:32.002767 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001301    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 12:59:32.002767 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001303    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 12:59:32.002767 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001306    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 12:59:32.002767 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001309    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 12:59:32.002767 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001312    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 12:59:32.002767 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001314    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 12:59:32.002767 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001317    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 12:59:32.002767 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001319    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 12:59:32.002767 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001322    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 12:59:32.002767 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001324    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 12:59:32.003290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001327    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 12:59:32.003290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001329    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 12:59:32.003290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001332    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 12:59:32.003290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001334    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 12:59:32.003290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001336    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 12:59:32.003290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001339    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 12:59:32.003290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001341    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 12:59:32.003290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001344    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 12:59:32.003290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001346    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 12:59:32.003290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001350    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 12:59:32.003290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001353    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 12:59:32.003290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001356    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 12:59:32.003290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001359    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 12:59:32.003290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001362    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 12:59:32.003290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001365    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 12:59:32.003290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001368    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 12:59:32.003290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001371    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 12:59:32.003290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001374    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 12:59:32.003290 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001377    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 12:59:32.003753 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001380    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 12:59:32.003753 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001382    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 12:59:32.003753 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001386    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 12:59:32.003753 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001389    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 12:59:32.003753 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001392    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 12:59:32.003753 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001395    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 12:59:32.003753 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001399    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 12:59:32.003753 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001402    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 12:59:32.003753 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001405    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 12:59:32.003753 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001408    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 12:59:32.003753 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001411    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 12:59:32.003753 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001413    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 12:59:32.003753 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001416    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 12:59:32.003753 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001418    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 12:59:32.003753 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001421    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 12:59:32.003753 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001424    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 12:59:32.003753 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001426    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 12:59:32.003753 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001429    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 12:59:32.003753 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001431    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 12:59:32.004232 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001433    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 12:59:32.004232 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001799    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 12:59:32.004232 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001804    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 12:59:32.004232 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001807    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 12:59:32.004232 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001810    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 12:59:32.004232 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001812    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 12:59:32.004232 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001815    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 12:59:32.004232 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001817    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 12:59:32.004232 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001820    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 12:59:32.004232 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001822    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 12:59:32.004232 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001837    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 12:59:32.004232 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001840    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 12:59:32.004232 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001843    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 12:59:32.004232 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001846    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 12:59:32.004232 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001849    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 12:59:32.004232 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001852    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 12:59:32.004232 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001854    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 12:59:32.004232 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001857    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 12:59:32.004232 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001860    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 12:59:32.004232 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001864    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 12:59:32.004720 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001882    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 12:59:32.004720 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001885    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 12:59:32.004720 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001888    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 12:59:32.004720 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001891    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 12:59:32.004720 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001894    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 12:59:32.004720 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001897    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 12:59:32.004720 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001900    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 12:59:32.004720 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001903    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 12:59:32.004720 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001906    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 12:59:32.004720 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001908    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 12:59:32.004720 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001911    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 12:59:32.004720 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001914    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 12:59:32.004720 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001917    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 12:59:32.004720 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001919    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 12:59:32.004720 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001922    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 12:59:32.004720 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001924    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 12:59:32.004720 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001927    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 12:59:32.004720 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001931    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 12:59:32.004720 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001934    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 12:59:32.004720 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001937    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 12:59:32.005221 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001940    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 12:59:32.005221 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001943    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 12:59:32.005221 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001945    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 12:59:32.005221 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001948    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 12:59:32.005221 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001950    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 12:59:32.005221 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001953    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 12:59:32.005221 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001956    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 12:59:32.005221 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001959    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 12:59:32.005221 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001961    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 12:59:32.005221 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001964    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 12:59:32.005221 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001966    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 12:59:32.005221 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001969    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 12:59:32.005221 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001972    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 12:59:32.005221 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001974    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 12:59:32.005221 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001976    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 12:59:32.005221 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001979    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 12:59:32.005221 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001981    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 12:59:32.005221 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001983    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 12:59:32.005221 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001986    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 12:59:32.005673 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001988    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 12:59:32.005673 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001990    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 12:59:32.005673 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001993    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 12:59:32.005673 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001995    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 12:59:32.005673 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.001998    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 12:59:32.005673 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002000    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 12:59:32.005673 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002003    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 12:59:32.005673 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002005    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 12:59:32.005673 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002007    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 12:59:32.005673 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002010    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 12:59:32.005673 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002012    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 12:59:32.005673 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002015    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 12:59:32.005673 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002017    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 12:59:32.005673 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002020    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 12:59:32.005673 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002022    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 12:59:32.005673 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002025    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 12:59:32.005673 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002027    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 12:59:32.005673 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002030    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 12:59:32.005673 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002033    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 12:59:32.005673 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002035    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 12:59:32.006184 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002039    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 12:59:32.006184 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002042    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 12:59:32.006184 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002045    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 12:59:32.006184 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002047    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 12:59:32.006184 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002050    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 12:59:32.006184 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002053    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 12:59:32.006184 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002056    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 12:59:32.006184 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002058    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 12:59:32.006184 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002061    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 12:59:32.006184 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002064    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 12:59:32.006184 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002066    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 12:59:32.006184 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002068    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 12:59:32.006184 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002071    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 12:59:32.006184 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002073    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 12:59:32.006184 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002076    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 12:59:32.006184 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002078    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 12:59:32.006184 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002081    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 12:59:32.006184 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002083    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 12:59:32.006184 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002086    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 12:59:32.006184 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002088    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 12:59:32.006665 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002090    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 12:59:32.006665 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002164    2576 flags.go:64] FLAG: --address="0.0.0.0"
Sep 07 12:59:32.006665 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002197    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 07 12:59:32.006665 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002207    2576 flags.go:64] FLAG: --anonymous-auth="true"
Sep 07 12:59:32.006665 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002211    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 07 12:59:32.006665 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002215    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 07 12:59:32.006665 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002218    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 07 12:59:32.006665 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002223    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 07 12:59:32.006665 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002227    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 07 12:59:32.006665 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002230    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 07 12:59:32.006665 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002233    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 07 12:59:32.006665 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002236    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 07 12:59:32.006665 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002240    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 07 12:59:32.006665 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002250    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 07 12:59:32.006665 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002253    2576 flags.go:64] FLAG: --cgroup-root=""
Sep 07 12:59:32.006665 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002256    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 07 12:59:32.006665 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002258    2576 flags.go:64] FLAG: --client-ca-file=""
Sep 07 12:59:32.006665 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002261    2576 flags.go:64] FLAG: --cloud-provider="external"
Sep 07 12:59:32.006665 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002264    2576 flags.go:64] FLAG: --cluster-dns="[]"
Sep 07 12:59:32.006665 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002271    2576 flags.go:64] FLAG: --cluster-domain=""
Sep 07 12:59:32.006665 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002274    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 07 12:59:32.006665 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002277    2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 07 12:59:32.006665 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002280    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 07 12:59:32.006665 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002283    2576 flags.go:64] FLAG: --container-log-max-files="5"
Sep 07 12:59:32.007265 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002286    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 07 12:59:32.007265 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002289    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 07 12:59:32.007265 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002292    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 07 12:59:32.007265 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002295    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 07 12:59:32.007265 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002298    2576 flags.go:64] FLAG: --contention-profiling="false"
Sep 07 12:59:32.007265 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002301    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 07 12:59:32.007265 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002304    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 07 12:59:32.007265 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002307    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 07 12:59:32.007265 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002310    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 07 12:59:32.007265 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002314    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 07 12:59:32.007265 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002317    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 07 12:59:32.007265 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002320    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 07 12:59:32.007265 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002323    2576 flags.go:64] FLAG: --enable-load-reader="false"
Sep 07 12:59:32.007265 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002325    2576 flags.go:64] FLAG: --enable-server="true"
Sep 07 12:59:32.007265 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002328    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 07 12:59:32.007265 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002334    2576 flags.go:64] FLAG: --event-burst="100"
Sep 07 12:59:32.007265 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002337    2576 flags.go:64] FLAG: --event-qps="50"
Sep 07 12:59:32.007265 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002339    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 07 12:59:32.007265 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002342    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 07 12:59:32.007265 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002345    2576 flags.go:64] FLAG: --eviction-hard=""
Sep 07 12:59:32.007265 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002352    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 07 12:59:32.007265 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002355    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 07 12:59:32.007265 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002363    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 07 12:59:32.007265 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002366    2576 flags.go:64] FLAG: --eviction-soft=""
Sep 07 12:59:32.007265 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002369    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 07 12:59:32.007856 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002372    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 07 12:59:32.007856 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002374    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 07 12:59:32.007856 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002377    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 07 12:59:32.007856 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002380    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 07 12:59:32.007856 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002382    2576 flags.go:64] FLAG: --fail-swap-on="true"
Sep 07 12:59:32.007856 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002385    2576 flags.go:64] FLAG: --feature-gates=""
Sep 07 12:59:32.007856 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002388    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 07 12:59:32.007856 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002391    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 07 12:59:32.007856 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002397    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 07 12:59:32.007856 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002400    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 07 12:59:32.007856 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002403    2576 flags.go:64] FLAG: --healthz-port="10248"
Sep 07 12:59:32.007856 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002406    2576 flags.go:64] FLAG: --help="false"
Sep 07 12:59:32.007856 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002409    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-142-74.ec2.internal"
Sep 07 12:59:32.007856 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002412    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 07 12:59:32.007856 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002414    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 07 12:59:32.007856 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002417    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 07 12:59:32.007856 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002420    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 07 12:59:32.007856 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002423    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 07 12:59:32.007856 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002426    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 07 12:59:32.007856 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002429    2576 flags.go:64] FLAG: --image-service-endpoint=""
Sep 07 12:59:32.007856 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002431    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 07 12:59:32.007856 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002434    2576 flags.go:64] FLAG: --kube-api-burst="100"
Sep 07 12:59:32.007856 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002437    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 07 12:59:32.008443 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002440    2576 flags.go:64] FLAG: --kube-api-qps="50"
Sep 07 12:59:32.008443 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002443    2576 flags.go:64] FLAG: --kube-reserved=""
Sep 07 12:59:32.008443 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002446    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 07 12:59:32.008443 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002449    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 07 12:59:32.008443 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002453    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 07 12:59:32.008443 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002455    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 07 12:59:32.008443 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002458    2576 flags.go:64] FLAG: --lock-file=""
Sep 07 12:59:32.008443 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002461    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 07 12:59:32.008443 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002464    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 07 12:59:32.008443 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002467    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 07 12:59:32.008443 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002472    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 07 12:59:32.008443 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002474    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 07 12:59:32.008443 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002477    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 07 12:59:32.008443 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002480    2576 flags.go:64] FLAG: --logging-format="text"
Sep 07 12:59:32.008443 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002482    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 07 12:59:32.008443 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002485    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 07 12:59:32.008443 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002488    2576 flags.go:64] FLAG: --manifest-url=""
Sep 07 12:59:32.008443 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002491    2576 flags.go:64] FLAG: --manifest-url-header=""
Sep 07 12:59:32.008443 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002495    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 07 12:59:32.008443 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002498    2576 flags.go:64] FLAG: --max-open-files="1000000"
Sep 07 12:59:32.008443 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002502    2576 flags.go:64] FLAG: --max-pods="110"
Sep 07 12:59:32.008443 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002505    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 07 12:59:32.008443 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002507    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 07 12:59:32.008443 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002510    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 07 12:59:32.008443 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002513    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 07 12:59:32.009055 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002516    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 07 12:59:32.009055 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002518    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 07 12:59:32.009055 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002521    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 07 12:59:32.009055 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002528    2576 flags.go:64] FLAG: --node-status-max-images="50"
Sep 07 12:59:32.009055 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002531    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 07 12:59:32.009055 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002534    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 07 12:59:32.009055 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002537    2576 flags.go:64] FLAG: --pod-cidr=""
Sep 07 12:59:32.009055 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002539    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 07 12:59:32.009055 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002545    2576 flags.go:64] FLAG: --pod-manifest-path=""
Sep 07 12:59:32.009055 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002548    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 07 12:59:32.009055 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002551    2576 flags.go:64] FLAG: --pods-per-core="0"
Sep 07 12:59:32.009055 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002555    2576 flags.go:64] FLAG: --port="10250"
Sep 07 12:59:32.009055 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002558    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 07 12:59:32.009055 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002561    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01bf8188755a20352"
Sep 07 12:59:32.009055 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002564    2576 flags.go:64] FLAG: --qos-reserved=""
Sep 07 12:59:32.009055 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002573    2576 flags.go:64] FLAG: --read-only-port="10255"
Sep 07 12:59:32.009055 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002576    2576 flags.go:64] FLAG: --register-node="true"
Sep 07 12:59:32.009055 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002579    2576 flags.go:64] FLAG: --register-with-taints=""
Sep 07 12:59:32.009055 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002586    2576 flags.go:64] FLAG: --registry-burst="10"
Sep 07 12:59:32.009055 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002589    2576 flags.go:64] FLAG: --registry-qps="5"
Sep 07 12:59:32.009055 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002592    2576 flags.go:64] FLAG: --reserved-cpus=""
Sep 07 12:59:32.009055 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002594    2576 flags.go:64] FLAG: --reserved-memory=""
Sep 07 12:59:32.009055 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002598    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 07 12:59:32.009055 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002601    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 07 12:59:32.009055 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002607    2576 flags.go:64] FLAG: --rotate-certificates="false"
Sep 07 12:59:32.009979 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002609    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 07 12:59:32.009979 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002612    2576 flags.go:64] FLAG: --runonce="false"
Sep 07 12:59:32.009979 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002614    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 07 12:59:32.009979 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002617    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 07 12:59:32.009979 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002620    2576 flags.go:64] FLAG: --seccomp-default="false"
Sep 07 12:59:32.009979 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002623    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 07 12:59:32.009979 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002625    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 07 12:59:32.009979 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002628    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 07 12:59:32.009979 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002631    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 07 12:59:32.009979 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002634    2576 flags.go:64] FLAG: --storage-driver-password="root"
Sep 07 12:59:32.009979 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002637    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 07 12:59:32.009979 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002639    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 07 12:59:32.009979 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002642    2576 flags.go:64] FLAG: --storage-driver-user="root"
Sep 07 12:59:32.009979 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002645    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 07 12:59:32.009979 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002647    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 07 12:59:32.009979 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002650    2576 flags.go:64] FLAG: --system-cgroups=""
Sep 07 12:59:32.009979 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002653    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 07 12:59:32.009979 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002658    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 07 12:59:32.009979 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002662    2576 flags.go:64] FLAG: --tls-cert-file=""
Sep 07 12:59:32.009979 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002665    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 07 12:59:32.009979 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002668    2576 flags.go:64] FLAG: --tls-min-version=""
Sep 07 12:59:32.009979 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002671    2576 flags.go:64] FLAG: --tls-private-key-file=""
Sep 07 12:59:32.009979 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002674    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 07 12:59:32.009979 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002677    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 07 12:59:32.009979 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002680    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 07 12:59:32.011075 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002682    2576 flags.go:64] FLAG: --v="2"
Sep 07 12:59:32.011075 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002686    2576 flags.go:64] FLAG: --version="false"
Sep 07 12:59:32.011075 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002690    2576 flags.go:64] FLAG: --vmodule=""
Sep 07 12:59:32.011075 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002693    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 07 12:59:32.011075 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.002696    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 07 12:59:32.011075 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002806    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 12:59:32.011075 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002811    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 12:59:32.011075 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002814    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 12:59:32.011075 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002817    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 12:59:32.011075 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002820    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 12:59:32.011075 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002823    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 12:59:32.011075 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002826    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 12:59:32.011075 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002829    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 12:59:32.011075 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002831    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 12:59:32.011075 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002834    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 12:59:32.011075 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002837    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 12:59:32.011075 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002839    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 12:59:32.011075 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002842    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 12:59:32.011075 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002844    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 12:59:32.011075 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002846    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 12:59:32.011075 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002849    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 12:59:32.012033 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002852    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 12:59:32.012033 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002854    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 12:59:32.012033 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002857    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 12:59:32.012033 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002859    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 12:59:32.012033 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002862    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 12:59:32.012033 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002881    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 12:59:32.012033 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002884    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 12:59:32.012033 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002886    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 12:59:32.012033 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002889    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 12:59:32.012033 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002891    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 12:59:32.012033 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002895    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 12:59:32.012033 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002897    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 12:59:32.012033 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002900    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 12:59:32.012033 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002902    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 12:59:32.012033 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002905    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 12:59:32.012033 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002907    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 12:59:32.012033 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002910    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 12:59:32.012033 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002913    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 12:59:32.012033 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002916    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 12:59:32.012033 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002919    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 12:59:32.012910 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002921    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 12:59:32.012910 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002924    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 12:59:32.012910 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002926    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 12:59:32.012910 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002929    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 12:59:32.012910 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002932    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 12:59:32.012910 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002934    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 12:59:32.012910 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002937    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 12:59:32.012910 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002939    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 12:59:32.012910 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002942    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 12:59:32.012910 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002944    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 12:59:32.012910 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002947    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 12:59:32.012910 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002950    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 12:59:32.012910 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002952    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 12:59:32.012910 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002955    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 12:59:32.012910 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002957    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 12:59:32.012910 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002960    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 12:59:32.012910 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002963    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 12:59:32.012910 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002967    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 12:59:32.012910 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002970    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 12:59:32.012910 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002973    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 12:59:32.013766 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002976    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 12:59:32.013766 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002978    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 12:59:32.013766 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002981    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 12:59:32.013766 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002984    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 12:59:32.013766 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002987    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 12:59:32.013766 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002990    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 12:59:32.013766 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002992    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 12:59:32.013766 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002995    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 12:59:32.013766 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.002998    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 12:59:32.013766 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.003002    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 12:59:32.013766 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.003005    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 12:59:32.013766 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.003007    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 12:59:32.013766 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.003010    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 12:59:32.013766 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.003013    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 12:59:32.013766 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.003017    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 12:59:32.013766 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.003020    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 12:59:32.013766 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.003022    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 12:59:32.013766 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.003025    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 12:59:32.013766 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.003027    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 12:59:32.014327 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.003030    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 12:59:32.014327 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.003032    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 12:59:32.014327 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.003035    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 12:59:32.014327 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.003037    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 12:59:32.014327 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.003040    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 12:59:32.014327 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.003043    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 12:59:32.014327 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.003045    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 12:59:32.014327 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.003048    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 12:59:32.014327 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.003050    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 12:59:32.014327 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.003053    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 12:59:32.014327 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.003055    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 12:59:32.014327 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.003058    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 12:59:32.014327 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.003060    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 12:59:32.014327 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.003064    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 12:59:32.014327 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.003067    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 12:59:32.014327 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.003070    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 12:59:32.014327 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.003073    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 12:59:32.014327 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.003076    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 12:59:32.014327 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.003079    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 12:59:32.015107 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.003082    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 12:59:32.015107 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.003085    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 12:59:32.015107 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.003087    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 12:59:32.015107 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.003091    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 12:59:32.015107 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.003094    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 12:59:32.015107 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.003100    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 12:59:32.015107 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.012029    2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 07 12:59:32.015107 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.012211    2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 07 12:59:32.015107 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.012237    2576 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 07 12:59:32.015107 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.012250    2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 07 12:59:32.015107 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012342    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 12:59:32.015107 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012349    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 12:59:32.015107 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012355    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 12:59:32.015107 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012359    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 12:59:32.015107 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012364    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 12:59:32.015755 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012368    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 12:59:32.015755 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012372    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 12:59:32.015755 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012376    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 12:59:32.015755 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012381    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 12:59:32.015755 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012385    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 12:59:32.015755 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012389    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 12:59:32.015755 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012393    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 12:59:32.015755 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012397    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 12:59:32.015755 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012402    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 12:59:32.015755 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012406    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 12:59:32.015755 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012410    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 12:59:32.015755 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012414    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 12:59:32.015755 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012418    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 12:59:32.015755 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012422    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 12:59:32.015755 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012426    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 12:59:32.015755 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012432    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 12:59:32.015755 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012438    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 12:59:32.015755 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012442    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 12:59:32.015755 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012446    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 12:59:32.015755 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012450    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 12:59:32.016409 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012454    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 12:59:32.016409 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012460    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 12:59:32.016409 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012465    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 12:59:32.016409 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012470    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 12:59:32.016409 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012486    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 12:59:32.016409 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012494    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 12:59:32.016409 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012500    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 12:59:32.016409 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012504    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 12:59:32.016409 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012509    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 12:59:32.016409 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012513    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 12:59:32.016409 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012518    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 12:59:32.016409 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012523    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 12:59:32.016409 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012527    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 12:59:32.016409 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012532    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 12:59:32.016409 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012537    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 12:59:32.016409 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012541    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 12:59:32.016409 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012545    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 12:59:32.016409 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012550    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 12:59:32.016409 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012554    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 12:59:32.017066 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012559    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 12:59:32.017066 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012563    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 12:59:32.017066 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012568    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 12:59:32.017066 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012572    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 12:59:32.017066 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012576    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 12:59:32.017066 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012580    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 12:59:32.017066 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012584    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 12:59:32.017066 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012588    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 12:59:32.017066 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012592    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 12:59:32.017066 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012596    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 12:59:32.017066 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012600    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 12:59:32.017066 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012604    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 12:59:32.017066 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012608    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 12:59:32.017066 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012612    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 12:59:32.017066 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012616    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 12:59:32.017066 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012621    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 12:59:32.017066 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012626    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 12:59:32.017066 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012630    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 12:59:32.017066 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012642    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 12:59:32.017066 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012646    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 12:59:32.017541 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012650    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 12:59:32.017541 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012655    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 12:59:32.017541 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012659    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 12:59:32.017541 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012663    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 12:59:32.017541 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012667    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 12:59:32.017541 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012671    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 12:59:32.017541 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012675    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 12:59:32.017541 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012680    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 12:59:32.017541 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012683    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 12:59:32.017541 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012687    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 12:59:32.017541 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012691    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 12:59:32.017541 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012696    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 12:59:32.017541 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012700    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 12:59:32.017541 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012703    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 12:59:32.017541 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012708    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 12:59:32.017541 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012712    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 12:59:32.017541 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012717    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 12:59:32.017541 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012721    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 12:59:32.017541 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012724    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 12:59:32.017541 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012728    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 12:59:32.018142 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012733    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 12:59:32.018142 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012736    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 12:59:32.018142 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012741    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 12:59:32.018142 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012744    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 12:59:32.018142 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012749    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 12:59:32.018142 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012752    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 12:59:32.018142 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012756    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 12:59:32.018142 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012761    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 12:59:32.018142 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012765    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 12:59:32.018142 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012770    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 12:59:32.018142 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012775    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 12:59:32.018142 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012786    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 12:59:32.018142 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012791    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 12:59:32.018142 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012795    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 12:59:32.018142 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.012799    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 12:59:32.018503 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.012807    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 12:59:32.018503 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013052    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 07 12:59:32.018503 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013062    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 07 12:59:32.018503 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013067    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 07 12:59:32.018503 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013071    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 07 12:59:32.018503 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013075    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 07 12:59:32.018503 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013080    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 07 12:59:32.018503 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013085    2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 07 12:59:32.018503 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013089    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 07 12:59:32.018503 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013094    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 07 12:59:32.018503 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013100    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 07 12:59:32.018503 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013104    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 07 12:59:32.018503 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013108    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 07 12:59:32.018503 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013113    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 07 12:59:32.018937 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013117    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 07 12:59:32.018937 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013121    2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 07 12:59:32.018937 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013125    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 07 12:59:32.018937 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013129    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 07 12:59:32.018937 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013134    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 07 12:59:32.018937 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013138    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 07 12:59:32.018937 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013142    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 07 12:59:32.018937 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013147    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 07 12:59:32.018937 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013151    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 07 12:59:32.018937 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013155    2576 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 07 12:59:32.018937 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013159    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 07 12:59:32.018937 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013164    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 07 12:59:32.018937 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013168    2576 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 07 12:59:32.018937 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013172    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 07 12:59:32.018937 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013176    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 07 12:59:32.018937 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013187    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 07 12:59:32.018937 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013192    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 07 12:59:32.018937 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013196    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 07 12:59:32.018937 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013200    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 07 12:59:32.018937 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013204    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 07 12:59:32.019446 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013208    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 07 12:59:32.019446 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013212    2576 feature_gate.go:328] unrecognized feature gate: Example2
Sep 07 12:59:32.019446 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013216    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 07 12:59:32.019446 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013220    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 07 12:59:32.019446 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013224    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 07 12:59:32.019446 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013228    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 07 12:59:32.019446 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013232    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 07 12:59:32.019446 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013236    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 07 12:59:32.019446 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013240    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 07 12:59:32.019446 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013244    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 07 12:59:32.019446 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013248    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 07 12:59:32.019446 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013252    2576 feature_gate.go:328] unrecognized feature gate: Example
Sep 07 12:59:32.019446 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013257    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 07 12:59:32.019446 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013260    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 07 12:59:32.019446 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013264    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 07 12:59:32.019446 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013268    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 07 12:59:32.019446 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013272    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 07 12:59:32.019446 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013276    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 07 12:59:32.019446 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013280    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 07 12:59:32.019446 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013285    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 07 12:59:32.019971 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013289    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 07 12:59:32.019971 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013294    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 07 12:59:32.019971 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013298    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 07 12:59:32.019971 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013302    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 07 12:59:32.019971 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013306    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 07 12:59:32.019971 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013310    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 07 12:59:32.019971 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013314    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 07 12:59:32.019971 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013318    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 07 12:59:32.019971 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013329    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 07 12:59:32.019971 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013334    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 07 12:59:32.019971 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013338    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 07 12:59:32.019971 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013342    2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 07 12:59:32.019971 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013348    2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 07 12:59:32.019971 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013353    2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 07 12:59:32.019971 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013358    2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 07 12:59:32.019971 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013363    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 07 12:59:32.019971 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013367    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 07 12:59:32.019971 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013371    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 07 12:59:32.019971 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013375    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 07 12:59:32.019971 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013380    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 07 12:59:32.020447 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013384    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 07 12:59:32.020447 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013388    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 07 12:59:32.020447 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013392    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 07 12:59:32.020447 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013396    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 07 12:59:32.020447 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013400    2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 07 12:59:32.020447 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013406    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 07 12:59:32.020447 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013411    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 07 12:59:32.020447 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013416    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 07 12:59:32.020447 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013421    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 07 12:59:32.020447 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013426    2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 07 12:59:32.020447 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013430    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 07 12:59:32.020447 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013434    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 07 12:59:32.020447 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013438    2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 07 12:59:32.020447 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013443    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 07 12:59:32.020447 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013447    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 07 12:59:32.020447 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013451    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 07 12:59:32.020447 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013454    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 07 12:59:32.020447 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013458    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 07 12:59:32.020447 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013462    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 07 12:59:32.021335 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013466    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 07 12:59:32.021335 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013470    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 07 12:59:32.021335 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013486    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 07 12:59:32.021335 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013491    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 07 12:59:32.021335 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013495    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 07 12:59:32.021335 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013498    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 07 12:59:32.021335 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:32.013502    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 07 12:59:32.021335 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.013511    2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 07 12:59:32.021335 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.013693    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 07 12:59:32.021335 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.016727    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 07 12:59:32.021335 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.017922    2576 server.go:1019] "Starting client certificate rotation"
Sep 07 12:59:32.021335 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.018020    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 07 12:59:32.021335 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.018051    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 07 12:59:32.021746 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.021232    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 07 12:59:32.026252 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.026229    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 07 12:59:32.036604 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.036585    2576 log.go:25] "Validated CRI v1 runtime API"
Sep 07 12:59:32.039830 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.039818    2576 log.go:25] "Validated CRI v1 image API"
Sep 07 12:59:32.040658 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.040641    2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 07 12:59:32.046180 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.046163    2576 fs.go:135] Filesystem UUIDs: map[02171879-c157-4ca5-9d12-813d8a1e5847:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b03708df-f253-4297-875f-0228cc3e5d96:/dev/nvme0n1p4]
Sep 07 12:59:32.046228 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.046181    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 07 12:59:32.051308 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.051208    2576 manager.go:216] Machine: {Timestamp:2026-09-07 12:59:32.04993146 +0000 UTC m=+0.306710820 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100077 MemoryCapacity:32812163072 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec278fe2a08e680423ef109be4ac9a21 SystemUUID:ec278fe2-a08e-6804-23ef-109be4ac9a21 BootID:d5112d81-d2e2-40bf-944b-640f3594e79a Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:50:31:3d:53:3d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:50:31:3d:53:3d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:82:db:7c:cd:43:2b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812163072 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 07 12:59:32.051308 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.051308    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 07 12:59:32.051415 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.051403    2576 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 07 12:59:32.052637 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.052614    2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 07 12:59:32.052777 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.052640    2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-142-74.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 07 12:59:32.054191 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.054180    2576 topology_manager.go:138] "Creating topology manager with none policy"
Sep 07 12:59:32.054230 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.054193    2576 container_manager_linux.go:309] "Creating device plugin manager"
Sep 07 12:59:32.054230 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.054201    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 07 12:59:32.054230 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.054215    2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 07 12:59:32.056193 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.056175    2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 07 12:59:32.060851 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.060840    2576 state_mem.go:36] "Initialized new in-memory state store"
Sep 07 12:59:32.061123 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.061114    2576 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 07 12:59:32.061157 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.061144    2576 kubelet.go:486] "Attempting to sync node with API server"
Sep 07 12:59:32.061187 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.061165    2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 07 12:59:32.061187 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.061181    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 07 12:59:32.061240 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.061194    2576 kubelet.go:398] "Adding apiserver pod source"
Sep 07 12:59:32.061240 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.061206    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 07 12:59:32.061670 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.061649    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 07 12:59:32.061742 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.061682    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 07 12:59:32.061944 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.061911    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 07 12:59:32.065464 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.065429    2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 07 12:59:32.068546 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.068525    2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 07 12:59:32.068638 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.068566    2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 07 12:59:32.068772 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.068759    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 07 12:59:32.068828 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.068777    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 07 12:59:32.068828 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.068787    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 07 12:59:32.068828 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.068795    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 07 12:59:32.068828 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.068807    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 07 12:59:32.068828 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.068816    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 07 12:59:32.069504 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.069493    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 07 12:59:32.069551 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.069507    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 07 12:59:32.069551 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.069520    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 07 12:59:32.069551 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.069529    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 07 12:59:32.069551 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.069548    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 07 12:59:32.069684 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.069561    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 07 12:59:32.070490 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.070478    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 07 12:59:32.070546 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.070492    2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 07 12:59:32.076289 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.076275    2576 server.go:1268] "Started kubelet"
Sep 07 12:59:32.076530 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.076425    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 07 12:59:32.076668 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:32.076646    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-142-74.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 07 12:59:32.076714 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.076707    2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-142-74.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 07 12:59:32.076931 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:32.076912    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 07 12:59:32.077157 ip-10-0-142-74 systemd[1]: Started Kubernetes Kubelet.
Sep 07 12:59:32.077438 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.077261    2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 07 12:59:32.077438 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.077335    2576 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 07 12:59:32.078559 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.078546    2576 server.go:310] "Adding debug handlers to kubelet server"
Sep 07 12:59:32.080680 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.080660    2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 07 12:59:32.083063 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:32.081924    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-74.ec2.internal.18d30b5d3cce5381  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-74.ec2.internal,UID:ip-10-0-142-74.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-142-74.ec2.internal,},FirstTimestamp:2026-09-07 12:59:32.076237697 +0000 UTC m=+0.333017057,LastTimestamp:2026-09-07 12:59:32.076237697 +0000 UTC m=+0.333017057,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-74.ec2.internal,}"
Sep 07 12:59:32.083199 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:32.083177    2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 07 12:59:32.086092 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.086069    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 07 12:59:32.086092 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.086080    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 07 12:59:32.086228 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:32.086143    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-74.ec2.internal\" not found"
Sep 07 12:59:32.086808 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.086791    2576 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 07 12:59:32.086922 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.086911    2576 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 07 12:59:32.087148 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.086805    2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 07 12:59:32.087148 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.087046    2576 reconstruct.go:97] "Volume reconstruction finished"
Sep 07 12:59:32.087148 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.087055    2576 reconciler.go:29] "Reconciler: start to sync state"
Sep 07 12:59:32.087148 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.087114    2576 factory.go:55] Registering systemd factory
Sep 07 12:59:32.087542 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.087165    2576 factory.go:223] Registration of the systemd container factory successfully
Sep 07 12:59:32.087542 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.087533    2576 factory.go:153] Registering CRI-O factory
Sep 07 12:59:32.087797 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.087548    2576 factory.go:223] Registration of the crio container factory successfully
Sep 07 12:59:32.087797 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.087608    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 07 12:59:32.087797 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.087626    2576 factory.go:103] Registering Raw factory
Sep 07 12:59:32.087797 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.087652    2576 manager.go:1196] Started watching for new ooms in manager
Sep 07 12:59:32.088194 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.088180    2576 manager.go:349] Starting recovery of all containers
Sep 07 12:59:32.090677 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:32.090641    2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-142-74.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 07 12:59:32.091008 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:32.090982    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 07 12:59:32.099451 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.099432    2576 manager.go:354] Recovery completed
Sep 07 12:59:32.104714 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.104699    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 12:59:32.106529 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.106503    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-74.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 12:59:32.106616 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.106548    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-74.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 12:59:32.106616 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.106563    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-74.ec2.internal" event="NodeHasSufficientPID"
Sep 07 12:59:32.107355 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.107330    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 07 12:59:32.107355 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.107344    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 07 12:59:32.107647 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.107363    2576 state_mem.go:36] "Initialized new in-memory state store"
Sep 07 12:59:32.107647 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.107345    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 12:59:32.108261 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.108244    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-74.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 12:59:32.108355 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.108271    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-74.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 12:59:32.108355 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.108281    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-74.ec2.internal" event="NodeHasSufficientPID"
Sep 07 12:59:32.109501 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.109487    2576 policy_none.go:49] "None policy: Start"
Sep 07 12:59:32.109501 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.109503    2576 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 07 12:59:32.109624 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.109514    2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 07 12:59:32.109913 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:32.108914    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-74.ec2.internal.18d30b5d3e9c8e0e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-74.ec2.internal,UID:ip-10-0-142-74.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-74.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-74.ec2.internal,},FirstTimestamp:2026-09-07 12:59:32.106530318 +0000 UTC m=+0.363309678,LastTimestamp:2026-09-07 12:59:32.106530318 +0000 UTC m=+0.363309678,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-74.ec2.internal,}"
Sep 07 12:59:32.111393 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.111380    2576 policy_none.go:47] "Start"
Sep 07 12:59:32.122486 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:32.122414    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-74.ec2.internal.18d30b5d3e9cef97  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-74.ec2.internal,UID:ip-10-0-142-74.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-74.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-74.ec2.internal,},FirstTimestamp:2026-09-07 12:59:32.106555287 +0000 UTC m=+0.363334655,LastTimestamp:2026-09-07 12:59:32.106555287 +0000 UTC m=+0.363334655,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-74.ec2.internal,}"
Sep 07 12:59:32.132864 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:32.132760    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-74.ec2.internal.18d30b5d3e9d223e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-74.ec2.internal,UID:ip-10-0-142-74.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-74.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-74.ec2.internal,},FirstTimestamp:2026-09-07 12:59:32.106568254 +0000 UTC m=+0.363347620,LastTimestamp:2026-09-07 12:59:32.106568254 +0000 UTC m=+0.363347620,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-74.ec2.internal,}"
Sep 07 12:59:32.137465 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:32.137405    2576 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-74.ec2.internal.18d30b5d3e9c8e0e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-74.ec2.internal.18d30b5d3e9c8e0e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-74.ec2.internal,UID:ip-10-0-142-74.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-74.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-74.ec2.internal,},FirstTimestamp:2026-09-07 12:59:32.106530318 +0000 UTC m=+0.363309678,LastTimestamp:2026-09-07 12:59:32.108259107 +0000 UTC m=+0.365038466,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-74.ec2.internal,}"
Sep 07 12:59:32.142925 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:32.142819    2576 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-74.ec2.internal.18d30b5d3e9cef97\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-74.ec2.internal.18d30b5d3e9cef97  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-74.ec2.internal,UID:ip-10-0-142-74.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-142-74.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-142-74.ec2.internal,},FirstTimestamp:2026-09-07 12:59:32.106555287 +0000 UTC m=+0.363334655,LastTimestamp:2026-09-07 12:59:32.108275827 +0000 UTC m=+0.365055188,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-74.ec2.internal,}"
Sep 07 12:59:32.166782 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.149450    2576 manager.go:337] "Starting Device Plugin manager"
Sep 07 12:59:32.166782 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:32.149483    2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 07 12:59:32.166782 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.149497    2576 server.go:87] "Starting device plugin registration server"
Sep 07 12:59:32.166782 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.149723    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 07 12:59:32.166782 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.149732    2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 07 12:59:32.166782 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.149913    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 07 12:59:32.166782 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.149980    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 07 12:59:32.166782 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.149986    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 07 12:59:32.166782 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:32.150437    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 07 12:59:32.166782 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:32.150489    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-142-74.ec2.internal\" not found"
Sep 07 12:59:32.166782 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:32.153706    2576 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-74.ec2.internal.18d30b5d3e9d223e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-74.ec2.internal.18d30b5d3e9d223e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-74.ec2.internal,UID:ip-10-0-142-74.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-142-74.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-142-74.ec2.internal,},FirstTimestamp:2026-09-07 12:59:32.106568254 +0000 UTC m=+0.363347620,LastTimestamp:2026-09-07 12:59:32.108285207 +0000 UTC m=+0.365064567,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-74.ec2.internal,}"
Sep 07 12:59:32.166782 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.158053    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 07 12:59:32.166782 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.159648    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ft2z4"
Sep 07 12:59:32.166782 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.159755    2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 07 12:59:32.166782 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.159800    2576 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 07 12:59:32.166782 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.159818    2576 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 07 12:59:32.166782 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:32.159861    2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 07 12:59:32.167612 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:32.167552    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-74.ec2.internal.18d30b5d41a2e23d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-74.ec2.internal,UID:ip-10-0-142-74.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-142-74.ec2.internal,},FirstTimestamp:2026-09-07 12:59:32.157276733 +0000 UTC m=+0.414056080,LastTimestamp:2026-09-07 12:59:32.157276733 +0000 UTC m=+0.414056080,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-74.ec2.internal,}"
Sep 07 12:59:32.167691 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:32.167657    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass"
Sep 07 12:59:32.170067 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.170052    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ft2z4"
Sep 07 12:59:32.250729 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.250660    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 12:59:32.251484 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.251471    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-74.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 12:59:32.251531 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.251497    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-74.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 12:59:32.251531 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.251507    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-74.ec2.internal" event="NodeHasSufficientPID"
Sep 07 12:59:32.251531 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.251527    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-74.ec2.internal"
Sep 07 12:59:32.254492 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:32.254420    2576 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-142-74.ec2.internal.18d30b5d3e9c8e0e\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-142-74.ec2.internal.18d30b5d3e9c8e0e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-142-74.ec2.internal,UID:ip-10-0-142-74.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-142-74.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-142-74.ec2.internal,},FirstTimestamp:2026-09-07 12:59:32.106530318 +0000 UTC m=+0.363309678,LastTimestamp:2026-09-07 12:59:32.251484077 +0000 UTC m=+0.508263437,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-142-74.ec2.internal,}"
Sep 07 12:59:32.260391 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.260375    2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-74.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-142-74.ec2.internal"]
Sep 07 12:59:32.260438 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.260433    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 12:59:32.261895 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.261859    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-74.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 12:59:32.261974 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.261906    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-74.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 12:59:32.261974 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.261915    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-74.ec2.internal" event="NodeHasSufficientPID"
Sep 07 12:59:32.264224 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.264210    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 12:59:32.264344 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.264330    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-74.ec2.internal"
Sep 07 12:59:32.264381 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.264358    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 12:59:32.264881 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.264855    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-74.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 12:59:32.264935 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.264892    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-74.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 12:59:32.264935 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.264898    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-74.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 12:59:32.264935 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.264918    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-74.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 12:59:32.264935 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.264926    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-74.ec2.internal" event="NodeHasSufficientPID"
Sep 07 12:59:32.265063 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.264903    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-74.ec2.internal" event="NodeHasSufficientPID"
Sep 07 12:59:32.266462 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:32.266446    2576 kubelet_node_status.go:116] "Unable to register node with API server, error getting existing node" err="nodes \"ip-10-0-142-74.ec2.internal\" not found" node="ip-10-0-142-74.ec2.internal"
Sep 07 12:59:32.267204 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.267189    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-74.ec2.internal"
Sep 07 12:59:32.267294 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.267219    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 12:59:32.267920 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.267903    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-74.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 12:59:32.268020 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.267928    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-74.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 12:59:32.268020 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.267941    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-74.ec2.internal" event="NodeHasSufficientPID"
Sep 07 12:59:32.288532 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.288507    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b4b5c62f53d64b7cd5db1bd47dc9efbb-config\") pod \"kube-apiserver-proxy-ip-10-0-142-74.ec2.internal\" (UID: \"b4b5c62f53d64b7cd5db1bd47dc9efbb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-74.ec2.internal"
Sep 07 12:59:32.288623 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.288534    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d6d94452f88d9e8b7a79d67147a4a91c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-74.ec2.internal\" (UID: \"d6d94452f88d9e8b7a79d67147a4a91c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-74.ec2.internal"
Sep 07 12:59:32.288623 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.288552    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6d94452f88d9e8b7a79d67147a4a91c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-74.ec2.internal\" (UID: \"d6d94452f88d9e8b7a79d67147a4a91c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-74.ec2.internal"
Sep 07 12:59:32.292427 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:32.292409    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-74.ec2.internal\" not found" node="ip-10-0-142-74.ec2.internal"
Sep 07 12:59:32.296644 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:32.296620    2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-142-74.ec2.internal\" not found" node="ip-10-0-142-74.ec2.internal"
Sep 07 12:59:32.305240 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:32.305226    2576 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-142-74.ec2.internal\" not found" node="ip-10-0-142-74.ec2.internal"
Sep 07 12:59:32.388764 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.388743    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d6d94452f88d9e8b7a79d67147a4a91c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-74.ec2.internal\" (UID: \"d6d94452f88d9e8b7a79d67147a4a91c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-74.ec2.internal"
Sep 07 12:59:32.388844 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.388767    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6d94452f88d9e8b7a79d67147a4a91c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-74.ec2.internal\" (UID: \"d6d94452f88d9e8b7a79d67147a4a91c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-74.ec2.internal"
Sep 07 12:59:32.388844 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.388783    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b4b5c62f53d64b7cd5db1bd47dc9efbb-config\") pod \"kube-apiserver-proxy-ip-10-0-142-74.ec2.internal\" (UID: \"b4b5c62f53d64b7cd5db1bd47dc9efbb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-74.ec2.internal"
Sep 07 12:59:32.388844 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.388809    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b4b5c62f53d64b7cd5db1bd47dc9efbb-config\") pod \"kube-apiserver-proxy-ip-10-0-142-74.ec2.internal\" (UID: \"b4b5c62f53d64b7cd5db1bd47dc9efbb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-142-74.ec2.internal"
Sep 07 12:59:32.388974 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.388838    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d6d94452f88d9e8b7a79d67147a4a91c-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-142-74.ec2.internal\" (UID: \"d6d94452f88d9e8b7a79d67147a4a91c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-74.ec2.internal"
Sep 07 12:59:32.388974 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.388841    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d6d94452f88d9e8b7a79d67147a4a91c-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-142-74.ec2.internal\" (UID: \"d6d94452f88d9e8b7a79d67147a4a91c\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-74.ec2.internal"
Sep 07 12:59:32.466529 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.466505    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 12:59:32.467434 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.467417    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-74.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 12:59:32.467498 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.467448    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-74.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 12:59:32.467498 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.467463    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-74.ec2.internal" event="NodeHasSufficientPID"
Sep 07 12:59:32.467498 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.467492    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-142-74.ec2.internal"
Sep 07 12:59:32.480483 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.480465    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-142-74.ec2.internal"
Sep 07 12:59:32.480547 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:32.480485    2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-142-74.ec2.internal\": node \"ip-10-0-142-74.ec2.internal\" not found"
Sep 07 12:59:32.499463 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:32.499442    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-74.ec2.internal\" not found"
Sep 07 12:59:32.596268 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.596203    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-74.ec2.internal"
Sep 07 12:59:32.599878 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:32.599854    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-74.ec2.internal\" not found"
Sep 07 12:59:32.600385 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:32.600367    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-74.ec2.internal"
Sep 07 12:59:32.699985 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:32.699959    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-74.ec2.internal\" not found"
Sep 07 12:59:32.800452 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:32.800428    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-74.ec2.internal\" not found"
Sep 07 12:59:32.901021 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:32.900962    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-74.ec2.internal\" not found"
Sep 07 12:59:33.001467 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:33.001444    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-74.ec2.internal\" not found"
Sep 07 12:59:33.017610 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:33.017589    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 07 12:59:33.101915 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:33.101745    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-74.ec2.internal\" not found"
Sep 07 12:59:33.133928 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:33.133909    2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 07 12:59:33.134979 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:33.134958    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-74.ec2.internal" event="NodeHasSufficientMemory"
Sep 07 12:59:33.135055 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:33.134997    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-74.ec2.internal" event="NodeHasNoDiskPressure"
Sep 07 12:59:33.135055 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:33.135008    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-74.ec2.internal" event="NodeHasSufficientPID"
Sep 07 12:59:33.161386 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:33.161362    2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 12:59:33.165200 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:33.165170    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6d94452f88d9e8b7a79d67147a4a91c.slice/crio-32fed2d79996c4e8c4582804586a13f49f1a63fd6684802ed315bf0dd3262b3e WatchSource:0}: Error finding container 32fed2d79996c4e8c4582804586a13f49f1a63fd6684802ed315bf0dd3262b3e: Status 404 returned error can't find the container with id 32fed2d79996c4e8c4582804586a13f49f1a63fd6684802ed315bf0dd3262b3e
Sep 07 12:59:33.165623 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:33.165606    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4b5c62f53d64b7cd5db1bd47dc9efbb.slice/crio-03c560e7a98d991c684a0d253b2fda4f7c460dda5c0e8c1a6ea3049ffa9e3fe0 WatchSource:0}: Error finding container 03c560e7a98d991c684a0d253b2fda4f7c460dda5c0e8c1a6ea3049ffa9e3fe0: Status 404 returned error can't find the container with id 03c560e7a98d991c684a0d253b2fda4f7c460dda5c0e8c1a6ea3049ffa9e3fe0
Sep 07 12:59:33.171628 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:33.171593    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 12:59:33.172589 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:33.172548    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-06 12:54:33 +0000 UTC" deadline="2028-02-20 06:05:12.914296104 +0000 UTC"
Sep 07 12:59:33.172915 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:33.172892    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12737h5m39.741413274s"
Sep 07 12:59:33.202560 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:33.202540    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-74.ec2.internal\" not found"
Sep 07 12:59:33.303096 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:33.303071    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-74.ec2.internal\" not found"
Sep 07 12:59:33.403565 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:33.403538    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-74.ec2.internal\" not found"
Sep 07 12:59:33.410440 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:33.410385    2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 12:59:33.503761 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:33.503731    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-74.ec2.internal\" not found"
Sep 07 12:59:33.604580 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:33.604544    2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-142-74.ec2.internal\" not found"
Sep 07 12:59:33.628901 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:33.628863    2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 12:59:33.687328 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:33.687256    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-74.ec2.internal"
Sep 07 12:59:33.701859 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:33.701834    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 07 12:59:33.703467 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:33.703429    2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-74.ec2.internal"
Sep 07 12:59:33.725046 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:33.724965    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 07 12:59:33.765766 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:33.765736    2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 07 12:59:35.262622 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.262545    2576 apiserver.go:52] "Watching apiserver"
Sep 07 12:59:35.270067 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.270042    2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 07 12:59:35.270585 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.270558    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-lxl7v","kube-system/kube-apiserver-proxy-ip-10-0-142-74.ec2.internal","openshift-dns/node-resolver-75jvc","openshift-multus/network-metrics-daemon-jj8gw","openshift-network-diagnostics/network-check-target-fgv8s","openshift-network-operator/iptables-alerter-zwmcp","openshift-ovn-kubernetes/ovnkube-node-5wqcp","kube-system/global-pull-secret-syncer-sjggc","kube-system/konnectivity-agent-78vt9","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xbnd","openshift-cluster-node-tuning-operator/tuned-ptb8x","openshift-image-registry/node-ca-wwf4n","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-74.ec2.internal","openshift-multus/multus-additional-cni-plugins-46pjh"]
Sep 07 12:59:35.273321 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.273300    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.275899 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.275879    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.277991 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.277965    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 07 12:59:35.278105 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.277969    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 07 12:59:35.278834 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.278811    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 07 12:59:35.279044 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.279028    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-75jvc"
Sep 07 12:59:35.279108 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.279052    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p9c22\""
Sep 07 12:59:35.279248 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.279232    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 07 12:59:35.279428 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.279408    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 07 12:59:35.279595 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.279583    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 07 12:59:35.281142 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.281122    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj8gw"
Sep 07 12:59:35.281242 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:35.281189    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj8gw" podUID="b68768bd-84ba-4756-834a-ad023bd05cd3"
Sep 07 12:59:35.282604 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.282208    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 07 12:59:35.282604 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.282567    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 07 12:59:35.282718 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.282609    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s2pjd\""
Sep 07 12:59:35.282887 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.282871    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 07 12:59:35.283090 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.283035    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kgmtr\""
Sep 07 12:59:35.283188 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.283170    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 07 12:59:35.284112 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.284093    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgv8s"
Sep 07 12:59:35.284199 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:35.284161    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgv8s" podUID="87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1"
Sep 07 12:59:35.286230 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.286215    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 07 12:59:35.286230 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.286227    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zwmcp"
Sep 07 12:59:35.288697 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.288676    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 07 12:59:35.288807 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.288687    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 07 12:59:35.288986 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.288966    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 07 12:59:35.289366 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.289346    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6trkj\""
Sep 07 12:59:35.290811 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.290575    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-78vt9"
Sep 07 12:59:35.292812 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.292790    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-46pjh"
Sep 07 12:59:35.295959 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.295133    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-df9ht\""
Sep 07 12:59:35.295959 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.295463    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 07 12:59:35.295959 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.295830    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 07 12:59:35.296212 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.296086    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 12:59:35.296212 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:35.296159    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjggc" podUID="a5d02c03-a753-4457-ab6a-99c8285ca9aa"
Sep 07 12:59:35.298016 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.297997    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 07 12:59:35.298257 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.298239    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29d319db-0b73-45bc-ae4f-d98e87c21725-host\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.298337 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.298273    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/71fe3fc3-2e5c-40a7-9b58-150e96bb5b7c-iptables-alerter-script\") pod \"iptables-alerter-zwmcp\" (UID: \"71fe3fc3-2e5c-40a7-9b58-150e96bb5b7c\") " pod="openshift-network-operator/iptables-alerter-zwmcp"
Sep 07 12:59:35.298337 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.298301    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71fe3fc3-2e5c-40a7-9b58-150e96bb5b7c-host-slash\") pod \"iptables-alerter-zwmcp\" (UID: \"71fe3fc3-2e5c-40a7-9b58-150e96bb5b7c\") " pod="openshift-network-operator/iptables-alerter-zwmcp"
Sep 07 12:59:35.298337 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.298325    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-host-run-ovn-kubernetes\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.298491 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.298348    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-host-cni-netd\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.298491 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.298373    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4c2g\" (UniqueName: \"kubernetes.io/projected/71fe3fc3-2e5c-40a7-9b58-150e96bb5b7c-kube-api-access-j4c2g\") pod \"iptables-alerter-zwmcp\" (UID: \"71fe3fc3-2e5c-40a7-9b58-150e96bb5b7c\") " pod="openshift-network-operator/iptables-alerter-zwmcp"
Sep 07 12:59:35.298491 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.298396    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-host-kubelet\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.298491 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.298419    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c5179ef2-d701-44ec-8758-673214b5efde-agent-certs\") pod \"konnectivity-agent-78vt9\" (UID: \"c5179ef2-d701-44ec-8758-673214b5efde\") " pod="kube-system/konnectivity-agent-78vt9"
Sep 07 12:59:35.298491 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.298444    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a81301be-0f84-4fbb-a496-08f21fe21ad7-tmp-dir\") pod \"node-resolver-75jvc\" (UID: \"a81301be-0f84-4fbb-a496-08f21fe21ad7\") " pod="openshift-dns/node-resolver-75jvc"
Sep 07 12:59:35.298491 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.298469    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-log-socket\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.298491 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.298491    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c3bd986d-bcc3-455e-a67e-6eb321778808-env-overrides\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.298842 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.298513    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c3bd986d-bcc3-455e-a67e-6eb321778808-ovnkube-script-lib\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.298842 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.298534    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/29d319db-0b73-45bc-ae4f-d98e87c21725-etc-sysctl-d\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.298842 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.298557    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/29d319db-0b73-45bc-ae4f-d98e87c21725-etc-systemd\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.298842 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.298577    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/29d319db-0b73-45bc-ae4f-d98e87c21725-run\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.298842 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.298610    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29d319db-0b73-45bc-ae4f-d98e87c21725-tmp\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.298842 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.298632    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-run-systemd\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.298842 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.298655    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-node-log\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.298842 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.298678    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.298842 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.298702    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c3bd986d-bcc3-455e-a67e-6eb321778808-ovnkube-config\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.298842 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.298726    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29d319db-0b73-45bc-ae4f-d98e87c21725-lib-modules\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.298842 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.298748    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29d319db-0b73-45bc-ae4f-d98e87c21725-var-lib-kubelet\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.298842 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.298789    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b68768bd-84ba-4756-834a-ad023bd05cd3-metrics-certs\") pod \"network-metrics-daemon-jj8gw\" (UID: \"b68768bd-84ba-4756-834a-ad023bd05cd3\") " pod="openshift-multus/network-metrics-daemon-jj8gw"
Sep 07 12:59:35.298842 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.298841    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-host-run-netns\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.299379 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.298866    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-var-lib-openvswitch\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.299379 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.298884    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-run-openvswitch\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.299379 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.298901    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29d319db-0b73-45bc-ae4f-d98e87c21725-sys\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.299379 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.298914    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/29d319db-0b73-45bc-ae4f-d98e87c21725-etc-tuned\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.299379 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.298929    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j7rz\" (UniqueName: \"kubernetes.io/projected/b68768bd-84ba-4756-834a-ad023bd05cd3-kube-api-access-5j7rz\") pod \"network-metrics-daemon-jj8gw\" (UID: \"b68768bd-84ba-4756-834a-ad023bd05cd3\") " pod="openshift-multus/network-metrics-daemon-jj8gw"
Sep 07 12:59:35.299379 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.298943    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nfq4\" (UniqueName: \"kubernetes.io/projected/87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1-kube-api-access-8nfq4\") pod \"network-check-target-fgv8s\" (UID: \"87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1\") " pod="openshift-network-diagnostics/network-check-target-fgv8s"
Sep 07 12:59:35.299379 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.298958    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-systemd-units\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.299379 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.298980    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgbrt\" (UniqueName: \"kubernetes.io/projected/a81301be-0f84-4fbb-a496-08f21fe21ad7-kube-api-access-bgbrt\") pod \"node-resolver-75jvc\" (UID: \"a81301be-0f84-4fbb-a496-08f21fe21ad7\") " pod="openshift-dns/node-resolver-75jvc"
Sep 07 12:59:35.299379 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.299001    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c5179ef2-d701-44ec-8758-673214b5efde-konnectivity-ca\") pod \"konnectivity-agent-78vt9\" (UID: \"c5179ef2-d701-44ec-8758-673214b5efde\") " pod="kube-system/konnectivity-agent-78vt9"
Sep 07 12:59:35.299379 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.299030    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljx7r\" (UniqueName: \"kubernetes.io/projected/c3bd986d-bcc3-455e-a67e-6eb321778808-kube-api-access-ljx7r\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.299379 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.299071    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-etc-openvswitch\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.299379 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.299094    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-run-ovn\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.299379 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.299115    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/29d319db-0b73-45bc-ae4f-d98e87c21725-etc-modprobe-d\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.299379 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.299137    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/29d319db-0b73-45bc-ae4f-d98e87c21725-etc-sysctl-conf\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.299379 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.299162    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4gkv\" (UniqueName: \"kubernetes.io/projected/29d319db-0b73-45bc-ae4f-d98e87c21725-kube-api-access-n4gkv\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.299379 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.299187    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a81301be-0f84-4fbb-a496-08f21fe21ad7-hosts-file\") pod \"node-resolver-75jvc\" (UID: \"a81301be-0f84-4fbb-a496-08f21fe21ad7\") " pod="openshift-dns/node-resolver-75jvc"
Sep 07 12:59:35.300086 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.299211    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-host-slash\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.300086 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.299237    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-host-cni-bin\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.300086 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.299266    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3bd986d-bcc3-455e-a67e-6eb321778808-ovn-node-metrics-cert\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.300086 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.299296    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/29d319db-0b73-45bc-ae4f-d98e87c21725-etc-sysconfig\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.300086 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.299321    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29d319db-0b73-45bc-ae4f-d98e87c21725-etc-kubernetes\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.300086 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.299693    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xbnd"
Sep 07 12:59:35.300355 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.300289    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 07 12:59:35.300355 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.300307    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 07 12:59:35.300548 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.300525    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 07 12:59:35.300639 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.300532    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 07 12:59:35.300981 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.300952    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dthxs\""
Sep 07 12:59:35.301946 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.301388    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.301946 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.301794    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 07 12:59:35.301946 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.301841    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-h7547\""
Sep 07 12:59:35.302989 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.302969    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 07 12:59:35.303602 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.303584    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 07 12:59:35.303922 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.303899    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wwf4n"
Sep 07 12:59:35.306632 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.306492    2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 07 12:59:35.306632 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.306497    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-td2kc\""
Sep 07 12:59:35.306632 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.306542    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 07 12:59:35.307038 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.307010    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 07 12:59:35.307263 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.307186    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 07 12:59:35.307377 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.307362    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 07 12:59:35.307639 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.307624    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-lbqzv\""
Sep 07 12:59:35.344924 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.344904    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5k6jp"
Sep 07 12:59:35.351650 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.351630    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5k6jp"
Sep 07 12:59:35.364704 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.364653    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-74.ec2.internal" event={"ID":"b4b5c62f53d64b7cd5db1bd47dc9efbb","Type":"ContainerStarted","Data":"03c560e7a98d991c684a0d253b2fda4f7c460dda5c0e8c1a6ea3049ffa9e3fe0"}
Sep 07 12:59:35.365993 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.365960    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-74.ec2.internal" event={"ID":"d6d94452f88d9e8b7a79d67147a4a91c","Type":"ContainerStarted","Data":"32fed2d79996c4e8c4582804586a13f49f1a63fd6684802ed315bf0dd3262b3e"}
Sep 07 12:59:35.388048 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.388027    2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 07 12:59:35.400061 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400036    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/29d319db-0b73-45bc-ae4f-d98e87c21725-etc-systemd\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.400171 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400080    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0d7e447-233a-4a4c-8723-7c9a59646086-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-46pjh\" (UID: \"c0d7e447-233a-4a4c-8723-7c9a59646086\") " pod="openshift-multus/multus-additional-cni-plugins-46pjh"
Sep 07 12:59:35.400171 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400111    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d725314-9d8e-480e-b7c2-01feec6b12e3-cni-binary-copy\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.400171 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400159    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-log-socket\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.400323 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400199    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c3bd986d-bcc3-455e-a67e-6eb321778808-ovnkube-script-lib\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.400323 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400170    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/29d319db-0b73-45bc-ae4f-d98e87c21725-etc-systemd\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.400323 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400228    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/29d319db-0b73-45bc-ae4f-d98e87c21725-run\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.400323 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400257    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-log-socket\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.400323 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400266    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29d319db-0b73-45bc-ae4f-d98e87c21725-tmp\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.400553 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400329    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0d7e447-233a-4a4c-8723-7c9a59646086-cnibin\") pod \"multus-additional-cni-plugins-46pjh\" (UID: \"c0d7e447-233a-4a4c-8723-7c9a59646086\") " pod="openshift-multus/multus-additional-cni-plugins-46pjh"
Sep 07 12:59:35.400553 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400352    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/29d319db-0b73-45bc-ae4f-d98e87c21725-run\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.400553 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400358    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7nc5\" (UniqueName: \"kubernetes.io/projected/c0d7e447-233a-4a4c-8723-7c9a59646086-kube-api-access-d7nc5\") pod \"multus-additional-cni-plugins-46pjh\" (UID: \"c0d7e447-233a-4a4c-8723-7c9a59646086\") " pod="openshift-multus/multus-additional-cni-plugins-46pjh"
Sep 07 12:59:35.400553 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400390    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.400553 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400415    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.400553 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400426    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c3bd986d-bcc3-455e-a67e-6eb321778808-ovnkube-config\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.400553 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400450    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29d319db-0b73-45bc-ae4f-d98e87c21725-var-lib-kubelet\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.400553 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400473    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5d02c03-a753-4457-ab6a-99c8285ca9aa-original-pull-secret\") pod \"global-pull-secret-syncer-sjggc\" (UID: \"a5d02c03-a753-4457-ab6a-99c8285ca9aa\") " pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 12:59:35.400553 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400515    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-host-run-netns\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.400553 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400543    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-run-openvswitch\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.401054 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400561    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-host-run-netns\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.401054 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400565    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29d319db-0b73-45bc-ae4f-d98e87c21725-sys\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.401054 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400601    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/29d319db-0b73-45bc-ae4f-d98e87c21725-sys\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.401054 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400602    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2djv\" (UniqueName: \"kubernetes.io/projected/235bfdd2-c2a1-498a-9f3e-168ac70fd85b-kube-api-access-g2djv\") pod \"aws-ebs-csi-driver-node-7xbnd\" (UID: \"235bfdd2-c2a1-498a-9f3e-168ac70fd85b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xbnd"
Sep 07 12:59:35.401054 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400516    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/29d319db-0b73-45bc-ae4f-d98e87c21725-var-lib-kubelet\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.401054 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400628    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0d7e447-233a-4a4c-8723-7c9a59646086-system-cni-dir\") pod \"multus-additional-cni-plugins-46pjh\" (UID: \"c0d7e447-233a-4a4c-8723-7c9a59646086\") " pod="openshift-multus/multus-additional-cni-plugins-46pjh"
Sep 07 12:59:35.401054 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400645    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-run-openvswitch\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.401054 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400655    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0d7e447-233a-4a4c-8723-7c9a59646086-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-46pjh\" (UID: \"c0d7e447-233a-4a4c-8723-7c9a59646086\") " pod="openshift-multus/multus-additional-cni-plugins-46pjh"
Sep 07 12:59:35.401054 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400698    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgbrt\" (UniqueName: \"kubernetes.io/projected/a81301be-0f84-4fbb-a496-08f21fe21ad7-kube-api-access-bgbrt\") pod \"node-resolver-75jvc\" (UID: \"a81301be-0f84-4fbb-a496-08f21fe21ad7\") " pod="openshift-dns/node-resolver-75jvc"
Sep 07 12:59:35.401054 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400725    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a5d02c03-a753-4457-ab6a-99c8285ca9aa-dbus\") pod \"global-pull-secret-syncer-sjggc\" (UID: \"a5d02c03-a753-4457-ab6a-99c8285ca9aa\") " pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 12:59:35.401054 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400744    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/235bfdd2-c2a1-498a-9f3e-168ac70fd85b-socket-dir\") pod \"aws-ebs-csi-driver-node-7xbnd\" (UID: \"235bfdd2-c2a1-498a-9f3e-168ac70fd85b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xbnd"
Sep 07 12:59:35.401054 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400759    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-host-run-k8s-cni-cncf-io\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.401054 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400792    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-multus-conf-dir\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.401054 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400814    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-run-ovn\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.401054 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400836    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/29d319db-0b73-45bc-ae4f-d98e87c21725-etc-modprobe-d\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.401054 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400848    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c3bd986d-bcc3-455e-a67e-6eb321778808-ovnkube-script-lib\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.401054 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400872    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/29d319db-0b73-45bc-ae4f-d98e87c21725-etc-sysctl-conf\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.401893 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400898    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4gkv\" (UniqueName: \"kubernetes.io/projected/29d319db-0b73-45bc-ae4f-d98e87c21725-kube-api-access-n4gkv\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.401893 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400897    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 07 12:59:35.401893 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400920    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/235bfdd2-c2a1-498a-9f3e-168ac70fd85b-device-dir\") pod \"aws-ebs-csi-driver-node-7xbnd\" (UID: \"235bfdd2-c2a1-498a-9f3e-168ac70fd85b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xbnd"
Sep 07 12:59:35.401893 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400942    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c42a485d-29e3-41f3-aa5e-d1100b1b0c54-serviceca\") pod \"node-ca-wwf4n\" (UID: \"c42a485d-29e3-41f3-aa5e-d1100b1b0c54\") " pod="openshift-image-registry/node-ca-wwf4n"
Sep 07 12:59:35.401893 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400966    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-host-var-lib-kubelet\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.401893 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400982    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-host-slash\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.401893 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400981    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c3bd986d-bcc3-455e-a67e-6eb321778808-ovnkube-config\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.401893 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.400995    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/235bfdd2-c2a1-498a-9f3e-168ac70fd85b-etc-selinux\") pod \"aws-ebs-csi-driver-node-7xbnd\" (UID: \"235bfdd2-c2a1-498a-9f3e-168ac70fd85b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xbnd"
Sep 07 12:59:35.401893 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401011    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0d7e447-233a-4a4c-8723-7c9a59646086-tuning-conf-dir\") pod \"multus-additional-cni-plugins-46pjh\" (UID: \"c0d7e447-233a-4a4c-8723-7c9a59646086\") " pod="openshift-multus/multus-additional-cni-plugins-46pjh"
Sep 07 12:59:35.401893 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401032    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/71fe3fc3-2e5c-40a7-9b58-150e96bb5b7c-iptables-alerter-script\") pod \"iptables-alerter-zwmcp\" (UID: \"71fe3fc3-2e5c-40a7-9b58-150e96bb5b7c\") " pod="openshift-network-operator/iptables-alerter-zwmcp"
Sep 07 12:59:35.401893 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401058    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71fe3fc3-2e5c-40a7-9b58-150e96bb5b7c-host-slash\") pod \"iptables-alerter-zwmcp\" (UID: \"71fe3fc3-2e5c-40a7-9b58-150e96bb5b7c\") " pod="openshift-network-operator/iptables-alerter-zwmcp"
Sep 07 12:59:35.401893 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401074    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-host-run-ovn-kubernetes\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.401893 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401088    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4c2g\" (UniqueName: \"kubernetes.io/projected/71fe3fc3-2e5c-40a7-9b58-150e96bb5b7c-kube-api-access-j4c2g\") pod \"iptables-alerter-zwmcp\" (UID: \"71fe3fc3-2e5c-40a7-9b58-150e96bb5b7c\") " pod="openshift-network-operator/iptables-alerter-zwmcp"
Sep 07 12:59:35.401893 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401104    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c5179ef2-d701-44ec-8758-673214b5efde-agent-certs\") pod \"konnectivity-agent-78vt9\" (UID: \"c5179ef2-d701-44ec-8758-673214b5efde\") " pod="kube-system/konnectivity-agent-78vt9"
Sep 07 12:59:35.401893 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401118    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c3bd986d-bcc3-455e-a67e-6eb321778808-env-overrides\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.401893 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401131    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/29d319db-0b73-45bc-ae4f-d98e87c21725-etc-sysctl-d\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.401893 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401135    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-run-ovn\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.402691 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401145    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j7rz\" (UniqueName: \"kubernetes.io/projected/b68768bd-84ba-4756-834a-ad023bd05cd3-kube-api-access-5j7rz\") pod \"network-metrics-daemon-jj8gw\" (UID: \"b68768bd-84ba-4756-834a-ad023bd05cd3\") " pod="openshift-multus/network-metrics-daemon-jj8gw"
Sep 07 12:59:35.402691 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401161    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/235bfdd2-c2a1-498a-9f3e-168ac70fd85b-registration-dir\") pod \"aws-ebs-csi-driver-node-7xbnd\" (UID: \"235bfdd2-c2a1-498a-9f3e-168ac70fd85b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xbnd"
Sep 07 12:59:35.402691 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401183    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/235bfdd2-c2a1-498a-9f3e-168ac70fd85b-sys-fs\") pod \"aws-ebs-csi-driver-node-7xbnd\" (UID: \"235bfdd2-c2a1-498a-9f3e-168ac70fd85b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xbnd"
Sep 07 12:59:35.402691 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401189    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71fe3fc3-2e5c-40a7-9b58-150e96bb5b7c-host-slash\") pod \"iptables-alerter-zwmcp\" (UID: \"71fe3fc3-2e5c-40a7-9b58-150e96bb5b7c\") " pod="openshift-network-operator/iptables-alerter-zwmcp"
Sep 07 12:59:35.402691 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401205    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp6z6\" (UniqueName: \"kubernetes.io/projected/c42a485d-29e3-41f3-aa5e-d1100b1b0c54-kube-api-access-sp6z6\") pod \"node-ca-wwf4n\" (UID: \"c42a485d-29e3-41f3-aa5e-d1100b1b0c54\") " pod="openshift-image-registry/node-ca-wwf4n"
Sep 07 12:59:35.402691 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401266    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/29d319db-0b73-45bc-ae4f-d98e87c21725-etc-modprobe-d\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.402691 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401287    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-host-slash\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.402691 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401339    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-host-run-ovn-kubernetes\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.402691 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401347    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/29d319db-0b73-45bc-ae4f-d98e87c21725-etc-sysctl-d\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.402691 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401418    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/29d319db-0b73-45bc-ae4f-d98e87c21725-etc-sysctl-conf\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.402691 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401582    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-host-run-netns\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.402691 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401612    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-hostroot\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.402691 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401626    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-etc-kubernetes\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.402691 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401649    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-run-systemd\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.402691 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401650    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/71fe3fc3-2e5c-40a7-9b58-150e96bb5b7c-iptables-alerter-script\") pod \"iptables-alerter-zwmcp\" (UID: \"71fe3fc3-2e5c-40a7-9b58-150e96bb5b7c\") " pod="openshift-network-operator/iptables-alerter-zwmcp"
Sep 07 12:59:35.402691 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401665    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-node-log\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.402691 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401680    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29d319db-0b73-45bc-ae4f-d98e87c21725-lib-modules\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.403556 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401697    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b68768bd-84ba-4756-834a-ad023bd05cd3-metrics-certs\") pod \"network-metrics-daemon-jj8gw\" (UID: \"b68768bd-84ba-4756-834a-ad023bd05cd3\") " pod="openshift-multus/network-metrics-daemon-jj8gw"
Sep 07 12:59:35.403556 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401696    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c3bd986d-bcc3-455e-a67e-6eb321778808-env-overrides\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.403556 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401739    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-run-systemd\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.403556 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401759    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c42a485d-29e3-41f3-aa5e-d1100b1b0c54-host\") pod \"node-ca-wwf4n\" (UID: \"c42a485d-29e3-41f3-aa5e-d1100b1b0c54\") " pod="openshift-image-registry/node-ca-wwf4n"
Sep 07 12:59:35.403556 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:35.401781    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 12:59:35.403556 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401796    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0d7e447-233a-4a4c-8723-7c9a59646086-cni-binary-copy\") pod \"multus-additional-cni-plugins-46pjh\" (UID: \"c0d7e447-233a-4a4c-8723-7c9a59646086\") " pod="openshift-multus/multus-additional-cni-plugins-46pjh"
Sep 07 12:59:35.403556 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401822    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-var-lib-openvswitch\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.403556 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401844    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/29d319db-0b73-45bc-ae4f-d98e87c21725-etc-tuned\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.403556 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401865    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-cnibin\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.403556 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401905    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/29d319db-0b73-45bc-ae4f-d98e87c21725-lib-modules\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.403556 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:35.401934    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b68768bd-84ba-4756-834a-ad023bd05cd3-metrics-certs podName:b68768bd-84ba-4756-834a-ad023bd05cd3 nodeName:}" failed. No retries permitted until 2026-09-07 12:59:35.901912283 +0000 UTC m=+2.958793926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b68768bd-84ba-4756-834a-ad023bd05cd3-metrics-certs") pod "network-metrics-daemon-jj8gw" (UID: "b68768bd-84ba-4756-834a-ad023bd05cd3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 12:59:35.403556 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401957    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d725314-9d8e-480e-b7c2-01feec6b12e3-multus-daemon-config\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.403556 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.401983    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nfq4\" (UniqueName: \"kubernetes.io/projected/87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1-kube-api-access-8nfq4\") pod \"network-check-target-fgv8s\" (UID: \"87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1\") " pod="openshift-network-diagnostics/network-check-target-fgv8s"
Sep 07 12:59:35.403556 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.402002    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-node-log\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.403556 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.402015    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-var-lib-openvswitch\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.403556 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.402044    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-systemd-units\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.403556 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.402167    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/235bfdd2-c2a1-498a-9f3e-168ac70fd85b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7xbnd\" (UID: \"235bfdd2-c2a1-498a-9f3e-168ac70fd85b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xbnd"
Sep 07 12:59:35.404404 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.402230    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-multus-cni-dir\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.404404 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.402237    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-systemd-units\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.404404 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.402271    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c5179ef2-d701-44ec-8758-673214b5efde-konnectivity-ca\") pod \"konnectivity-agent-78vt9\" (UID: \"c5179ef2-d701-44ec-8758-673214b5efde\") " pod="kube-system/konnectivity-agent-78vt9"
Sep 07 12:59:35.404404 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.402303    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljx7r\" (UniqueName: \"kubernetes.io/projected/c3bd986d-bcc3-455e-a67e-6eb321778808-kube-api-access-ljx7r\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.404404 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.402326    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a5d02c03-a753-4457-ab6a-99c8285ca9aa-kubelet-config\") pod \"global-pull-secret-syncer-sjggc\" (UID: \"a5d02c03-a753-4457-ab6a-99c8285ca9aa\") " pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 12:59:35.404404 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.402374    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-host-var-lib-cni-bin\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.404404 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.402403    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-host-run-multus-certs\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.404404 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.402427    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-etc-openvswitch\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.404404 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.402469    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-multus-socket-dir-parent\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.404404 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.402493    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-host-var-lib-cni-multus\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.404404 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.402519    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a81301be-0f84-4fbb-a496-08f21fe21ad7-hosts-file\") pod \"node-resolver-75jvc\" (UID: \"a81301be-0f84-4fbb-a496-08f21fe21ad7\") " pod="openshift-dns/node-resolver-75jvc"
Sep 07 12:59:35.404404 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.402542    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-host-cni-bin\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.404404 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.402592    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3bd986d-bcc3-455e-a67e-6eb321778808-ovn-node-metrics-cert\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.404404 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.402617    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/29d319db-0b73-45bc-ae4f-d98e87c21725-etc-sysconfig\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.404404 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.402642    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29d319db-0b73-45bc-ae4f-d98e87c21725-etc-kubernetes\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.404404 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.402665    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29d319db-0b73-45bc-ae4f-d98e87c21725-host\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.404404 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.402699    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-system-cni-dir\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.405199 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.402725    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xwc6\" (UniqueName: \"kubernetes.io/projected/7d725314-9d8e-480e-b7c2-01feec6b12e3-kube-api-access-2xwc6\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.405199 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.402754    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-host-cni-netd\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.405199 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.402801    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-host-kubelet\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.405199 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.402890    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a81301be-0f84-4fbb-a496-08f21fe21ad7-tmp-dir\") pod \"node-resolver-75jvc\" (UID: \"a81301be-0f84-4fbb-a496-08f21fe21ad7\") " pod="openshift-dns/node-resolver-75jvc"
Sep 07 12:59:35.405199 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.402984    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c5179ef2-d701-44ec-8758-673214b5efde-konnectivity-ca\") pod \"konnectivity-agent-78vt9\" (UID: \"c5179ef2-d701-44ec-8758-673214b5efde\") " pod="kube-system/konnectivity-agent-78vt9"
Sep 07 12:59:35.405199 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.403042    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a81301be-0f84-4fbb-a496-08f21fe21ad7-hosts-file\") pod \"node-resolver-75jvc\" (UID: \"a81301be-0f84-4fbb-a496-08f21fe21ad7\") " pod="openshift-dns/node-resolver-75jvc"
Sep 07 12:59:35.405199 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.403077    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-host-kubelet\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.405199 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.403107    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-host-cni-bin\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.405199 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.403142    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-etc-openvswitch\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.405199 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.403156    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a81301be-0f84-4fbb-a496-08f21fe21ad7-tmp-dir\") pod \"node-resolver-75jvc\" (UID: \"a81301be-0f84-4fbb-a496-08f21fe21ad7\") " pod="openshift-dns/node-resolver-75jvc"
Sep 07 12:59:35.405199 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.403222    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/29d319db-0b73-45bc-ae4f-d98e87c21725-host\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.405199 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.403256    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c3bd986d-bcc3-455e-a67e-6eb321778808-host-cni-netd\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.405199 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.403307    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/29d319db-0b73-45bc-ae4f-d98e87c21725-etc-sysconfig\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.405199 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.403384    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/29d319db-0b73-45bc-ae4f-d98e87c21725-etc-kubernetes\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.405852 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.405827    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29d319db-0b73-45bc-ae4f-d98e87c21725-tmp\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.405907 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.405872    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/29d319db-0b73-45bc-ae4f-d98e87c21725-etc-tuned\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.405941 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.405903    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c3bd986d-bcc3-455e-a67e-6eb321778808-ovn-node-metrics-cert\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.406016 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.405999    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c5179ef2-d701-44ec-8758-673214b5efde-agent-certs\") pod \"konnectivity-agent-78vt9\" (UID: \"c5179ef2-d701-44ec-8758-673214b5efde\") " pod="kube-system/konnectivity-agent-78vt9"
Sep 07 12:59:35.418494 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:35.418196    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 12:59:35.418494 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:35.418228    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 12:59:35.418494 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:35.418241    2576 projected.go:196] Error preparing data for projected volume kube-api-access-8nfq4 for pod openshift-network-diagnostics/network-check-target-fgv8s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 12:59:35.418494 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:35.418304    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1-kube-api-access-8nfq4 podName:87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1 nodeName:}" failed. No retries permitted until 2026-09-07 12:59:35.918287847 +0000 UTC m=+2.975169504 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8nfq4" (UniqueName: "kubernetes.io/projected/87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1-kube-api-access-8nfq4") pod "network-check-target-fgv8s" (UID: "87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 12:59:35.420430 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.420403    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgbrt\" (UniqueName: \"kubernetes.io/projected/a81301be-0f84-4fbb-a496-08f21fe21ad7-kube-api-access-bgbrt\") pod \"node-resolver-75jvc\" (UID: \"a81301be-0f84-4fbb-a496-08f21fe21ad7\") " pod="openshift-dns/node-resolver-75jvc"
Sep 07 12:59:35.421169 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.421147    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4c2g\" (UniqueName: \"kubernetes.io/projected/71fe3fc3-2e5c-40a7-9b58-150e96bb5b7c-kube-api-access-j4c2g\") pod \"iptables-alerter-zwmcp\" (UID: \"71fe3fc3-2e5c-40a7-9b58-150e96bb5b7c\") " pod="openshift-network-operator/iptables-alerter-zwmcp"
Sep 07 12:59:35.422549 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.422224    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j7rz\" (UniqueName: \"kubernetes.io/projected/b68768bd-84ba-4756-834a-ad023bd05cd3-kube-api-access-5j7rz\") pod \"network-metrics-daemon-jj8gw\" (UID: \"b68768bd-84ba-4756-834a-ad023bd05cd3\") " pod="openshift-multus/network-metrics-daemon-jj8gw"
Sep 07 12:59:35.422549 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.422521    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljx7r\" (UniqueName: \"kubernetes.io/projected/c3bd986d-bcc3-455e-a67e-6eb321778808-kube-api-access-ljx7r\") pod \"ovnkube-node-5wqcp\" (UID: \"c3bd986d-bcc3-455e-a67e-6eb321778808\") " pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.423721 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.423699    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4gkv\" (UniqueName: \"kubernetes.io/projected/29d319db-0b73-45bc-ae4f-d98e87c21725-kube-api-access-n4gkv\") pod \"tuned-ptb8x\" (UID: \"29d319db-0b73-45bc-ae4f-d98e87c21725\") " pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.503964 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.503931    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-system-cni-dir\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.504129 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.503971    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xwc6\" (UniqueName: \"kubernetes.io/projected/7d725314-9d8e-480e-b7c2-01feec6b12e3-kube-api-access-2xwc6\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.504129 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504004    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0d7e447-233a-4a4c-8723-7c9a59646086-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-46pjh\" (UID: \"c0d7e447-233a-4a4c-8723-7c9a59646086\") " pod="openshift-multus/multus-additional-cni-plugins-46pjh"
Sep 07 12:59:35.504129 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504031    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d725314-9d8e-480e-b7c2-01feec6b12e3-cni-binary-copy\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.504129 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504069    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0d7e447-233a-4a4c-8723-7c9a59646086-cnibin\") pod \"multus-additional-cni-plugins-46pjh\" (UID: \"c0d7e447-233a-4a4c-8723-7c9a59646086\") " pod="openshift-multus/multus-additional-cni-plugins-46pjh"
Sep 07 12:59:35.504129 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504077    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-system-cni-dir\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.504129 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504095    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7nc5\" (UniqueName: \"kubernetes.io/projected/c0d7e447-233a-4a4c-8723-7c9a59646086-kube-api-access-d7nc5\") pod \"multus-additional-cni-plugins-46pjh\" (UID: \"c0d7e447-233a-4a4c-8723-7c9a59646086\") " pod="openshift-multus/multus-additional-cni-plugins-46pjh"
Sep 07 12:59:35.504129 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504125    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5d02c03-a753-4457-ab6a-99c8285ca9aa-original-pull-secret\") pod \"global-pull-secret-syncer-sjggc\" (UID: \"a5d02c03-a753-4457-ab6a-99c8285ca9aa\") " pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 12:59:35.504450 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504138    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0d7e447-233a-4a4c-8723-7c9a59646086-cnibin\") pod \"multus-additional-cni-plugins-46pjh\" (UID: \"c0d7e447-233a-4a4c-8723-7c9a59646086\") " pod="openshift-multus/multus-additional-cni-plugins-46pjh"
Sep 07 12:59:35.504450 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504148    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2djv\" (UniqueName: \"kubernetes.io/projected/235bfdd2-c2a1-498a-9f3e-168ac70fd85b-kube-api-access-g2djv\") pod \"aws-ebs-csi-driver-node-7xbnd\" (UID: \"235bfdd2-c2a1-498a-9f3e-168ac70fd85b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xbnd"
Sep 07 12:59:35.504450 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504165    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0d7e447-233a-4a4c-8723-7c9a59646086-system-cni-dir\") pod \"multus-additional-cni-plugins-46pjh\" (UID: \"c0d7e447-233a-4a4c-8723-7c9a59646086\") " pod="openshift-multus/multus-additional-cni-plugins-46pjh"
Sep 07 12:59:35.504450 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504181    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0d7e447-233a-4a4c-8723-7c9a59646086-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-46pjh\" (UID: \"c0d7e447-233a-4a4c-8723-7c9a59646086\") " pod="openshift-multus/multus-additional-cni-plugins-46pjh"
Sep 07 12:59:35.504450 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504199    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a5d02c03-a753-4457-ab6a-99c8285ca9aa-dbus\") pod \"global-pull-secret-syncer-sjggc\" (UID: \"a5d02c03-a753-4457-ab6a-99c8285ca9aa\") " pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 12:59:35.504450 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504213    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/235bfdd2-c2a1-498a-9f3e-168ac70fd85b-socket-dir\") pod \"aws-ebs-csi-driver-node-7xbnd\" (UID: \"235bfdd2-c2a1-498a-9f3e-168ac70fd85b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xbnd"
Sep 07 12:59:35.504450 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504260    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0d7e447-233a-4a4c-8723-7c9a59646086-system-cni-dir\") pod \"multus-additional-cni-plugins-46pjh\" (UID: \"c0d7e447-233a-4a4c-8723-7c9a59646086\") " pod="openshift-multus/multus-additional-cni-plugins-46pjh"
Sep 07 12:59:35.504450 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504299    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-host-run-k8s-cni-cncf-io\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.504450 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504325    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/235bfdd2-c2a1-498a-9f3e-168ac70fd85b-socket-dir\") pod \"aws-ebs-csi-driver-node-7xbnd\" (UID: \"235bfdd2-c2a1-498a-9f3e-168ac70fd85b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xbnd"
Sep 07 12:59:35.504450 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504342    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-host-run-k8s-cni-cncf-io\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.504450 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:35.504372    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 12:59:35.504450 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:35.504424    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5d02c03-a753-4457-ab6a-99c8285ca9aa-original-pull-secret podName:a5d02c03-a753-4457-ab6a-99c8285ca9aa nodeName:}" failed. No retries permitted until 2026-09-07 12:59:36.004407241 +0000 UTC m=+3.061288898 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5d02c03-a753-4457-ab6a-99c8285ca9aa-original-pull-secret") pod "global-pull-secret-syncer-sjggc" (UID: "a5d02c03-a753-4457-ab6a-99c8285ca9aa") : object "kube-system"/"original-pull-secret" not registered
Sep 07 12:59:35.505080 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504551    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-multus-conf-dir\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.505080 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504579    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/235bfdd2-c2a1-498a-9f3e-168ac70fd85b-device-dir\") pod \"aws-ebs-csi-driver-node-7xbnd\" (UID: \"235bfdd2-c2a1-498a-9f3e-168ac70fd85b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xbnd"
Sep 07 12:59:35.505080 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504601    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c42a485d-29e3-41f3-aa5e-d1100b1b0c54-serviceca\") pod \"node-ca-wwf4n\" (UID: \"c42a485d-29e3-41f3-aa5e-d1100b1b0c54\") " pod="openshift-image-registry/node-ca-wwf4n"
Sep 07 12:59:35.505080 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504624    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-host-var-lib-kubelet\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.505080 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504626    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a5d02c03-a753-4457-ab6a-99c8285ca9aa-dbus\") pod \"global-pull-secret-syncer-sjggc\" (UID: \"a5d02c03-a753-4457-ab6a-99c8285ca9aa\") " pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 12:59:35.505080 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504648    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/235bfdd2-c2a1-498a-9f3e-168ac70fd85b-etc-selinux\") pod \"aws-ebs-csi-driver-node-7xbnd\" (UID: \"235bfdd2-c2a1-498a-9f3e-168ac70fd85b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xbnd"
Sep 07 12:59:35.505080 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504666    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7d725314-9d8e-480e-b7c2-01feec6b12e3-cni-binary-copy\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.505080 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504681    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/235bfdd2-c2a1-498a-9f3e-168ac70fd85b-device-dir\") pod \"aws-ebs-csi-driver-node-7xbnd\" (UID: \"235bfdd2-c2a1-498a-9f3e-168ac70fd85b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xbnd"
Sep 07 12:59:35.505080 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504673    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0d7e447-233a-4a4c-8723-7c9a59646086-tuning-conf-dir\") pod \"multus-additional-cni-plugins-46pjh\" (UID: \"c0d7e447-233a-4a4c-8723-7c9a59646086\") " pod="openshift-multus/multus-additional-cni-plugins-46pjh"
Sep 07 12:59:35.505080 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504720    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0d7e447-233a-4a4c-8723-7c9a59646086-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-46pjh\" (UID: \"c0d7e447-233a-4a4c-8723-7c9a59646086\") " pod="openshift-multus/multus-additional-cni-plugins-46pjh"
Sep 07 12:59:35.505080 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504727    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/235bfdd2-c2a1-498a-9f3e-168ac70fd85b-registration-dir\") pod \"aws-ebs-csi-driver-node-7xbnd\" (UID: \"235bfdd2-c2a1-498a-9f3e-168ac70fd85b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xbnd"
Sep 07 12:59:35.505080 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504750    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/235bfdd2-c2a1-498a-9f3e-168ac70fd85b-sys-fs\") pod \"aws-ebs-csi-driver-node-7xbnd\" (UID: \"235bfdd2-c2a1-498a-9f3e-168ac70fd85b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xbnd"
Sep 07 12:59:35.505080 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504785    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-multus-conf-dir\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.505080 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504795    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp6z6\" (UniqueName: \"kubernetes.io/projected/c42a485d-29e3-41f3-aa5e-d1100b1b0c54-kube-api-access-sp6z6\") pod \"node-ca-wwf4n\" (UID: \"c42a485d-29e3-41f3-aa5e-d1100b1b0c54\") " pod="openshift-image-registry/node-ca-wwf4n"
Sep 07 12:59:35.505080 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504818    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-host-run-netns\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.505080 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504837    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0d7e447-233a-4a4c-8723-7c9a59646086-tuning-conf-dir\") pod \"multus-additional-cni-plugins-46pjh\" (UID: \"c0d7e447-233a-4a4c-8723-7c9a59646086\") " pod="openshift-multus/multus-additional-cni-plugins-46pjh"
Sep 07 12:59:35.505080 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504877    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-host-var-lib-kubelet\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.505818 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504886    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/235bfdd2-c2a1-498a-9f3e-168ac70fd85b-registration-dir\") pod \"aws-ebs-csi-driver-node-7xbnd\" (UID: \"235bfdd2-c2a1-498a-9f3e-168ac70fd85b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xbnd"
Sep 07 12:59:35.505818 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504937    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/235bfdd2-c2a1-498a-9f3e-168ac70fd85b-sys-fs\") pod \"aws-ebs-csi-driver-node-7xbnd\" (UID: \"235bfdd2-c2a1-498a-9f3e-168ac70fd85b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xbnd"
Sep 07 12:59:35.505818 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504940    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-host-run-netns\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.505818 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504938    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/235bfdd2-c2a1-498a-9f3e-168ac70fd85b-etc-selinux\") pod \"aws-ebs-csi-driver-node-7xbnd\" (UID: \"235bfdd2-c2a1-498a-9f3e-168ac70fd85b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xbnd"
Sep 07 12:59:35.505818 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.504975    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-hostroot\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.505818 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.505000    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-etc-kubernetes\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.505818 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.505038    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c42a485d-29e3-41f3-aa5e-d1100b1b0c54-host\") pod \"node-ca-wwf4n\" (UID: \"c42a485d-29e3-41f3-aa5e-d1100b1b0c54\") " pod="openshift-image-registry/node-ca-wwf4n"
Sep 07 12:59:35.505818 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.505062    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0d7e447-233a-4a4c-8723-7c9a59646086-cni-binary-copy\") pod \"multus-additional-cni-plugins-46pjh\" (UID: \"c0d7e447-233a-4a4c-8723-7c9a59646086\") " pod="openshift-multus/multus-additional-cni-plugins-46pjh"
Sep 07 12:59:35.505818 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.505088    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-cnibin\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.505818 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.505110    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d725314-9d8e-480e-b7c2-01feec6b12e3-multus-daemon-config\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.505818 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.505116    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-etc-kubernetes\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.505818 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.505150    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/235bfdd2-c2a1-498a-9f3e-168ac70fd85b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7xbnd\" (UID: \"235bfdd2-c2a1-498a-9f3e-168ac70fd85b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xbnd"
Sep 07 12:59:35.505818 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.505158    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0d7e447-233a-4a4c-8723-7c9a59646086-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-46pjh\" (UID: \"c0d7e447-233a-4a4c-8723-7c9a59646086\") " pod="openshift-multus/multus-additional-cni-plugins-46pjh"
Sep 07 12:59:35.505818 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.505167    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-multus-cni-dir\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.505818 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.505186    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a5d02c03-a753-4457-ab6a-99c8285ca9aa-kubelet-config\") pod \"global-pull-secret-syncer-sjggc\" (UID: \"a5d02c03-a753-4457-ab6a-99c8285ca9aa\") " pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 12:59:35.505818 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.505191    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c42a485d-29e3-41f3-aa5e-d1100b1b0c54-serviceca\") pod \"node-ca-wwf4n\" (UID: \"c42a485d-29e3-41f3-aa5e-d1100b1b0c54\") " pod="openshift-image-registry/node-ca-wwf4n"
Sep 07 12:59:35.505818 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.505202    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-host-var-lib-cni-bin\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.505818 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.505224    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-host-run-multus-certs\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.506468 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.505228    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/235bfdd2-c2a1-498a-9f3e-168ac70fd85b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7xbnd\" (UID: \"235bfdd2-c2a1-498a-9f3e-168ac70fd85b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xbnd"
Sep 07 12:59:35.506468 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.505236    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-hostroot\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.506468 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.505276    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a5d02c03-a753-4457-ab6a-99c8285ca9aa-kubelet-config\") pod \"global-pull-secret-syncer-sjggc\" (UID: \"a5d02c03-a753-4457-ab6a-99c8285ca9aa\") " pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 12:59:35.506468 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.505276    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c42a485d-29e3-41f3-aa5e-d1100b1b0c54-host\") pod \"node-ca-wwf4n\" (UID: \"c42a485d-29e3-41f3-aa5e-d1100b1b0c54\") " pod="openshift-image-registry/node-ca-wwf4n"
Sep 07 12:59:35.506468 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.505313    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-host-run-multus-certs\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.506468 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.505330    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-multus-cni-dir\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.506468 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.505341    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-multus-socket-dir-parent\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.506468 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.505241    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-multus-socket-dir-parent\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.506468 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.505368    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-host-var-lib-cni-multus\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.506468 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.505372    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-host-var-lib-cni-bin\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.506468 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.505423    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-cnibin\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.506468 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.505445    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7d725314-9d8e-480e-b7c2-01feec6b12e3-host-var-lib-cni-multus\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.506468 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.505536    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7d725314-9d8e-480e-b7c2-01feec6b12e3-multus-daemon-config\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.506468 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.505636    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0d7e447-233a-4a4c-8723-7c9a59646086-cni-binary-copy\") pod \"multus-additional-cni-plugins-46pjh\" (UID: \"c0d7e447-233a-4a4c-8723-7c9a59646086\") " pod="openshift-multus/multus-additional-cni-plugins-46pjh"
Sep 07 12:59:35.517710 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.517654    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7nc5\" (UniqueName: \"kubernetes.io/projected/c0d7e447-233a-4a4c-8723-7c9a59646086-kube-api-access-d7nc5\") pod \"multus-additional-cni-plugins-46pjh\" (UID: \"c0d7e447-233a-4a4c-8723-7c9a59646086\") " pod="openshift-multus/multus-additional-cni-plugins-46pjh"
Sep 07 12:59:35.518114 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.518092    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xwc6\" (UniqueName: \"kubernetes.io/projected/7d725314-9d8e-480e-b7c2-01feec6b12e3-kube-api-access-2xwc6\") pod \"multus-lxl7v\" (UID: \"7d725314-9d8e-480e-b7c2-01feec6b12e3\") " pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.519103 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.519081    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2djv\" (UniqueName: \"kubernetes.io/projected/235bfdd2-c2a1-498a-9f3e-168ac70fd85b-kube-api-access-g2djv\") pod \"aws-ebs-csi-driver-node-7xbnd\" (UID: \"235bfdd2-c2a1-498a-9f3e-168ac70fd85b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xbnd"
Sep 07 12:59:35.523161 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.523139    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp6z6\" (UniqueName: \"kubernetes.io/projected/c42a485d-29e3-41f3-aa5e-d1100b1b0c54-kube-api-access-sp6z6\") pod \"node-ca-wwf4n\" (UID: \"c42a485d-29e3-41f3-aa5e-d1100b1b0c54\") " pod="openshift-image-registry/node-ca-wwf4n"
Sep 07 12:59:35.586404 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.586373    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 12:59:35.595984 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.595957    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ptb8x"
Sep 07 12:59:35.604848 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.604825    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-75jvc"
Sep 07 12:59:35.613560 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.613539    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zwmcp"
Sep 07 12:59:35.621295 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.621272    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-78vt9"
Sep 07 12:59:35.628180 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.628160    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-46pjh"
Sep 07 12:59:35.637986 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.637962    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xbnd"
Sep 07 12:59:35.643720 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.643701    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lxl7v"
Sep 07 12:59:35.649353 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.649333    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wwf4n"
Sep 07 12:59:35.908365 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:35.908283    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b68768bd-84ba-4756-834a-ad023bd05cd3-metrics-certs\") pod \"network-metrics-daemon-jj8gw\" (UID: \"b68768bd-84ba-4756-834a-ad023bd05cd3\") " pod="openshift-multus/network-metrics-daemon-jj8gw"
Sep 07 12:59:35.908508 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:35.908442    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 12:59:35.908550 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:35.908510    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b68768bd-84ba-4756-834a-ad023bd05cd3-metrics-certs podName:b68768bd-84ba-4756-834a-ad023bd05cd3 nodeName:}" failed. No retries permitted until 2026-09-07 12:59:36.908495076 +0000 UTC m=+3.965376717 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b68768bd-84ba-4756-834a-ad023bd05cd3-metrics-certs") pod "network-metrics-daemon-jj8gw" (UID: "b68768bd-84ba-4756-834a-ad023bd05cd3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 12:59:36.008867 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:36.008836    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5d02c03-a753-4457-ab6a-99c8285ca9aa-original-pull-secret\") pod \"global-pull-secret-syncer-sjggc\" (UID: \"a5d02c03-a753-4457-ab6a-99c8285ca9aa\") " pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 12:59:36.009013 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:36.008910    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nfq4\" (UniqueName: \"kubernetes.io/projected/87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1-kube-api-access-8nfq4\") pod \"network-check-target-fgv8s\" (UID: \"87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1\") " pod="openshift-network-diagnostics/network-check-target-fgv8s"
Sep 07 12:59:36.009013 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:36.008985    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 12:59:36.009083 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:36.009034    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 12:59:36.009083 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:36.009052    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 12:59:36.009083 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:36.009062    2576 projected.go:196] Error preparing data for projected volume kube-api-access-8nfq4 for pod openshift-network-diagnostics/network-check-target-fgv8s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 12:59:36.009083 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:36.009066    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5d02c03-a753-4457-ab6a-99c8285ca9aa-original-pull-secret podName:a5d02c03-a753-4457-ab6a-99c8285ca9aa nodeName:}" failed. No retries permitted until 2026-09-07 12:59:37.009048982 +0000 UTC m=+4.065930623 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5d02c03-a753-4457-ab6a-99c8285ca9aa-original-pull-secret") pod "global-pull-secret-syncer-sjggc" (UID: "a5d02c03-a753-4457-ab6a-99c8285ca9aa") : object "kube-system"/"original-pull-secret" not registered
Sep 07 12:59:36.009210 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:36.009102    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1-kube-api-access-8nfq4 podName:87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1 nodeName:}" failed. No retries permitted until 2026-09-07 12:59:37.009089383 +0000 UTC m=+4.065971020 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8nfq4" (UniqueName: "kubernetes.io/projected/87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1-kube-api-access-8nfq4") pod "network-check-target-fgv8s" (UID: "87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 12:59:36.314366 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:36.314330    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71fe3fc3_2e5c_40a7_9b58_150e96bb5b7c.slice/crio-0be877dd6cf4c380114f8fec9f75719e6a251de09d36792d4097fab2a9385d36 WatchSource:0}: Error finding container 0be877dd6cf4c380114f8fec9f75719e6a251de09d36792d4097fab2a9385d36: Status 404 returned error can't find the container with id 0be877dd6cf4c380114f8fec9f75719e6a251de09d36792d4097fab2a9385d36
Sep 07 12:59:36.321742 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:36.321704    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3bd986d_bcc3_455e_a67e_6eb321778808.slice/crio-fd6470d8ab57346d893564140a4cb7c162407a2a46765aba3bfa1eea32da77d4 WatchSource:0}: Error finding container fd6470d8ab57346d893564140a4cb7c162407a2a46765aba3bfa1eea32da77d4: Status 404 returned error can't find the container with id fd6470d8ab57346d893564140a4cb7c162407a2a46765aba3bfa1eea32da77d4
Sep 07 12:59:36.322810 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:36.322782    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0d7e447_233a_4a4c_8723_7c9a59646086.slice/crio-8c9f09d06ec10c52aa3417b9f4a4eabbc9843d8d8696dd6e3b26daec67fb1308 WatchSource:0}: Error finding container 8c9f09d06ec10c52aa3417b9f4a4eabbc9843d8d8696dd6e3b26daec67fb1308: Status 404 returned error can't find the container with id 8c9f09d06ec10c52aa3417b9f4a4eabbc9843d8d8696dd6e3b26daec67fb1308
Sep 07 12:59:36.323527 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:36.323511    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5179ef2_d701_44ec_8758_673214b5efde.slice/crio-85f57427e4fe6b1ef8fea52e78d3b3ef362bf614420f4f8178914b8167c15430 WatchSource:0}: Error finding container 85f57427e4fe6b1ef8fea52e78d3b3ef362bf614420f4f8178914b8167c15430: Status 404 returned error can't find the container with id 85f57427e4fe6b1ef8fea52e78d3b3ef362bf614420f4f8178914b8167c15430
Sep 07 12:59:36.344047 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:36.344027    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29d319db_0b73_45bc_ae4f_d98e87c21725.slice/crio-e23e05a1163faa7a0fd9e7d85000b79574994ce3558f34c55f903897b075c8f1 WatchSource:0}: Error finding container e23e05a1163faa7a0fd9e7d85000b79574994ce3558f34c55f903897b075c8f1: Status 404 returned error can't find the container with id e23e05a1163faa7a0fd9e7d85000b79574994ce3558f34c55f903897b075c8f1
Sep 07 12:59:36.345218 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:36.345138    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda81301be_0f84_4fbb_a496_08f21fe21ad7.slice/crio-167a2014eeb862d420705b24cdfe6890e5a50ad35379661b870ddf5b282417fc WatchSource:0}: Error finding container 167a2014eeb862d420705b24cdfe6890e5a50ad35379661b870ddf5b282417fc: Status 404 returned error can't find the container with id 167a2014eeb862d420705b24cdfe6890e5a50ad35379661b870ddf5b282417fc
Sep 07 12:59:36.346810 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:36.346792    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod235bfdd2_c2a1_498a_9f3e_168ac70fd85b.slice/crio-36b71e64c7e3856f09145fc9f68222a21e0207b0901671aaf1ba5ff8fc1ad522 WatchSource:0}: Error finding container 36b71e64c7e3856f09145fc9f68222a21e0207b0901671aaf1ba5ff8fc1ad522: Status 404 returned error can't find the container with id 36b71e64c7e3856f09145fc9f68222a21e0207b0901671aaf1ba5ff8fc1ad522
Sep 07 12:59:36.347315 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:36.347296    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d725314_9d8e_480e_b7c2_01feec6b12e3.slice/crio-8fb661cbaeea0716b8e62efd5064c485f2fe899ced47183e05bdae07fd22aea6 WatchSource:0}: Error finding container 8fb661cbaeea0716b8e62efd5064c485f2fe899ced47183e05bdae07fd22aea6: Status 404 returned error can't find the container with id 8fb661cbaeea0716b8e62efd5064c485f2fe899ced47183e05bdae07fd22aea6
Sep 07 12:59:36.348129 ip-10-0-142-74 kubenswrapper[2576]: W0907 12:59:36.348109    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc42a485d_29e3_41f3_aa5e_d1100b1b0c54.slice/crio-173b1e254149a82547ee0f51adbf4beb2c74d1e64d8df9ac3d930370d476e40a WatchSource:0}: Error finding container 173b1e254149a82547ee0f51adbf4beb2c74d1e64d8df9ac3d930370d476e40a: Status 404 returned error can't find the container with id 173b1e254149a82547ee0f51adbf4beb2c74d1e64d8df9ac3d930370d476e40a
Sep 07 12:59:36.354258 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:36.354184    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 12:54:35 +0000 UTC" deadline="2028-03-03 16:03:20.943141674 +0000 UTC"
Sep 07 12:59:36.354258 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:36.354209    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13035h3m44.58893642s"
Sep 07 12:59:36.369224 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:36.369193    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wwf4n" event={"ID":"c42a485d-29e3-41f3-aa5e-d1100b1b0c54","Type":"ContainerStarted","Data":"173b1e254149a82547ee0f51adbf4beb2c74d1e64d8df9ac3d930370d476e40a"}
Sep 07 12:59:36.370629 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:36.370602    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-78vt9" event={"ID":"c5179ef2-d701-44ec-8758-673214b5efde","Type":"ContainerStarted","Data":"85f57427e4fe6b1ef8fea52e78d3b3ef362bf614420f4f8178914b8167c15430"}
Sep 07 12:59:36.371849 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:36.371826    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zwmcp" event={"ID":"71fe3fc3-2e5c-40a7-9b58-150e96bb5b7c","Type":"ContainerStarted","Data":"0be877dd6cf4c380114f8fec9f75719e6a251de09d36792d4097fab2a9385d36"}
Sep 07 12:59:36.372955 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:36.372934    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lxl7v" event={"ID":"7d725314-9d8e-480e-b7c2-01feec6b12e3","Type":"ContainerStarted","Data":"8fb661cbaeea0716b8e62efd5064c485f2fe899ced47183e05bdae07fd22aea6"}
Sep 07 12:59:36.373982 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:36.373957    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xbnd" event={"ID":"235bfdd2-c2a1-498a-9f3e-168ac70fd85b","Type":"ContainerStarted","Data":"36b71e64c7e3856f09145fc9f68222a21e0207b0901671aaf1ba5ff8fc1ad522"}
Sep 07 12:59:36.375058 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:36.375034    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-75jvc" event={"ID":"a81301be-0f84-4fbb-a496-08f21fe21ad7","Type":"ContainerStarted","Data":"167a2014eeb862d420705b24cdfe6890e5a50ad35379661b870ddf5b282417fc"}
Sep 07 12:59:36.376177 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:36.376152    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ptb8x" event={"ID":"29d319db-0b73-45bc-ae4f-d98e87c21725","Type":"ContainerStarted","Data":"e23e05a1163faa7a0fd9e7d85000b79574994ce3558f34c55f903897b075c8f1"}
Sep 07 12:59:36.377289 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:36.377270    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-46pjh" event={"ID":"c0d7e447-233a-4a4c-8723-7c9a59646086","Type":"ContainerStarted","Data":"8c9f09d06ec10c52aa3417b9f4a4eabbc9843d8d8696dd6e3b26daec67fb1308"}
Sep 07 12:59:36.378344 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:36.378326    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp" event={"ID":"c3bd986d-bcc3-455e-a67e-6eb321778808","Type":"ContainerStarted","Data":"fd6470d8ab57346d893564140a4cb7c162407a2a46765aba3bfa1eea32da77d4"}
Sep 07 12:59:36.914034 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:36.913947    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b68768bd-84ba-4756-834a-ad023bd05cd3-metrics-certs\") pod \"network-metrics-daemon-jj8gw\" (UID: \"b68768bd-84ba-4756-834a-ad023bd05cd3\") " pod="openshift-multus/network-metrics-daemon-jj8gw"
Sep 07 12:59:36.914182 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:36.914156    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 12:59:36.914254 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:36.914221    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b68768bd-84ba-4756-834a-ad023bd05cd3-metrics-certs podName:b68768bd-84ba-4756-834a-ad023bd05cd3 nodeName:}" failed. No retries permitted until 2026-09-07 12:59:38.914202244 +0000 UTC m=+5.971083884 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b68768bd-84ba-4756-834a-ad023bd05cd3-metrics-certs") pod "network-metrics-daemon-jj8gw" (UID: "b68768bd-84ba-4756-834a-ad023bd05cd3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 12:59:37.015648 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:37.014836    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nfq4\" (UniqueName: \"kubernetes.io/projected/87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1-kube-api-access-8nfq4\") pod \"network-check-target-fgv8s\" (UID: \"87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1\") " pod="openshift-network-diagnostics/network-check-target-fgv8s"
Sep 07 12:59:37.015648 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:37.014903    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5d02c03-a753-4457-ab6a-99c8285ca9aa-original-pull-secret\") pod \"global-pull-secret-syncer-sjggc\" (UID: \"a5d02c03-a753-4457-ab6a-99c8285ca9aa\") " pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 12:59:37.015648 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:37.015041    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 12:59:37.015648 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:37.015104    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5d02c03-a753-4457-ab6a-99c8285ca9aa-original-pull-secret podName:a5d02c03-a753-4457-ab6a-99c8285ca9aa nodeName:}" failed. No retries permitted until 2026-09-07 12:59:39.015085717 +0000 UTC m=+6.071967356 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5d02c03-a753-4457-ab6a-99c8285ca9aa-original-pull-secret") pod "global-pull-secret-syncer-sjggc" (UID: "a5d02c03-a753-4457-ab6a-99c8285ca9aa") : object "kube-system"/"original-pull-secret" not registered
Sep 07 12:59:37.015648 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:37.015530    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 12:59:37.015648 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:37.015549    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 12:59:37.015648 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:37.015563    2576 projected.go:196] Error preparing data for projected volume kube-api-access-8nfq4 for pod openshift-network-diagnostics/network-check-target-fgv8s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 12:59:37.015648 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:37.015611    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1-kube-api-access-8nfq4 podName:87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1 nodeName:}" failed. No retries permitted until 2026-09-07 12:59:39.015594792 +0000 UTC m=+6.072476443 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8nfq4" (UniqueName: "kubernetes.io/projected/87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1-kube-api-access-8nfq4") pod "network-check-target-fgv8s" (UID: "87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 12:59:37.354866 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:37.354790    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 12:54:35 +0000 UTC" deadline="2028-03-23 18:21:41.884626672 +0000 UTC"
Sep 07 12:59:37.354866 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:37.354851    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13517h22m4.529779766s"
Sep 07 12:59:37.363761 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:37.362751    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj8gw"
Sep 07 12:59:37.363761 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:37.362904    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj8gw" podUID="b68768bd-84ba-4756-834a-ad023bd05cd3"
Sep 07 12:59:37.363761 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:37.362979    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgv8s"
Sep 07 12:59:37.363761 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:37.363042    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgv8s" podUID="87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1"
Sep 07 12:59:37.363761 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:37.363099    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 12:59:37.363761 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:37.363166    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjggc" podUID="a5d02c03-a753-4457-ab6a-99c8285ca9aa"
Sep 07 12:59:37.397018 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:37.396976    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-74.ec2.internal" event={"ID":"b4b5c62f53d64b7cd5db1bd47dc9efbb","Type":"ContainerStarted","Data":"51aec02fb26aa4e966426c096e5cb62fec6ac3a929e28032424b018b69234d5e"}
Sep 07 12:59:37.406415 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:37.406385    2576 generic.go:356] "Generic (PLEG): container finished" podID="d6d94452f88d9e8b7a79d67147a4a91c" containerID="dbedc0ed09d660a503fd6ac39167355ba4ff9030997e0d58cef78a6349223937" exitCode=0
Sep 07 12:59:37.406555 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:37.406436    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-74.ec2.internal" event={"ID":"d6d94452f88d9e8b7a79d67147a4a91c","Type":"ContainerDied","Data":"dbedc0ed09d660a503fd6ac39167355ba4ff9030997e0d58cef78a6349223937"}
Sep 07 12:59:37.438199 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:37.437238    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-142-74.ec2.internal" podStartSLOduration=3.4372160210000002 podStartE2EDuration="3.437216021s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:59:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:59:37.415793479 +0000 UTC m=+4.472675137" watchObservedRunningTime="2026-09-07 12:59:37.437216021 +0000 UTC m=+4.494097681"
Sep 07 12:59:38.423299 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:38.423113    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-74.ec2.internal" event={"ID":"d6d94452f88d9e8b7a79d67147a4a91c","Type":"ContainerStarted","Data":"079ba93b11f10431aed350dc1362a2bb0813a38df13d52ff70b71adf2348e875"}
Sep 07 12:59:38.451387 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:38.450825    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-142-74.ec2.internal" podStartSLOduration=4.450806482 podStartE2EDuration="4.450806482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:59:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:59:38.448447525 +0000 UTC m=+5.505329184" watchObservedRunningTime="2026-09-07 12:59:38.450806482 +0000 UTC m=+5.507688153"
Sep 07 12:59:38.931583 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:38.930955    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b68768bd-84ba-4756-834a-ad023bd05cd3-metrics-certs\") pod \"network-metrics-daemon-jj8gw\" (UID: \"b68768bd-84ba-4756-834a-ad023bd05cd3\") " pod="openshift-multus/network-metrics-daemon-jj8gw"
Sep 07 12:59:38.931583 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:38.931175    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 12:59:38.931583 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:38.931244    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b68768bd-84ba-4756-834a-ad023bd05cd3-metrics-certs podName:b68768bd-84ba-4756-834a-ad023bd05cd3 nodeName:}" failed. No retries permitted until 2026-09-07 12:59:42.931224605 +0000 UTC m=+9.988106245 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b68768bd-84ba-4756-834a-ad023bd05cd3-metrics-certs") pod "network-metrics-daemon-jj8gw" (UID: "b68768bd-84ba-4756-834a-ad023bd05cd3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 12:59:39.032065 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:39.032026    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5d02c03-a753-4457-ab6a-99c8285ca9aa-original-pull-secret\") pod \"global-pull-secret-syncer-sjggc\" (UID: \"a5d02c03-a753-4457-ab6a-99c8285ca9aa\") " pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 12:59:39.032234 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:39.032102    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nfq4\" (UniqueName: \"kubernetes.io/projected/87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1-kube-api-access-8nfq4\") pod \"network-check-target-fgv8s\" (UID: \"87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1\") " pod="openshift-network-diagnostics/network-check-target-fgv8s"
Sep 07 12:59:39.032294 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:39.032256    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 12:59:39.032294 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:39.032276    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 12:59:39.032294 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:39.032289    2576 projected.go:196] Error preparing data for projected volume kube-api-access-8nfq4 for pod openshift-network-diagnostics/network-check-target-fgv8s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 12:59:39.032449 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:39.032426    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1-kube-api-access-8nfq4 podName:87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1 nodeName:}" failed. No retries permitted until 2026-09-07 12:59:43.032404843 +0000 UTC m=+10.089286497 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8nfq4" (UniqueName: "kubernetes.io/projected/87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1-kube-api-access-8nfq4") pod "network-check-target-fgv8s" (UID: "87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 12:59:39.032886 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:39.032864    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 12:59:39.033026 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:39.032923    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5d02c03-a753-4457-ab6a-99c8285ca9aa-original-pull-secret podName:a5d02c03-a753-4457-ab6a-99c8285ca9aa nodeName:}" failed. No retries permitted until 2026-09-07 12:59:43.032909135 +0000 UTC m=+10.089790787 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5d02c03-a753-4457-ab6a-99c8285ca9aa-original-pull-secret") pod "global-pull-secret-syncer-sjggc" (UID: "a5d02c03-a753-4457-ab6a-99c8285ca9aa") : object "kube-system"/"original-pull-secret" not registered
Sep 07 12:59:39.362759 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:39.362677    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj8gw"
Sep 07 12:59:39.362988 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:39.362845    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj8gw" podUID="b68768bd-84ba-4756-834a-ad023bd05cd3"
Sep 07 12:59:39.363253 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:39.363233    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgv8s"
Sep 07 12:59:39.363347 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:39.363330    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgv8s" podUID="87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1"
Sep 07 12:59:39.363404 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:39.363374    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 12:59:39.363508 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:39.363460    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjggc" podUID="a5d02c03-a753-4457-ab6a-99c8285ca9aa"
Sep 07 12:59:41.360700 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:41.360668    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj8gw"
Sep 07 12:59:41.361163 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:41.360829    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj8gw" podUID="b68768bd-84ba-4756-834a-ad023bd05cd3"
Sep 07 12:59:41.361290 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:41.361259    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgv8s"
Sep 07 12:59:41.361397 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:41.361364    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgv8s" podUID="87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1"
Sep 07 12:59:41.361670 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:41.361517    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 12:59:41.361670 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:41.361628    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjggc" podUID="a5d02c03-a753-4457-ab6a-99c8285ca9aa"
Sep 07 12:59:42.976955 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:42.976920    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b68768bd-84ba-4756-834a-ad023bd05cd3-metrics-certs\") pod \"network-metrics-daemon-jj8gw\" (UID: \"b68768bd-84ba-4756-834a-ad023bd05cd3\") " pod="openshift-multus/network-metrics-daemon-jj8gw"
Sep 07 12:59:42.977422 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:42.977095    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 12:59:42.977422 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:42.977163    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b68768bd-84ba-4756-834a-ad023bd05cd3-metrics-certs podName:b68768bd-84ba-4756-834a-ad023bd05cd3 nodeName:}" failed. No retries permitted until 2026-09-07 12:59:50.97714462 +0000 UTC m=+18.034026272 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b68768bd-84ba-4756-834a-ad023bd05cd3-metrics-certs") pod "network-metrics-daemon-jj8gw" (UID: "b68768bd-84ba-4756-834a-ad023bd05cd3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 12:59:43.077304 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:43.077259    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nfq4\" (UniqueName: \"kubernetes.io/projected/87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1-kube-api-access-8nfq4\") pod \"network-check-target-fgv8s\" (UID: \"87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1\") " pod="openshift-network-diagnostics/network-check-target-fgv8s"
Sep 07 12:59:43.077470 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:43.077327    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5d02c03-a753-4457-ab6a-99c8285ca9aa-original-pull-secret\") pod \"global-pull-secret-syncer-sjggc\" (UID: \"a5d02c03-a753-4457-ab6a-99c8285ca9aa\") " pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 12:59:43.077470 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:43.077449    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 12:59:43.077592 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:43.077472    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 12:59:43.077592 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:43.077497    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 12:59:43.077592 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:43.077505    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5d02c03-a753-4457-ab6a-99c8285ca9aa-original-pull-secret podName:a5d02c03-a753-4457-ab6a-99c8285ca9aa nodeName:}" failed. No retries permitted until 2026-09-07 12:59:51.077490975 +0000 UTC m=+18.134372612 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5d02c03-a753-4457-ab6a-99c8285ca9aa-original-pull-secret") pod "global-pull-secret-syncer-sjggc" (UID: "a5d02c03-a753-4457-ab6a-99c8285ca9aa") : object "kube-system"/"original-pull-secret" not registered
Sep 07 12:59:43.077592 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:43.077511    2576 projected.go:196] Error preparing data for projected volume kube-api-access-8nfq4 for pod openshift-network-diagnostics/network-check-target-fgv8s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 12:59:43.077592 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:43.077552    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1-kube-api-access-8nfq4 podName:87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1 nodeName:}" failed. No retries permitted until 2026-09-07 12:59:51.077540368 +0000 UTC m=+18.134422011 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8nfq4" (UniqueName: "kubernetes.io/projected/87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1-kube-api-access-8nfq4") pod "network-check-target-fgv8s" (UID: "87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 12:59:43.360832 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:43.360737    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgv8s"
Sep 07 12:59:43.360832 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:43.360761    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj8gw"
Sep 07 12:59:43.361020 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:43.360744    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 12:59:43.361020 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:43.360883    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgv8s" podUID="87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1"
Sep 07 12:59:43.361020 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:43.360971    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjggc" podUID="a5d02c03-a753-4457-ab6a-99c8285ca9aa"
Sep 07 12:59:43.361114 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:43.361072    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj8gw" podUID="b68768bd-84ba-4756-834a-ad023bd05cd3"
Sep 07 12:59:45.361303 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:45.360876    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgv8s"
Sep 07 12:59:45.361303 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:45.360998    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 12:59:45.361303 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:45.361093    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjggc" podUID="a5d02c03-a753-4457-ab6a-99c8285ca9aa"
Sep 07 12:59:45.361303 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:45.361001    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgv8s" podUID="87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1"
Sep 07 12:59:45.361303 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:45.360876    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj8gw"
Sep 07 12:59:45.361303 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:45.361176    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj8gw" podUID="b68768bd-84ba-4756-834a-ad023bd05cd3"
Sep 07 12:59:47.360371 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:47.360327    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgv8s"
Sep 07 12:59:47.360371 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:47.360364    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 12:59:47.360840 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:47.360327    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj8gw"
Sep 07 12:59:47.360840 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:47.360442    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgv8s" podUID="87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1"
Sep 07 12:59:47.360840 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:47.360507    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjggc" podUID="a5d02c03-a753-4457-ab6a-99c8285ca9aa"
Sep 07 12:59:47.360840 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:47.360586    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj8gw" podUID="b68768bd-84ba-4756-834a-ad023bd05cd3"
Sep 07 12:59:49.360135 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:49.360105    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgv8s"
Sep 07 12:59:49.360135 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:49.360133    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj8gw"
Sep 07 12:59:49.360648 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:49.360105    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 12:59:49.360648 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:49.360275    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgv8s" podUID="87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1"
Sep 07 12:59:49.360648 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:49.360409    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjggc" podUID="a5d02c03-a753-4457-ab6a-99c8285ca9aa"
Sep 07 12:59:49.360648 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:49.360513    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj8gw" podUID="b68768bd-84ba-4756-834a-ad023bd05cd3"
Sep 07 12:59:51.038031 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:51.038001    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b68768bd-84ba-4756-834a-ad023bd05cd3-metrics-certs\") pod \"network-metrics-daemon-jj8gw\" (UID: \"b68768bd-84ba-4756-834a-ad023bd05cd3\") " pod="openshift-multus/network-metrics-daemon-jj8gw"
Sep 07 12:59:51.038484 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:51.038121    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 12:59:51.038484 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:51.038179    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b68768bd-84ba-4756-834a-ad023bd05cd3-metrics-certs podName:b68768bd-84ba-4756-834a-ad023bd05cd3 nodeName:}" failed. No retries permitted until 2026-09-07 13:00:07.038164267 +0000 UTC m=+34.095045905 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b68768bd-84ba-4756-834a-ad023bd05cd3-metrics-certs") pod "network-metrics-daemon-jj8gw" (UID: "b68768bd-84ba-4756-834a-ad023bd05cd3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 12:59:51.138315 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:51.138280    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nfq4\" (UniqueName: \"kubernetes.io/projected/87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1-kube-api-access-8nfq4\") pod \"network-check-target-fgv8s\" (UID: \"87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1\") " pod="openshift-network-diagnostics/network-check-target-fgv8s"
Sep 07 12:59:51.138481 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:51.138342    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5d02c03-a753-4457-ab6a-99c8285ca9aa-original-pull-secret\") pod \"global-pull-secret-syncer-sjggc\" (UID: \"a5d02c03-a753-4457-ab6a-99c8285ca9aa\") " pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 12:59:51.138481 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:51.138448    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 12:59:51.138481 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:51.138466    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 12:59:51.138604 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:51.138490    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 12:59:51.138604 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:51.138504    2576 projected.go:196] Error preparing data for projected volume kube-api-access-8nfq4 for pod openshift-network-diagnostics/network-check-target-fgv8s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 12:59:51.138604 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:51.138505    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5d02c03-a753-4457-ab6a-99c8285ca9aa-original-pull-secret podName:a5d02c03-a753-4457-ab6a-99c8285ca9aa nodeName:}" failed. No retries permitted until 2026-09-07 13:00:07.138490386 +0000 UTC m=+34.195372043 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5d02c03-a753-4457-ab6a-99c8285ca9aa-original-pull-secret") pod "global-pull-secret-syncer-sjggc" (UID: "a5d02c03-a753-4457-ab6a-99c8285ca9aa") : object "kube-system"/"original-pull-secret" not registered
Sep 07 12:59:51.138604 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:51.138565    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1-kube-api-access-8nfq4 podName:87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1 nodeName:}" failed. No retries permitted until 2026-09-07 13:00:07.13854973 +0000 UTC m=+34.195431369 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8nfq4" (UniqueName: "kubernetes.io/projected/87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1-kube-api-access-8nfq4") pod "network-check-target-fgv8s" (UID: "87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 12:59:51.360303 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:51.360224    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 12:59:51.360303 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:51.360266    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgv8s"
Sep 07 12:59:51.360513 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:51.360224    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj8gw"
Sep 07 12:59:51.360513 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:51.360345    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjggc" podUID="a5d02c03-a753-4457-ab6a-99c8285ca9aa"
Sep 07 12:59:51.360513 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:51.360443    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj8gw" podUID="b68768bd-84ba-4756-834a-ad023bd05cd3"
Sep 07 12:59:51.360666 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:51.360514    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgv8s" podUID="87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1"
Sep 07 12:59:53.361068 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:53.361042    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj8gw"
Sep 07 12:59:53.361493 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:53.361144    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj8gw" podUID="b68768bd-84ba-4756-834a-ad023bd05cd3"
Sep 07 12:59:53.361493 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:53.361236    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgv8s"
Sep 07 12:59:53.361493 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:53.361360    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgv8s" podUID="87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1"
Sep 07 12:59:53.361493 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:53.361368    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 12:59:53.361493 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:53.361455    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjggc" podUID="a5d02c03-a753-4457-ab6a-99c8285ca9aa"
Sep 07 12:59:55.360995 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:55.360783    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 12:59:55.361665 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:55.360780    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgv8s"
Sep 07 12:59:55.361665 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:55.361051    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjggc" podUID="a5d02c03-a753-4457-ab6a-99c8285ca9aa"
Sep 07 12:59:55.361665 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:55.361083    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgv8s" podUID="87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1"
Sep 07 12:59:55.361665 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:55.360824    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj8gw"
Sep 07 12:59:55.361665 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:55.361152    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj8gw" podUID="b68768bd-84ba-4756-834a-ad023bd05cd3"
Sep 07 12:59:55.459701 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:55.457460    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lxl7v" event={"ID":"7d725314-9d8e-480e-b7c2-01feec6b12e3","Type":"ContainerStarted","Data":"2cb14af2fbc519a7ab7de4dc3ba043b7db5180ae768dc9e85b8275f06ea2fdf5"}
Sep 07 12:59:55.461830 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:55.461801    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xbnd" event={"ID":"235bfdd2-c2a1-498a-9f3e-168ac70fd85b","Type":"ContainerStarted","Data":"9d61052d49cfa396a9ccf4cb9d0b69a720b57d997884f80122de115b03191b03"}
Sep 07 12:59:55.463294 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:55.463260    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-75jvc" event={"ID":"a81301be-0f84-4fbb-a496-08f21fe21ad7","Type":"ContainerStarted","Data":"b8378a4bd120362c5d72e1b45273671ad8c88e443f1fd857f79c4e03b042c885"}
Sep 07 12:59:55.464628 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:55.464609    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ptb8x" event={"ID":"29d319db-0b73-45bc-ae4f-d98e87c21725","Type":"ContainerStarted","Data":"26052fa983c84c268fa5e375c07df3a03f0dd33536e81a4c296c97dc85bbd2b8"}
Sep 07 12:59:55.466807 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:55.466780    2576 generic.go:356] "Generic (PLEG): container finished" podID="c0d7e447-233a-4a4c-8723-7c9a59646086" containerID="7ef196a230dca1405de99695844180ec670a7ac39e19a42ff02f10416cadb899" exitCode=0
Sep 07 12:59:55.466899 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:55.466854    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-46pjh" event={"ID":"c0d7e447-233a-4a4c-8723-7c9a59646086","Type":"ContainerDied","Data":"7ef196a230dca1405de99695844180ec670a7ac39e19a42ff02f10416cadb899"}
Sep 07 12:59:55.470137 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:55.470119    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp" event={"ID":"c3bd986d-bcc3-455e-a67e-6eb321778808","Type":"ContainerStarted","Data":"534a302263725a1e1126e70d3e6f2e867a72a1fc444ef7cd6111d34fd4e5d7af"}
Sep 07 12:59:55.470230 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:55.470188    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp" event={"ID":"c3bd986d-bcc3-455e-a67e-6eb321778808","Type":"ContainerStarted","Data":"067df16b643231e7307f7b7bdb39a6b520f0b282adbfb66c58e2c4944ee8d445"}
Sep 07 12:59:55.470290 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:55.470242    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp" event={"ID":"c3bd986d-bcc3-455e-a67e-6eb321778808","Type":"ContainerStarted","Data":"060ea2b1d2660b3ac7e09f4f693c0089e462306e843fcf611043e5b9575796ab"}
Sep 07 12:59:55.470348 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:55.470293    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp" event={"ID":"c3bd986d-bcc3-455e-a67e-6eb321778808","Type":"ContainerStarted","Data":"c28979b38d38fba878772dfe0596a027a364d20bfb35dd9ef58fb5ef041c69fd"}
Sep 07 12:59:55.470348 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:55.470342    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp" event={"ID":"c3bd986d-bcc3-455e-a67e-6eb321778808","Type":"ContainerStarted","Data":"4760edadbc9351e5363e4e7becd0f7ebeb02a3f630e3be58da951b001fdcc499"}
Sep 07 12:59:55.470446 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:55.470390    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp" event={"ID":"c3bd986d-bcc3-455e-a67e-6eb321778808","Type":"ContainerStarted","Data":"fd5475b935b3240c9574587e035ba1bd69034fea12001db8d7a2daeea45addce"}
Sep 07 12:59:55.471462 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:55.471439    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wwf4n" event={"ID":"c42a485d-29e3-41f3-aa5e-d1100b1b0c54","Type":"ContainerStarted","Data":"3e9457358260c3e8af5411d25ea81f30f24367b5bf02409a00a269afda6ff0e3"}
Sep 07 12:59:55.472830 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:55.472812    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-78vt9" event={"ID":"c5179ef2-d701-44ec-8758-673214b5efde","Type":"ContainerStarted","Data":"19c02d4df900c9e75a12363a8b63176566813b02668f5001b7dfbdf7b62a6d0d"}
Sep 07 12:59:55.478692 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:55.478658    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lxl7v" podStartSLOduration=4.140791956 podStartE2EDuration="22.47864716s" totalImagesPullingTime="18.337855204s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:59:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:59:55.47837164 +0000 UTC m=+22.535253299" watchObservedRunningTime="2026-09-07 12:59:55.47864716 +0000 UTC m=+22.535528868"
Sep 07 12:59:55.503166 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:55.503132    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-75jvc" podStartSLOduration=4.212412558 podStartE2EDuration="22.50312067s" totalImagesPullingTime="18.290708112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:59:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:59:55.501628726 +0000 UTC m=+22.558510384" watchObservedRunningTime="2026-09-07 12:59:55.50312067 +0000 UTC m=+22.560002329"
Sep 07 12:59:55.530382 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:55.530342    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-78vt9" podStartSLOduration=11.766250985 podStartE2EDuration="22.530327451s" totalImagesPullingTime="10.764076466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:59:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:59:55.530051823 +0000 UTC m=+22.586933482" watchObservedRunningTime="2026-09-07 12:59:55.530327451 +0000 UTC m=+22.587209111"
Sep 07 12:59:55.567442 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:55.567415    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 12:59:55.601584 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:55.601391    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ptb8x" podStartSLOduration=4.285120804 podStartE2EDuration="22.6013785s" totalImagesPullingTime="18.316257696s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:59:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:59:55.580531862 +0000 UTC m=+22.637413522" watchObservedRunningTime="2026-09-07 12:59:55.6013785 +0000 UTC m=+22.658260158"
Sep 07 12:59:55.665195 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:55.665132    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 12:59:55.760692 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:55.760660    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 12:59:56.251441 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:56.251407    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 07 12:59:56.361232 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:56.361073    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-07T12:59:56.25142392Z","UUID":"c3d4d0e0-f30b-4d86-9982-f031ab0ee30c","Handler":null,"Name":"","Endpoint":""}
Sep 07 12:59:56.362605 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:56.362580    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 07 12:59:56.362724 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:56.362613    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 07 12:59:56.477194 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:56.477113    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xbnd" event={"ID":"235bfdd2-c2a1-498a-9f3e-168ac70fd85b","Type":"ContainerStarted","Data":"5fec97c0ec96a4edc86a9159a9ade7a2b8d859854168ec9bf0ee58cd9b6e0f2a"}
Sep 07 12:59:56.479149 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:56.479123    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zwmcp" event={"ID":"71fe3fc3-2e5c-40a7-9b58-150e96bb5b7c","Type":"ContainerStarted","Data":"a5744afa22c994092f30a95749031e7d6f11b97f28103bb285d4fab8adbd2ab2"}
Sep 07 12:59:56.499543 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:56.499486    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wwf4n" podStartSLOduration=5.208749575 podStartE2EDuration="23.499466901s" totalImagesPullingTime="18.290717326s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:59:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:59:55.60167043 +0000 UTC m=+22.658552085" watchObservedRunningTime="2026-09-07 12:59:56.499466901 +0000 UTC m=+23.556348564"
Sep 07 12:59:56.629032 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:56.629000    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 12:59:56.735500 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:56.735393    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 12:59:57.360964 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:57.360931    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgv8s"
Sep 07 12:59:57.361143 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:57.361063    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgv8s" podUID="87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1"
Sep 07 12:59:57.361572 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:57.361553    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 12:59:57.361977 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:57.361685    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjggc" podUID="a5d02c03-a753-4457-ab6a-99c8285ca9aa"
Sep 07 12:59:57.361977 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:57.361782    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj8gw"
Sep 07 12:59:57.361977 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:57.361870    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj8gw" podUID="b68768bd-84ba-4756-834a-ad023bd05cd3"
Sep 07 12:59:57.506583 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:57.506527    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 12:59:57.586644 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:57.586612    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-78vt9"
Sep 07 12:59:57.587265 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:57.587238    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-78vt9"
Sep 07 12:59:57.612227 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:57.612152    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zwmcp" podStartSLOduration=6.289834436 podStartE2EDuration="24.612137647s" totalImagesPullingTime="18.322303211s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:59:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 12:59:56.499134901 +0000 UTC m=+23.556016561" watchObservedRunningTime="2026-09-07 12:59:57.612137647 +0000 UTC m=+24.669019306"
Sep 07 12:59:57.614846 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:57.614792    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 12:59:58.487736 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:58.487704    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp" event={"ID":"c3bd986d-bcc3-455e-a67e-6eb321778808","Type":"ContainerStarted","Data":"c70ad80e68db6effb784edc3ad4f8422376180b3dde42c64b29d1c16dc69eb02"}
Sep 07 12:59:58.488221 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:58.487953    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-78vt9"
Sep 07 12:59:58.488507 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:58.488489    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-78vt9"
Sep 07 12:59:58.740923 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:58.740843    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 12:59:59.360779 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:59.360747    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 12:59:59.360957 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:59.360751    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj8gw"
Sep 07 12:59:59.360957 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:59.360894    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjggc" podUID="a5d02c03-a753-4457-ab6a-99c8285ca9aa"
Sep 07 12:59:59.360957 ip-10-0-142-74 kubenswrapper[2576]: I0907 12:59:59.360751    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgv8s"
Sep 07 12:59:59.361117 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:59.360962    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj8gw" podUID="b68768bd-84ba-4756-834a-ad023bd05cd3"
Sep 07 12:59:59.361117 ip-10-0-142-74 kubenswrapper[2576]: E0907 12:59:59.361006    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgv8s" podUID="87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1"
Sep 07 13:00:00.211860 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:00.211585    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:00.329125 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:00.329047    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:00.428347 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:00.428315    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:00.493909 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:00.493881    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xbnd" event={"ID":"235bfdd2-c2a1-498a-9f3e-168ac70fd85b","Type":"ContainerStarted","Data":"f0ff90036d77460490de5f2b9c45f93dfb1ecdd00795bf2297248994fe9bc1e3"}
Sep 07 13:00:00.495719 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:00.495696    2576 generic.go:356] "Generic (PLEG): container finished" podID="c0d7e447-233a-4a4c-8723-7c9a59646086" containerID="1a41daf8a41bb770a72886c60823dd766a57e2f5c88a75d08f391844c0b975ba" exitCode=0
Sep 07 13:00:00.495826 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:00.495785    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-46pjh" event={"ID":"c0d7e447-233a-4a4c-8723-7c9a59646086","Type":"ContainerDied","Data":"1a41daf8a41bb770a72886c60823dd766a57e2f5c88a75d08f391844c0b975ba"}
Sep 07 13:00:00.499574 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:00.499547    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp" event={"ID":"c3bd986d-bcc3-455e-a67e-6eb321778808","Type":"ContainerStarted","Data":"c50b9834582c5c899558b885d03fa29286b96740429612d0dd84f9804eb1a09b"}
Sep 07 13:00:00.499807 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:00.499790    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 13:00:00.499878 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:00.499850    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 13:00:00.499935 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:00.499895    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 13:00:00.514986 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:00.514966    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 13:00:00.515072 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:00.515062    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 13:00:00.519999 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:00.519963    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7xbnd" podStartSLOduration=4.122816064 podStartE2EDuration="27.519949813s" totalImagesPullingTime="23.397133749s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:59:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:00:00.519584516 +0000 UTC m=+27.576466176" watchObservedRunningTime="2026-09-07 13:00:00.519949813 +0000 UTC m=+27.576831472"
Sep 07 13:00:00.579658 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:00.579576    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp" podStartSLOduration=9.18414738 podStartE2EDuration="27.579562677s" totalImagesPullingTime="18.395415297s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:59:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:00:00.553940702 +0000 UTC m=+27.610822360" watchObservedRunningTime="2026-09-07 13:00:00.579562677 +0000 UTC m=+27.636444335"
Sep 07 13:00:01.285296 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:01.285266    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:01.362327 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:01.361647    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj8gw"
Sep 07 13:00:01.362327 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:01.361792    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj8gw" podUID="b68768bd-84ba-4756-834a-ad023bd05cd3"
Sep 07 13:00:01.362327 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:01.362101    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgv8s"
Sep 07 13:00:01.362327 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:01.362164    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgv8s" podUID="87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1"
Sep 07 13:00:01.362327 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:01.362204    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 13:00:01.362327 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:01.362248    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjggc" podUID="a5d02c03-a753-4457-ab6a-99c8285ca9aa"
Sep 07 13:00:01.450935 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:01.450893    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:02.145062 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:02.144834    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fgv8s"]
Sep 07 13:00:02.145199 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:02.145110    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgv8s"
Sep 07 13:00:02.145239 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:02.145200    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgv8s" podUID="87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1"
Sep 07 13:00:02.148864 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:02.148837    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jj8gw"]
Sep 07 13:00:02.148953 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:02.148930    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj8gw"
Sep 07 13:00:02.149038 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:02.149022    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj8gw" podUID="b68768bd-84ba-4756-834a-ad023bd05cd3"
Sep 07 13:00:02.153939 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:02.153917    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sjggc"]
Sep 07 13:00:02.154023 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:02.154006    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 13:00:02.154095 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:02.154076    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjggc" podUID="a5d02c03-a753-4457-ab6a-99c8285ca9aa"
Sep 07 13:00:02.506139 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:02.506080    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-46pjh" event={"ID":"c0d7e447-233a-4a4c-8723-7c9a59646086","Type":"ContainerStarted","Data":"539d684805ad192dedd1e32ed54859426ba23728290db6214725c04d0d678327"}
Sep 07 13:00:03.509971 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:03.509938    2576 generic.go:356] "Generic (PLEG): container finished" podID="c0d7e447-233a-4a4c-8723-7c9a59646086" containerID="539d684805ad192dedd1e32ed54859426ba23728290db6214725c04d0d678327" exitCode=0
Sep 07 13:00:03.510323 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:03.509982    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-46pjh" event={"ID":"c0d7e447-233a-4a4c-8723-7c9a59646086","Type":"ContainerDied","Data":"539d684805ad192dedd1e32ed54859426ba23728290db6214725c04d0d678327"}
Sep 07 13:00:04.360674 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:04.360613    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgv8s"
Sep 07 13:00:04.360674 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:04.360654    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 13:00:04.360901 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:04.360654    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj8gw"
Sep 07 13:00:04.360901 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:04.360735    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgv8s" podUID="87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1"
Sep 07 13:00:04.360901 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:04.360890    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj8gw" podUID="b68768bd-84ba-4756-834a-ad023bd05cd3"
Sep 07 13:00:04.361069 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:04.360988    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjggc" podUID="a5d02c03-a753-4457-ab6a-99c8285ca9aa"
Sep 07 13:00:05.516404 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:05.516369    2576 generic.go:356] "Generic (PLEG): container finished" podID="c0d7e447-233a-4a4c-8723-7c9a59646086" containerID="5aa852a79d52ad03856024d14326fe8f95847ef601856e0d00d4d628c1ae999a" exitCode=0
Sep 07 13:00:05.516848 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:05.516430    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-46pjh" event={"ID":"c0d7e447-233a-4a4c-8723-7c9a59646086","Type":"ContainerDied","Data":"5aa852a79d52ad03856024d14326fe8f95847ef601856e0d00d4d628c1ae999a"}
Sep 07 13:00:06.361008 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:06.360964    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgv8s"
Sep 07 13:00:06.361208 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:06.361094    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fgv8s" podUID="87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1"
Sep 07 13:00:06.361536 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:06.361512    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 13:00:06.361661 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:06.361622    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sjggc" podUID="a5d02c03-a753-4457-ab6a-99c8285ca9aa"
Sep 07 13:00:06.361729 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:06.361696    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj8gw"
Sep 07 13:00:06.361829 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:06.361810    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jj8gw" podUID="b68768bd-84ba-4756-834a-ad023bd05cd3"
Sep 07 13:00:07.055034 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:07.054811    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b68768bd-84ba-4756-834a-ad023bd05cd3-metrics-certs\") pod \"network-metrics-daemon-jj8gw\" (UID: \"b68768bd-84ba-4756-834a-ad023bd05cd3\") " pod="openshift-multus/network-metrics-daemon-jj8gw"
Sep 07 13:00:07.055467 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:07.054989    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 13:00:07.055467 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:07.055102    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b68768bd-84ba-4756-834a-ad023bd05cd3-metrics-certs podName:b68768bd-84ba-4756-834a-ad023bd05cd3 nodeName:}" failed. No retries permitted until 2026-09-07 13:00:39.055085578 +0000 UTC m=+66.111967214 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b68768bd-84ba-4756-834a-ad023bd05cd3-metrics-certs") pod "network-metrics-daemon-jj8gw" (UID: "b68768bd-84ba-4756-834a-ad023bd05cd3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 07 13:00:07.156254 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:07.156221    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5d02c03-a753-4457-ab6a-99c8285ca9aa-original-pull-secret\") pod \"global-pull-secret-syncer-sjggc\" (UID: \"a5d02c03-a753-4457-ab6a-99c8285ca9aa\") " pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 13:00:07.156434 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:07.156292    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nfq4\" (UniqueName: \"kubernetes.io/projected/87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1-kube-api-access-8nfq4\") pod \"network-check-target-fgv8s\" (UID: \"87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1\") " pod="openshift-network-diagnostics/network-check-target-fgv8s"
Sep 07 13:00:07.156434 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:07.156395    2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 07 13:00:07.156434 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:07.156406    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 07 13:00:07.156434 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:07.156428    2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 07 13:00:07.156618 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:07.156440    2576 projected.go:196] Error preparing data for projected volume kube-api-access-8nfq4 for pod openshift-network-diagnostics/network-check-target-fgv8s: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 13:00:07.156618 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:07.156470    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5d02c03-a753-4457-ab6a-99c8285ca9aa-original-pull-secret podName:a5d02c03-a753-4457-ab6a-99c8285ca9aa nodeName:}" failed. No retries permitted until 2026-09-07 13:00:39.156451709 +0000 UTC m=+66.213333362 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a5d02c03-a753-4457-ab6a-99c8285ca9aa-original-pull-secret") pod "global-pull-secret-syncer-sjggc" (UID: "a5d02c03-a753-4457-ab6a-99c8285ca9aa") : object "kube-system"/"original-pull-secret" not registered
Sep 07 13:00:07.156618 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:07.156489    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1-kube-api-access-8nfq4 podName:87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1 nodeName:}" failed. No retries permitted until 2026-09-07 13:00:39.156479519 +0000 UTC m=+66.213361156 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8nfq4" (UniqueName: "kubernetes.io/projected/87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1-kube-api-access-8nfq4") pod "network-check-target-fgv8s" (UID: "87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 07 13:00:08.308532 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.308496    2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-142-74.ec2.internal" event="NodeReady"
Sep 07 13:00:08.309000 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.308662    2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 07 13:00:08.360538 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.360507    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj8gw"
Sep 07 13:00:08.360707 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.360623    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgv8s"
Sep 07 13:00:08.360707 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.360663    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 13:00:08.364007 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.363973    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 07 13:00:08.364160 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.364131    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 07 13:00:08.364279 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.364253    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8d5qt\""
Sep 07 13:00:08.364790 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.364730    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5v9xw\""
Sep 07 13:00:08.364874 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.364794    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 07 13:00:08.365013 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.364999    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 07 13:00:08.366989 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.366969    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hpwk6"]
Sep 07 13:00:08.372260 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.372006    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hpwk6"
Sep 07 13:00:08.373660 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.373639    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-m5qjt"]
Sep 07 13:00:08.374592 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.374572    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 07 13:00:08.374848 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.374828    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 07 13:00:08.374945 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.374912    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rqgx2\""
Sep 07 13:00:08.376959 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.376940    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m5qjt"
Sep 07 13:00:08.379719 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.379700    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 07 13:00:08.379838 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.379809    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 07 13:00:08.379902 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.379864    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 07 13:00:08.380750 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.380420    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n5q6z\""
Sep 07 13:00:08.383539 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.383517    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m5qjt"]
Sep 07 13:00:08.389238 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.389218    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hpwk6"]
Sep 07 13:00:08.464931 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.464855    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14038337-346f-4a5e-96bc-d4004f778bc1-cert\") pod \"ingress-canary-m5qjt\" (UID: \"14038337-346f-4a5e-96bc-d4004f778bc1\") " pod="openshift-ingress-canary/ingress-canary-m5qjt"
Sep 07 13:00:08.464931 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.464896    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmrs9\" (UniqueName: \"kubernetes.io/projected/e0ec59be-b6b6-47de-8b39-41cd853d72ac-kube-api-access-wmrs9\") pod \"dns-default-hpwk6\" (UID: \"e0ec59be-b6b6-47de-8b39-41cd853d72ac\") " pod="openshift-dns/dns-default-hpwk6"
Sep 07 13:00:08.465128 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.465015    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl8k7\" (UniqueName: \"kubernetes.io/projected/14038337-346f-4a5e-96bc-d4004f778bc1-kube-api-access-rl8k7\") pod \"ingress-canary-m5qjt\" (UID: \"14038337-346f-4a5e-96bc-d4004f778bc1\") " pod="openshift-ingress-canary/ingress-canary-m5qjt"
Sep 07 13:00:08.465128 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.465052    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0ec59be-b6b6-47de-8b39-41cd853d72ac-metrics-tls\") pod \"dns-default-hpwk6\" (UID: \"e0ec59be-b6b6-47de-8b39-41cd853d72ac\") " pod="openshift-dns/dns-default-hpwk6"
Sep 07 13:00:08.465128 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.465076    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e0ec59be-b6b6-47de-8b39-41cd853d72ac-config-volume\") pod \"dns-default-hpwk6\" (UID: \"e0ec59be-b6b6-47de-8b39-41cd853d72ac\") " pod="openshift-dns/dns-default-hpwk6"
Sep 07 13:00:08.465128 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.465114    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0ec59be-b6b6-47de-8b39-41cd853d72ac-tmp-dir\") pod \"dns-default-hpwk6\" (UID: \"e0ec59be-b6b6-47de-8b39-41cd853d72ac\") " pod="openshift-dns/dns-default-hpwk6"
Sep 07 13:00:08.566414 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.566384    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0ec59be-b6b6-47de-8b39-41cd853d72ac-tmp-dir\") pod \"dns-default-hpwk6\" (UID: \"e0ec59be-b6b6-47de-8b39-41cd853d72ac\") " pod="openshift-dns/dns-default-hpwk6"
Sep 07 13:00:08.566628 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.566436    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14038337-346f-4a5e-96bc-d4004f778bc1-cert\") pod \"ingress-canary-m5qjt\" (UID: \"14038337-346f-4a5e-96bc-d4004f778bc1\") " pod="openshift-ingress-canary/ingress-canary-m5qjt"
Sep 07 13:00:08.566628 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.566479    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmrs9\" (UniqueName: \"kubernetes.io/projected/e0ec59be-b6b6-47de-8b39-41cd853d72ac-kube-api-access-wmrs9\") pod \"dns-default-hpwk6\" (UID: \"e0ec59be-b6b6-47de-8b39-41cd853d72ac\") " pod="openshift-dns/dns-default-hpwk6"
Sep 07 13:00:08.566628 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.566503    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl8k7\" (UniqueName: \"kubernetes.io/projected/14038337-346f-4a5e-96bc-d4004f778bc1-kube-api-access-rl8k7\") pod \"ingress-canary-m5qjt\" (UID: \"14038337-346f-4a5e-96bc-d4004f778bc1\") " pod="openshift-ingress-canary/ingress-canary-m5qjt"
Sep 07 13:00:08.566628 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.566536    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0ec59be-b6b6-47de-8b39-41cd853d72ac-metrics-tls\") pod \"dns-default-hpwk6\" (UID: \"e0ec59be-b6b6-47de-8b39-41cd853d72ac\") " pod="openshift-dns/dns-default-hpwk6"
Sep 07 13:00:08.566628 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.566568    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e0ec59be-b6b6-47de-8b39-41cd853d72ac-config-volume\") pod \"dns-default-hpwk6\" (UID: \"e0ec59be-b6b6-47de-8b39-41cd853d72ac\") " pod="openshift-dns/dns-default-hpwk6"
Sep 07 13:00:08.566917 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.566753    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0ec59be-b6b6-47de-8b39-41cd853d72ac-tmp-dir\") pod \"dns-default-hpwk6\" (UID: \"e0ec59be-b6b6-47de-8b39-41cd853d72ac\") " pod="openshift-dns/dns-default-hpwk6"
Sep 07 13:00:08.566917 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:08.566902    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 13:00:08.567022 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:08.566952    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0ec59be-b6b6-47de-8b39-41cd853d72ac-metrics-tls podName:e0ec59be-b6b6-47de-8b39-41cd853d72ac nodeName:}" failed. No retries permitted until 2026-09-07 13:00:09.066938837 +0000 UTC m=+36.123820477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e0ec59be-b6b6-47de-8b39-41cd853d72ac-metrics-tls") pod "dns-default-hpwk6" (UID: "e0ec59be-b6b6-47de-8b39-41cd853d72ac") : secret "dns-default-metrics-tls" not found
Sep 07 13:00:08.567150 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.567130    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e0ec59be-b6b6-47de-8b39-41cd853d72ac-config-volume\") pod \"dns-default-hpwk6\" (UID: \"e0ec59be-b6b6-47de-8b39-41cd853d72ac\") " pod="openshift-dns/dns-default-hpwk6"
Sep 07 13:00:08.570960 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.570935    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/14038337-346f-4a5e-96bc-d4004f778bc1-cert\") pod \"ingress-canary-m5qjt\" (UID: \"14038337-346f-4a5e-96bc-d4004f778bc1\") " pod="openshift-ingress-canary/ingress-canary-m5qjt"
Sep 07 13:00:08.575519 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.575491    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmrs9\" (UniqueName: \"kubernetes.io/projected/e0ec59be-b6b6-47de-8b39-41cd853d72ac-kube-api-access-wmrs9\") pod \"dns-default-hpwk6\" (UID: \"e0ec59be-b6b6-47de-8b39-41cd853d72ac\") " pod="openshift-dns/dns-default-hpwk6"
Sep 07 13:00:08.575941 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.575921    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl8k7\" (UniqueName: \"kubernetes.io/projected/14038337-346f-4a5e-96bc-d4004f778bc1-kube-api-access-rl8k7\") pod \"ingress-canary-m5qjt\" (UID: \"14038337-346f-4a5e-96bc-d4004f778bc1\") " pod="openshift-ingress-canary/ingress-canary-m5qjt"
Sep 07 13:00:08.620832 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.620800    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:08.687990 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.687957    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:08.703029 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:08.702999    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m5qjt"
Sep 07 13:00:09.070695 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:09.070655    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0ec59be-b6b6-47de-8b39-41cd853d72ac-metrics-tls\") pod \"dns-default-hpwk6\" (UID: \"e0ec59be-b6b6-47de-8b39-41cd853d72ac\") " pod="openshift-dns/dns-default-hpwk6"
Sep 07 13:00:09.070906 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:09.070841    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 13:00:09.070967 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:09.070922    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0ec59be-b6b6-47de-8b39-41cd853d72ac-metrics-tls podName:e0ec59be-b6b6-47de-8b39-41cd853d72ac nodeName:}" failed. No retries permitted until 2026-09-07 13:00:10.070900632 +0000 UTC m=+37.127782268 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e0ec59be-b6b6-47de-8b39-41cd853d72ac-metrics-tls") pod "dns-default-hpwk6" (UID: "e0ec59be-b6b6-47de-8b39-41cd853d72ac") : secret "dns-default-metrics-tls" not found
Sep 07 13:00:09.903538 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:09.903502    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m5qjt"]
Sep 07 13:00:09.961890 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:00:09.961639    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14038337_346f_4a5e_96bc_d4004f778bc1.slice/crio-de32af6c2e3dc572ef52a0ccbe98125d83a0df1bb79ce88e9a41f461353ae905 WatchSource:0}: Error finding container de32af6c2e3dc572ef52a0ccbe98125d83a0df1bb79ce88e9a41f461353ae905: Status 404 returned error can't find the container with id de32af6c2e3dc572ef52a0ccbe98125d83a0df1bb79ce88e9a41f461353ae905
Sep 07 13:00:10.077872 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:10.077832    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0ec59be-b6b6-47de-8b39-41cd853d72ac-metrics-tls\") pod \"dns-default-hpwk6\" (UID: \"e0ec59be-b6b6-47de-8b39-41cd853d72ac\") " pod="openshift-dns/dns-default-hpwk6"
Sep 07 13:00:10.078011 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:10.077992    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 13:00:10.078065 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:10.078056    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0ec59be-b6b6-47de-8b39-41cd853d72ac-metrics-tls podName:e0ec59be-b6b6-47de-8b39-41cd853d72ac nodeName:}" failed. No retries permitted until 2026-09-07 13:00:12.078041129 +0000 UTC m=+39.134922766 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e0ec59be-b6b6-47de-8b39-41cd853d72ac-metrics-tls") pod "dns-default-hpwk6" (UID: "e0ec59be-b6b6-47de-8b39-41cd853d72ac") : secret "dns-default-metrics-tls" not found
Sep 07 13:00:10.148119 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:10.148052    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:10.530511 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:10.530430    2576 generic.go:356] "Generic (PLEG): container finished" podID="c0d7e447-233a-4a4c-8723-7c9a59646086" containerID="e784e52c8282159971c79cc5cf1584caf12ac0cfb65b5a05f98c990af568244f" exitCode=0
Sep 07 13:00:10.530647 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:10.530517    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-46pjh" event={"ID":"c0d7e447-233a-4a4c-8723-7c9a59646086","Type":"ContainerDied","Data":"e784e52c8282159971c79cc5cf1584caf12ac0cfb65b5a05f98c990af568244f"}
Sep 07 13:00:10.531690 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:10.531668    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m5qjt" event={"ID":"14038337-346f-4a5e-96bc-d4004f778bc1","Type":"ContainerStarted","Data":"de32af6c2e3dc572ef52a0ccbe98125d83a0df1bb79ce88e9a41f461353ae905"}
Sep 07 13:00:11.538515 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:11.538473    2576 generic.go:356] "Generic (PLEG): container finished" podID="c0d7e447-233a-4a4c-8723-7c9a59646086" containerID="55c84460e5d32d5f49d407a98b5a05f214828986e0c01fa134db977bd3e903b9" exitCode=0
Sep 07 13:00:11.538912 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:11.538528    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-46pjh" event={"ID":"c0d7e447-233a-4a4c-8723-7c9a59646086","Type":"ContainerDied","Data":"55c84460e5d32d5f49d407a98b5a05f214828986e0c01fa134db977bd3e903b9"}
Sep 07 13:00:12.094572 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:12.094536    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0ec59be-b6b6-47de-8b39-41cd853d72ac-metrics-tls\") pod \"dns-default-hpwk6\" (UID: \"e0ec59be-b6b6-47de-8b39-41cd853d72ac\") " pod="openshift-dns/dns-default-hpwk6"
Sep 07 13:00:12.094738 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:12.094687    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 13:00:12.094803 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:12.094753    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0ec59be-b6b6-47de-8b39-41cd853d72ac-metrics-tls podName:e0ec59be-b6b6-47de-8b39-41cd853d72ac nodeName:}" failed. No retries permitted until 2026-09-07 13:00:16.094737628 +0000 UTC m=+43.151619278 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e0ec59be-b6b6-47de-8b39-41cd853d72ac-metrics-tls") pod "dns-default-hpwk6" (UID: "e0ec59be-b6b6-47de-8b39-41cd853d72ac") : secret "dns-default-metrics-tls" not found
Sep 07 13:00:12.545596 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:12.545558    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-46pjh" event={"ID":"c0d7e447-233a-4a4c-8723-7c9a59646086","Type":"ContainerStarted","Data":"9e76788bd381a7e78fa0b9e4cbc5664f9c6e0b0b172a308be9c0c83951ca59a5"}
Sep 07 13:00:12.571743 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:12.571677    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-46pjh" podStartSLOduration=9.485420268 podStartE2EDuration="39.571659959s" totalImagesPullingTime="30.086239691s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:59:33 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:00:12.57068852 +0000 UTC m=+39.627570181" watchObservedRunningTime="2026-09-07 13:00:12.571659959 +0000 UTC m=+39.628541628"
Sep 07 13:00:12.700419 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:12.700382    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:12.801973 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:12.801884    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:13.121122 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:13.121038    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:13.225484 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:13.225453    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:13.379584 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:13.379546    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:13.480966 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:13.480932    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:13.551546 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:13.551490    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m5qjt" event={"ID":"14038337-346f-4a5e-96bc-d4004f778bc1","Type":"ContainerStarted","Data":"6a23854728da8020cc6d41b99432287c989764bd08f8329dbb106bb7c2a3c951"}
Sep 07 13:00:13.569255 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:13.569197    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-m5qjt" podStartSLOduration=2.19456167 podStartE2EDuration="5.569182615s" totalImagesPullingTime="3.374620945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:00:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:00:13.568136656 +0000 UTC m=+40.625018315" watchObservedRunningTime="2026-09-07 13:00:13.569182615 +0000 UTC m=+40.626064273"
Sep 07 13:00:13.857120 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:13.857094    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-nl9hf"]
Sep 07 13:00:13.878819 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:13.878787    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-nl9hf"]
Sep 07 13:00:13.878949 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:13.878859    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-nl9hf"
Sep 07 13:00:13.884642 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:13.884506    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-h24ct\""
Sep 07 13:00:13.886092 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:13.886062    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 07 13:00:13.888571 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:13.888551    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-hk2dx"]
Sep 07 13:00:13.891238 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:13.891223    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 07 13:00:13.912856 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:13.912835    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-hk2dx"
Sep 07 13:00:13.917678 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:13.917656    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 07 13:00:13.919324 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:13.919291    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-hk2dx"]
Sep 07 13:00:13.919630 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:13.919609    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 07 13:00:13.919897 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:13.919884    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-cvxk9\""
Sep 07 13:00:13.920496 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:13.920477    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 07 13:00:13.921106 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:13.921091    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 07 13:00:13.940524 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:13.940494    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 07 13:00:13.991522 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:13.991496    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-v9pd8"]
Sep 07 13:00:14.008819 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.008789    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-848fc6765d-blcdh"]
Sep 07 13:00:14.008922 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.008829    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-v9pd8"
Sep 07 13:00:14.012641 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.012619    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a2c14fb-81d2-4056-bf98-ac72b0b69aae-tmp\") pod \"insights-operator-76bcd6ccf5-hk2dx\" (UID: \"9a2c14fb-81d2-4056-bf98-ac72b0b69aae\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hk2dx"
Sep 07 13:00:14.012760 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.012664    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a2c14fb-81d2-4056-bf98-ac72b0b69aae-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-hk2dx\" (UID: \"9a2c14fb-81d2-4056-bf98-ac72b0b69aae\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hk2dx"
Sep 07 13:00:14.012760 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.012685    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnpnh\" (UniqueName: \"kubernetes.io/projected/9a2c14fb-81d2-4056-bf98-ac72b0b69aae-kube-api-access-pnpnh\") pod \"insights-operator-76bcd6ccf5-hk2dx\" (UID: \"9a2c14fb-81d2-4056-bf98-ac72b0b69aae\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hk2dx"
Sep 07 13:00:14.012760 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.012714    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c48xd\" (UniqueName: \"kubernetes.io/projected/c4eea408-8172-4e4d-bc5f-c1674c0b7169-kube-api-access-c48xd\") pod \"volume-data-source-validator-695c895bd6-nl9hf\" (UID: \"c4eea408-8172-4e4d-bc5f-c1674c0b7169\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-nl9hf"
Sep 07 13:00:14.012957 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.012796    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9a2c14fb-81d2-4056-bf98-ac72b0b69aae-snapshots\") pod \"insights-operator-76bcd6ccf5-hk2dx\" (UID: \"9a2c14fb-81d2-4056-bf98-ac72b0b69aae\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hk2dx"
Sep 07 13:00:14.012957 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.012835    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a2c14fb-81d2-4056-bf98-ac72b0b69aae-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-hk2dx\" (UID: \"9a2c14fb-81d2-4056-bf98-ac72b0b69aae\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hk2dx"
Sep 07 13:00:14.012957 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.012862    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9a2c14fb-81d2-4056-bf98-ac72b0b69aae-serving-cert\") pod \"insights-operator-76bcd6ccf5-hk2dx\" (UID: \"9a2c14fb-81d2-4056-bf98-ac72b0b69aae\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hk2dx"
Sep 07 13:00:14.022726 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.022708    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-pjqqn"]
Sep 07 13:00:14.022860 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.022846    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-848fc6765d-blcdh"
Sep 07 13:00:14.023406 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.023383    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 07 13:00:14.023534 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.023516    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 07 13:00:14.023637 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.023622    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 07 13:00:14.024167 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.024147    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-cmg5b\""
Sep 07 13:00:14.024503 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.024488    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 07 13:00:14.024860 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.024837    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 07 13:00:14.024952 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.024890    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 07 13:00:14.025316 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.025291    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 07 13:00:14.025423 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.025355    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 07 13:00:14.025529 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.025516    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9ls99\""
Sep 07 13:00:14.025663 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.025649    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 07 13:00:14.025977 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.025958    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 07 13:00:14.036570 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.036550    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 07 13:00:14.044852 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.044836    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-v9pd8"]
Sep 07 13:00:14.044933 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.044862    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-pjqqn"]
Sep 07 13:00:14.044933 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.044875    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-848fc6765d-blcdh"]
Sep 07 13:00:14.044997 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.044945    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-pjqqn"
Sep 07 13:00:14.048809 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.048789    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-qbjs6\""
Sep 07 13:00:14.114123 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.114062    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a2c14fb-81d2-4056-bf98-ac72b0b69aae-tmp\") pod \"insights-operator-76bcd6ccf5-hk2dx\" (UID: \"9a2c14fb-81d2-4056-bf98-ac72b0b69aae\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hk2dx"
Sep 07 13:00:14.114123 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.114094    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2bb2527-1a29-4b7e-b6fb-9be32693a5cd-trusted-ca\") pod \"console-operator-85b454874b-v9pd8\" (UID: \"d2bb2527-1a29-4b7e-b6fb-9be32693a5cd\") " pod="openshift-console-operator/console-operator-85b454874b-v9pd8"
Sep 07 13:00:14.114123 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.114119    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a2c14fb-81d2-4056-bf98-ac72b0b69aae-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-hk2dx\" (UID: \"9a2c14fb-81d2-4056-bf98-ac72b0b69aae\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hk2dx"
Sep 07 13:00:14.114283 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.114237    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnpnh\" (UniqueName: \"kubernetes.io/projected/9a2c14fb-81d2-4056-bf98-ac72b0b69aae-kube-api-access-pnpnh\") pod \"insights-operator-76bcd6ccf5-hk2dx\" (UID: \"9a2c14fb-81d2-4056-bf98-ac72b0b69aae\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hk2dx"
Sep 07 13:00:14.114283 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.114265    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c48xd\" (UniqueName: \"kubernetes.io/projected/c4eea408-8172-4e4d-bc5f-c1674c0b7169-kube-api-access-c48xd\") pod \"volume-data-source-validator-695c895bd6-nl9hf\" (UID: \"c4eea408-8172-4e4d-bc5f-c1674c0b7169\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-nl9hf"
Sep 07 13:00:14.114379 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.114292    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d2bb2527-1a29-4b7e-b6fb-9be32693a5cd-serving-cert\") pod \"console-operator-85b454874b-v9pd8\" (UID: \"d2bb2527-1a29-4b7e-b6fb-9be32693a5cd\") " pod="openshift-console-operator/console-operator-85b454874b-v9pd8"
Sep 07 13:00:14.114379 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.114319    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2bb2527-1a29-4b7e-b6fb-9be32693a5cd-config\") pod \"console-operator-85b454874b-v9pd8\" (UID: \"d2bb2527-1a29-4b7e-b6fb-9be32693a5cd\") " pod="openshift-console-operator/console-operator-85b454874b-v9pd8"
Sep 07 13:00:14.114379 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.114343    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmvgw\" (UniqueName: \"kubernetes.io/projected/d2bb2527-1a29-4b7e-b6fb-9be32693a5cd-kube-api-access-kmvgw\") pod \"console-operator-85b454874b-v9pd8\" (UID: \"d2bb2527-1a29-4b7e-b6fb-9be32693a5cd\") " pod="openshift-console-operator/console-operator-85b454874b-v9pd8"
Sep 07 13:00:14.114379 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.114374    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9a2c14fb-81d2-4056-bf98-ac72b0b69aae-snapshots\") pod \"insights-operator-76bcd6ccf5-hk2dx\" (UID: \"9a2c14fb-81d2-4056-bf98-ac72b0b69aae\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hk2dx"
Sep 07 13:00:14.114540 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.114412    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a2c14fb-81d2-4056-bf98-ac72b0b69aae-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-hk2dx\" (UID: \"9a2c14fb-81d2-4056-bf98-ac72b0b69aae\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hk2dx"
Sep 07 13:00:14.114540 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.114435    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9a2c14fb-81d2-4056-bf98-ac72b0b69aae-serving-cert\") pod \"insights-operator-76bcd6ccf5-hk2dx\" (UID: \"9a2c14fb-81d2-4056-bf98-ac72b0b69aae\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hk2dx"
Sep 07 13:00:14.114540 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.114512    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9a2c14fb-81d2-4056-bf98-ac72b0b69aae-tmp\") pod \"insights-operator-76bcd6ccf5-hk2dx\" (UID: \"9a2c14fb-81d2-4056-bf98-ac72b0b69aae\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hk2dx"
Sep 07 13:00:14.114804 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.114759    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a2c14fb-81d2-4056-bf98-ac72b0b69aae-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-hk2dx\" (UID: \"9a2c14fb-81d2-4056-bf98-ac72b0b69aae\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hk2dx"
Sep 07 13:00:14.114878 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.114861    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9a2c14fb-81d2-4056-bf98-ac72b0b69aae-snapshots\") pod \"insights-operator-76bcd6ccf5-hk2dx\" (UID: \"9a2c14fb-81d2-4056-bf98-ac72b0b69aae\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hk2dx"
Sep 07 13:00:14.115135 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.115112    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a2c14fb-81d2-4056-bf98-ac72b0b69aae-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-hk2dx\" (UID: \"9a2c14fb-81d2-4056-bf98-ac72b0b69aae\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hk2dx"
Sep 07 13:00:14.117942 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.117926    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9a2c14fb-81d2-4056-bf98-ac72b0b69aae-serving-cert\") pod \"insights-operator-76bcd6ccf5-hk2dx\" (UID: \"9a2c14fb-81d2-4056-bf98-ac72b0b69aae\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hk2dx"
Sep 07 13:00:14.128671 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.128651    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnpnh\" (UniqueName: \"kubernetes.io/projected/9a2c14fb-81d2-4056-bf98-ac72b0b69aae-kube-api-access-pnpnh\") pod \"insights-operator-76bcd6ccf5-hk2dx\" (UID: \"9a2c14fb-81d2-4056-bf98-ac72b0b69aae\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hk2dx"
Sep 07 13:00:14.130152 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.130134    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c48xd\" (UniqueName: \"kubernetes.io/projected/c4eea408-8172-4e4d-bc5f-c1674c0b7169-kube-api-access-c48xd\") pod \"volume-data-source-validator-695c895bd6-nl9hf\" (UID: \"c4eea408-8172-4e4d-bc5f-c1674c0b7169\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-nl9hf"
Sep 07 13:00:14.187443 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.187422    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-nl9hf"
Sep 07 13:00:14.212631 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.212594    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:14.215510 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.215492    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e745f4b-1d80-4c19-91ae-9fbe643572de-service-ca-bundle\") pod \"router-default-848fc6765d-blcdh\" (UID: \"4e745f4b-1d80-4c19-91ae-9fbe643572de\") " pod="openshift-ingress/router-default-848fc6765d-blcdh"
Sep 07 13:00:14.215583 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.215528    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4e745f4b-1d80-4c19-91ae-9fbe643572de-stats-auth\") pod \"router-default-848fc6765d-blcdh\" (UID: \"4e745f4b-1d80-4c19-91ae-9fbe643572de\") " pod="openshift-ingress/router-default-848fc6765d-blcdh"
Sep 07 13:00:14.215583 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.215566    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2bb2527-1a29-4b7e-b6fb-9be32693a5cd-trusted-ca\") pod \"console-operator-85b454874b-v9pd8\" (UID: \"d2bb2527-1a29-4b7e-b6fb-9be32693a5cd\") " pod="openshift-console-operator/console-operator-85b454874b-v9pd8"
Sep 07 13:00:14.215668 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.215589    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4e745f4b-1d80-4c19-91ae-9fbe643572de-default-certificate\") pod \"router-default-848fc6765d-blcdh\" (UID: \"4e745f4b-1d80-4c19-91ae-9fbe643572de\") " pod="openshift-ingress/router-default-848fc6765d-blcdh"
Sep 07 13:00:14.215668 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.215618    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d2bb2527-1a29-4b7e-b6fb-9be32693a5cd-serving-cert\") pod \"console-operator-85b454874b-v9pd8\" (UID: \"d2bb2527-1a29-4b7e-b6fb-9be32693a5cd\") " pod="openshift-console-operator/console-operator-85b454874b-v9pd8"
Sep 07 13:00:14.215668 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.215632    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e745f4b-1d80-4c19-91ae-9fbe643572de-metrics-certs\") pod \"router-default-848fc6765d-blcdh\" (UID: \"4e745f4b-1d80-4c19-91ae-9fbe643572de\") " pod="openshift-ingress/router-default-848fc6765d-blcdh"
Sep 07 13:00:14.215668 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.215649    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zvfg\" (UniqueName: \"kubernetes.io/projected/4e745f4b-1d80-4c19-91ae-9fbe643572de-kube-api-access-4zvfg\") pod \"router-default-848fc6765d-blcdh\" (UID: \"4e745f4b-1d80-4c19-91ae-9fbe643572de\") " pod="openshift-ingress/router-default-848fc6765d-blcdh"
Sep 07 13:00:14.215881 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.215689    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2bb2527-1a29-4b7e-b6fb-9be32693a5cd-config\") pod \"console-operator-85b454874b-v9pd8\" (UID: \"d2bb2527-1a29-4b7e-b6fb-9be32693a5cd\") " pod="openshift-console-operator/console-operator-85b454874b-v9pd8"
Sep 07 13:00:14.215881 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.215716    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmvgw\" (UniqueName: \"kubernetes.io/projected/d2bb2527-1a29-4b7e-b6fb-9be32693a5cd-kube-api-access-kmvgw\") pod \"console-operator-85b454874b-v9pd8\" (UID: \"d2bb2527-1a29-4b7e-b6fb-9be32693a5cd\") " pod="openshift-console-operator/console-operator-85b454874b-v9pd8"
Sep 07 13:00:14.215881 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.215745    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5wcn\" (UniqueName: \"kubernetes.io/projected/67f92ad6-f786-4ffc-81a4-4e3619820742-kube-api-access-f5wcn\") pod \"network-check-source-685456655f-pjqqn\" (UID: \"67f92ad6-f786-4ffc-81a4-4e3619820742\") " pod="openshift-network-diagnostics/network-check-source-685456655f-pjqqn"
Sep 07 13:00:14.216370 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.216351    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d2bb2527-1a29-4b7e-b6fb-9be32693a5cd-config\") pod \"console-operator-85b454874b-v9pd8\" (UID: \"d2bb2527-1a29-4b7e-b6fb-9be32693a5cd\") " pod="openshift-console-operator/console-operator-85b454874b-v9pd8"
Sep 07 13:00:14.216412 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.216402    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d2bb2527-1a29-4b7e-b6fb-9be32693a5cd-trusted-ca\") pod \"console-operator-85b454874b-v9pd8\" (UID: \"d2bb2527-1a29-4b7e-b6fb-9be32693a5cd\") " pod="openshift-console-operator/console-operator-85b454874b-v9pd8"
Sep 07 13:00:14.217928 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.217910    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d2bb2527-1a29-4b7e-b6fb-9be32693a5cd-serving-cert\") pod \"console-operator-85b454874b-v9pd8\" (UID: \"d2bb2527-1a29-4b7e-b6fb-9be32693a5cd\") " pod="openshift-console-operator/console-operator-85b454874b-v9pd8"
Sep 07 13:00:14.220890 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.220857    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-hk2dx"
Sep 07 13:00:14.223740 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.223720    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmvgw\" (UniqueName: \"kubernetes.io/projected/d2bb2527-1a29-4b7e-b6fb-9be32693a5cd-kube-api-access-kmvgw\") pod \"console-operator-85b454874b-v9pd8\" (UID: \"d2bb2527-1a29-4b7e-b6fb-9be32693a5cd\") " pod="openshift-console-operator/console-operator-85b454874b-v9pd8"
Sep 07 13:00:14.278305 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.278274    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:14.316294 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.316268    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4e745f4b-1d80-4c19-91ae-9fbe643572de-stats-auth\") pod \"router-default-848fc6765d-blcdh\" (UID: \"4e745f4b-1d80-4c19-91ae-9fbe643572de\") " pod="openshift-ingress/router-default-848fc6765d-blcdh"
Sep 07 13:00:14.316416 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.316331    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4e745f4b-1d80-4c19-91ae-9fbe643572de-default-certificate\") pod \"router-default-848fc6765d-blcdh\" (UID: \"4e745f4b-1d80-4c19-91ae-9fbe643572de\") " pod="openshift-ingress/router-default-848fc6765d-blcdh"
Sep 07 13:00:14.316416 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.316381    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e745f4b-1d80-4c19-91ae-9fbe643572de-metrics-certs\") pod \"router-default-848fc6765d-blcdh\" (UID: \"4e745f4b-1d80-4c19-91ae-9fbe643572de\") " pod="openshift-ingress/router-default-848fc6765d-blcdh"
Sep 07 13:00:14.316416 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.316404    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zvfg\" (UniqueName: \"kubernetes.io/projected/4e745f4b-1d80-4c19-91ae-9fbe643572de-kube-api-access-4zvfg\") pod \"router-default-848fc6765d-blcdh\" (UID: \"4e745f4b-1d80-4c19-91ae-9fbe643572de\") " pod="openshift-ingress/router-default-848fc6765d-blcdh"
Sep 07 13:00:14.316562 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:14.316496    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 07 13:00:14.316612 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:14.316570    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e745f4b-1d80-4c19-91ae-9fbe643572de-metrics-certs podName:4e745f4b-1d80-4c19-91ae-9fbe643572de nodeName:}" failed. No retries permitted until 2026-09-07 13:00:14.816549212 +0000 UTC m=+41.873430864 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e745f4b-1d80-4c19-91ae-9fbe643572de-metrics-certs") pod "router-default-848fc6765d-blcdh" (UID: "4e745f4b-1d80-4c19-91ae-9fbe643572de") : secret "router-metrics-certs-default" not found
Sep 07 13:00:14.316612 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.316595    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5wcn\" (UniqueName: \"kubernetes.io/projected/67f92ad6-f786-4ffc-81a4-4e3619820742-kube-api-access-f5wcn\") pod \"network-check-source-685456655f-pjqqn\" (UID: \"67f92ad6-f786-4ffc-81a4-4e3619820742\") " pod="openshift-network-diagnostics/network-check-source-685456655f-pjqqn"
Sep 07 13:00:14.316707 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.316660    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e745f4b-1d80-4c19-91ae-9fbe643572de-service-ca-bundle\") pod \"router-default-848fc6765d-blcdh\" (UID: \"4e745f4b-1d80-4c19-91ae-9fbe643572de\") " pod="openshift-ingress/router-default-848fc6765d-blcdh"
Sep 07 13:00:14.316828 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:14.316812    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e745f4b-1d80-4c19-91ae-9fbe643572de-service-ca-bundle podName:4e745f4b-1d80-4c19-91ae-9fbe643572de nodeName:}" failed. No retries permitted until 2026-09-07 13:00:14.816798963 +0000 UTC m=+41.873680613 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4e745f4b-1d80-4c19-91ae-9fbe643572de-service-ca-bundle") pod "router-default-848fc6765d-blcdh" (UID: "4e745f4b-1d80-4c19-91ae-9fbe643572de") : configmap references non-existent config key: service-ca.crt
Sep 07 13:00:14.317899 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.317876    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-v9pd8"
Sep 07 13:00:14.319010 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.318987    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4e745f4b-1d80-4c19-91ae-9fbe643572de-default-certificate\") pod \"router-default-848fc6765d-blcdh\" (UID: \"4e745f4b-1d80-4c19-91ae-9fbe643572de\") " pod="openshift-ingress/router-default-848fc6765d-blcdh"
Sep 07 13:00:14.319010 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.318997    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4e745f4b-1d80-4c19-91ae-9fbe643572de-stats-auth\") pod \"router-default-848fc6765d-blcdh\" (UID: \"4e745f4b-1d80-4c19-91ae-9fbe643572de\") " pod="openshift-ingress/router-default-848fc6765d-blcdh"
Sep 07 13:00:14.326024 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.326001    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5wcn\" (UniqueName: \"kubernetes.io/projected/67f92ad6-f786-4ffc-81a4-4e3619820742-kube-api-access-f5wcn\") pod \"network-check-source-685456655f-pjqqn\" (UID: \"67f92ad6-f786-4ffc-81a4-4e3619820742\") " pod="openshift-network-diagnostics/network-check-source-685456655f-pjqqn"
Sep 07 13:00:14.326024 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.326015    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zvfg\" (UniqueName: \"kubernetes.io/projected/4e745f4b-1d80-4c19-91ae-9fbe643572de-kube-api-access-4zvfg\") pod \"router-default-848fc6765d-blcdh\" (UID: \"4e745f4b-1d80-4c19-91ae-9fbe643572de\") " pod="openshift-ingress/router-default-848fc6765d-blcdh"
Sep 07 13:00:14.353192 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.353178    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-pjqqn"
Sep 07 13:00:14.487827 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.487798    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-nl9hf"]
Sep 07 13:00:14.490748 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:00:14.490721    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4eea408_8172_4e4d_bc5f_c1674c0b7169.slice/crio-77c0d85c14fc5f01332d24dcb390f82242dbe921c1bc0746f111031c94c4e4c1 WatchSource:0}: Error finding container 77c0d85c14fc5f01332d24dcb390f82242dbe921c1bc0746f111031c94c4e4c1: Status 404 returned error can't find the container with id 77c0d85c14fc5f01332d24dcb390f82242dbe921c1bc0746f111031c94c4e4c1
Sep 07 13:00:14.527744 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.527717    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-hk2dx"]
Sep 07 13:00:14.530647 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:00:14.530621    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a2c14fb_81d2_4056_bf98_ac72b0b69aae.slice/crio-4ad7adcbfaff96521c28c0573c5b95d2a157da6e3009ce4f144b47dbbadb9212 WatchSource:0}: Error finding container 4ad7adcbfaff96521c28c0573c5b95d2a157da6e3009ce4f144b47dbbadb9212: Status 404 returned error can't find the container with id 4ad7adcbfaff96521c28c0573c5b95d2a157da6e3009ce4f144b47dbbadb9212
Sep 07 13:00:14.555207 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.555147    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-hk2dx" event={"ID":"9a2c14fb-81d2-4056-bf98-ac72b0b69aae","Type":"ContainerStarted","Data":"4ad7adcbfaff96521c28c0573c5b95d2a157da6e3009ce4f144b47dbbadb9212"}
Sep 07 13:00:14.556493 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.556467    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-nl9hf" event={"ID":"c4eea408-8172-4e4d-bc5f-c1674c0b7169","Type":"ContainerStarted","Data":"77c0d85c14fc5f01332d24dcb390f82242dbe921c1bc0746f111031c94c4e4c1"}
Sep 07 13:00:14.617749 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.617723    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-v9pd8"]
Sep 07 13:00:14.620108 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:00:14.620082    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2bb2527_1a29_4b7e_b6fb_9be32693a5cd.slice/crio-b388763356f9354c417c19eca82533289eac6c169e908c018040f21b3bdbe2a9 WatchSource:0}: Error finding container b388763356f9354c417c19eca82533289eac6c169e908c018040f21b3bdbe2a9: Status 404 returned error can't find the container with id b388763356f9354c417c19eca82533289eac6c169e908c018040f21b3bdbe2a9
Sep 07 13:00:14.642091 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.642065    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-pjqqn"]
Sep 07 13:00:14.645337 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:00:14.645306    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67f92ad6_f786_4ffc_81a4_4e3619820742.slice/crio-b5925cf9b86abfa245889860ce831e241e64747f6abef524d8b093b3d280915c WatchSource:0}: Error finding container b5925cf9b86abfa245889860ce831e241e64747f6abef524d8b093b3d280915c: Status 404 returned error can't find the container with id b5925cf9b86abfa245889860ce831e241e64747f6abef524d8b093b3d280915c
Sep 07 13:00:14.819295 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.819261    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e745f4b-1d80-4c19-91ae-9fbe643572de-metrics-certs\") pod \"router-default-848fc6765d-blcdh\" (UID: \"4e745f4b-1d80-4c19-91ae-9fbe643572de\") " pod="openshift-ingress/router-default-848fc6765d-blcdh"
Sep 07 13:00:14.819448 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:14.819315    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e745f4b-1d80-4c19-91ae-9fbe643572de-service-ca-bundle\") pod \"router-default-848fc6765d-blcdh\" (UID: \"4e745f4b-1d80-4c19-91ae-9fbe643572de\") " pod="openshift-ingress/router-default-848fc6765d-blcdh"
Sep 07 13:00:14.819448 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:14.819401    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 07 13:00:14.819448 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:14.819441    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e745f4b-1d80-4c19-91ae-9fbe643572de-service-ca-bundle podName:4e745f4b-1d80-4c19-91ae-9fbe643572de nodeName:}" failed. No retries permitted until 2026-09-07 13:00:15.819427548 +0000 UTC m=+42.876309186 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4e745f4b-1d80-4c19-91ae-9fbe643572de-service-ca-bundle") pod "router-default-848fc6765d-blcdh" (UID: "4e745f4b-1d80-4c19-91ae-9fbe643572de") : configmap references non-existent config key: service-ca.crt
Sep 07 13:00:14.819551 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:14.819456    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e745f4b-1d80-4c19-91ae-9fbe643572de-metrics-certs podName:4e745f4b-1d80-4c19-91ae-9fbe643572de nodeName:}" failed. No retries permitted until 2026-09-07 13:00:15.819449634 +0000 UTC m=+42.876331271 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e745f4b-1d80-4c19-91ae-9fbe643572de-metrics-certs") pod "router-default-848fc6765d-blcdh" (UID: "4e745f4b-1d80-4c19-91ae-9fbe643572de") : secret "router-metrics-certs-default" not found
Sep 07 13:00:15.489780 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:15.489746    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:15.560064 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:15.560027    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-v9pd8" event={"ID":"d2bb2527-1a29-4b7e-b6fb-9be32693a5cd","Type":"ContainerStarted","Data":"b388763356f9354c417c19eca82533289eac6c169e908c018040f21b3bdbe2a9"}
Sep 07 13:00:15.561492 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:15.561462    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-pjqqn" event={"ID":"67f92ad6-f786-4ffc-81a4-4e3619820742","Type":"ContainerStarted","Data":"b5925cf9b86abfa245889860ce831e241e64747f6abef524d8b093b3d280915c"}
Sep 07 13:00:15.589449 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:15.589421    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:15.827616 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:15.827543    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e745f4b-1d80-4c19-91ae-9fbe643572de-service-ca-bundle\") pod \"router-default-848fc6765d-blcdh\" (UID: \"4e745f4b-1d80-4c19-91ae-9fbe643572de\") " pod="openshift-ingress/router-default-848fc6765d-blcdh"
Sep 07 13:00:15.827749 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:15.827627    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e745f4b-1d80-4c19-91ae-9fbe643572de-metrics-certs\") pod \"router-default-848fc6765d-blcdh\" (UID: \"4e745f4b-1d80-4c19-91ae-9fbe643572de\") " pod="openshift-ingress/router-default-848fc6765d-blcdh"
Sep 07 13:00:15.827749 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:15.827728    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e745f4b-1d80-4c19-91ae-9fbe643572de-service-ca-bundle podName:4e745f4b-1d80-4c19-91ae-9fbe643572de nodeName:}" failed. No retries permitted until 2026-09-07 13:00:17.827705403 +0000 UTC m=+44.884587060 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4e745f4b-1d80-4c19-91ae-9fbe643572de-service-ca-bundle") pod "router-default-848fc6765d-blcdh" (UID: "4e745f4b-1d80-4c19-91ae-9fbe643572de") : configmap references non-existent config key: service-ca.crt
Sep 07 13:00:15.827749 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:15.827736    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 07 13:00:15.827884 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:15.827797    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e745f4b-1d80-4c19-91ae-9fbe643572de-metrics-certs podName:4e745f4b-1d80-4c19-91ae-9fbe643572de nodeName:}" failed. No retries permitted until 2026-09-07 13:00:17.827785477 +0000 UTC m=+44.884667128 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e745f4b-1d80-4c19-91ae-9fbe643572de-metrics-certs") pod "router-default-848fc6765d-blcdh" (UID: "4e745f4b-1d80-4c19-91ae-9fbe643572de") : secret "router-metrics-certs-default" not found
Sep 07 13:00:16.129813 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:16.129789    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0ec59be-b6b6-47de-8b39-41cd853d72ac-metrics-tls\") pod \"dns-default-hpwk6\" (UID: \"e0ec59be-b6b6-47de-8b39-41cd853d72ac\") " pod="openshift-dns/dns-default-hpwk6"
Sep 07 13:00:16.129947 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:16.129929    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 13:00:16.130004 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:16.129995    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0ec59be-b6b6-47de-8b39-41cd853d72ac-metrics-tls podName:e0ec59be-b6b6-47de-8b39-41cd853d72ac nodeName:}" failed. No retries permitted until 2026-09-07 13:00:24.129974631 +0000 UTC m=+51.186856293 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e0ec59be-b6b6-47de-8b39-41cd853d72ac-metrics-tls") pod "dns-default-hpwk6" (UID: "e0ec59be-b6b6-47de-8b39-41cd853d72ac") : secret "dns-default-metrics-tls" not found
Sep 07 13:00:16.567365 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:16.566860    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-nl9hf" event={"ID":"c4eea408-8172-4e4d-bc5f-c1674c0b7169","Type":"ContainerStarted","Data":"9450ac335c69c507e2ecee707646608462f3d87b4e35c23cf42cc8041faecbcc"}
Sep 07 13:00:16.584144 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:16.584089    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-nl9hf" podStartSLOduration=1.970282631 podStartE2EDuration="3.584068315s" totalImagesPullingTime="1.613785684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:00:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:00:16.582713216 +0000 UTC m=+43.639594876" watchObservedRunningTime="2026-09-07 13:00:16.584068315 +0000 UTC m=+43.640949974"
Sep 07 13:00:16.715404 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:16.715354    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:16.783739 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:16.783700    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:17.845479 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:17.845418    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e745f4b-1d80-4c19-91ae-9fbe643572de-service-ca-bundle\") pod \"router-default-848fc6765d-blcdh\" (UID: \"4e745f4b-1d80-4c19-91ae-9fbe643572de\") " pod="openshift-ingress/router-default-848fc6765d-blcdh"
Sep 07 13:00:17.846048 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:17.845563    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e745f4b-1d80-4c19-91ae-9fbe643572de-metrics-certs\") pod \"router-default-848fc6765d-blcdh\" (UID: \"4e745f4b-1d80-4c19-91ae-9fbe643572de\") " pod="openshift-ingress/router-default-848fc6765d-blcdh"
Sep 07 13:00:17.846048 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:17.845621    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e745f4b-1d80-4c19-91ae-9fbe643572de-service-ca-bundle podName:4e745f4b-1d80-4c19-91ae-9fbe643572de nodeName:}" failed. No retries permitted until 2026-09-07 13:00:21.845595521 +0000 UTC m=+48.902477162 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4e745f4b-1d80-4c19-91ae-9fbe643572de-service-ca-bundle") pod "router-default-848fc6765d-blcdh" (UID: "4e745f4b-1d80-4c19-91ae-9fbe643572de") : configmap references non-existent config key: service-ca.crt
Sep 07 13:00:17.846048 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:17.845683    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 07 13:00:17.846048 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:17.845753    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e745f4b-1d80-4c19-91ae-9fbe643572de-metrics-certs podName:4e745f4b-1d80-4c19-91ae-9fbe643572de nodeName:}" failed. No retries permitted until 2026-09-07 13:00:21.845735529 +0000 UTC m=+48.902617185 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e745f4b-1d80-4c19-91ae-9fbe643572de-metrics-certs") pod "router-default-848fc6765d-blcdh" (UID: "4e745f4b-1d80-4c19-91ae-9fbe643572de") : secret "router-metrics-certs-default" not found
Sep 07 13:00:17.974932 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:17.974896    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:18.050530 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:18.050446    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:18.176665 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:18.176615    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:18.284947 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:18.284909    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:18.493369 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:18.493293    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:18.560779 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:18.560722    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:20.214407 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:20.214204    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:20.323609 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:20.323538    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:20.579782 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:20.579681    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-v9pd8_d2bb2527-1a29-4b7e-b6fb-9be32693a5cd/console-operator/0.log"
Sep 07 13:00:20.579782 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:20.579733    2576 generic.go:356] "Generic (PLEG): container finished" podID="d2bb2527-1a29-4b7e-b6fb-9be32693a5cd" containerID="6da9c6a755e72e2bcb886d270667a096a4a232fbafa880b85507fa5609b68437" exitCode=255
Sep 07 13:00:20.579987 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:20.579814    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-v9pd8" event={"ID":"d2bb2527-1a29-4b7e-b6fb-9be32693a5cd","Type":"ContainerDied","Data":"6da9c6a755e72e2bcb886d270667a096a4a232fbafa880b85507fa5609b68437"}
Sep 07 13:00:20.580101 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:20.580071    2576 scope.go:117] "RemoveContainer" containerID="6da9c6a755e72e2bcb886d270667a096a4a232fbafa880b85507fa5609b68437"
Sep 07 13:00:20.581523 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:20.581500    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-hk2dx" event={"ID":"9a2c14fb-81d2-4056-bf98-ac72b0b69aae","Type":"ContainerStarted","Data":"c654132cd19f7e0d73acb7a17d7f98d84b2f40741805f02f67fe7ddcfa715d27"}
Sep 07 13:00:20.583201 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:20.583178    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-pjqqn" event={"ID":"67f92ad6-f786-4ffc-81a4-4e3619820742","Type":"ContainerStarted","Data":"ab390c7330f40090309dead54ca87d162989e048f1965676438c498a728b90cd"}
Sep 07 13:00:20.613942 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:20.613901    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-hk2dx" podStartSLOduration=2.091731579 podStartE2EDuration="7.613887258s" totalImagesPullingTime="5.522155679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:00:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:00:20.613500412 +0000 UTC m=+47.670382072" watchObservedRunningTime="2026-09-07 13:00:20.613887258 +0000 UTC m=+47.670768918"
Sep 07 13:00:20.630574 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:20.630534    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-pjqqn" podStartSLOduration=2.213517758 podStartE2EDuration="7.630519989s" totalImagesPullingTime="5.417002231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:00:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:00:20.629153637 +0000 UTC m=+47.686035296" watchObservedRunningTime="2026-09-07 13:00:20.630519989 +0000 UTC m=+47.687401648"
Sep 07 13:00:20.714934 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:20.714902    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:20.889697 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:20.889665    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:21.588438 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:21.588409    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-v9pd8_d2bb2527-1a29-4b7e-b6fb-9be32693a5cd/console-operator/1.log"
Sep 07 13:00:21.588923 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:21.588905    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-v9pd8_d2bb2527-1a29-4b7e-b6fb-9be32693a5cd/console-operator/0.log"
Sep 07 13:00:21.589015 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:21.588949    2576 generic.go:356] "Generic (PLEG): container finished" podID="d2bb2527-1a29-4b7e-b6fb-9be32693a5cd" containerID="b34313d80f407b773dea0f4e254c0f7c80dcf0deec1fa31fbaba8d3cfa6658a5" exitCode=255
Sep 07 13:00:21.589074 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:21.589039    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-v9pd8" event={"ID":"d2bb2527-1a29-4b7e-b6fb-9be32693a5cd","Type":"ContainerDied","Data":"b34313d80f407b773dea0f4e254c0f7c80dcf0deec1fa31fbaba8d3cfa6658a5"}
Sep 07 13:00:21.589126 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:21.589115    2576 scope.go:117] "RemoveContainer" containerID="6da9c6a755e72e2bcb886d270667a096a4a232fbafa880b85507fa5609b68437"
Sep 07 13:00:21.589326 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:21.589286    2576 scope.go:117] "RemoveContainer" containerID="b34313d80f407b773dea0f4e254c0f7c80dcf0deec1fa31fbaba8d3cfa6658a5"
Sep 07 13:00:21.589519 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:21.589498    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-v9pd8_openshift-console-operator(d2bb2527-1a29-4b7e-b6fb-9be32693a5cd)\"" pod="openshift-console-operator/console-operator-85b454874b-v9pd8" podUID="d2bb2527-1a29-4b7e-b6fb-9be32693a5cd"
Sep 07 13:00:21.783570 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:21.783540    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-n7562"]
Sep 07 13:00:21.793745 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:21.793723    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n7562"
Sep 07 13:00:21.799028 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:21.799000    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 07 13:00:21.799182 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:21.799000    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9l2d6\""
Sep 07 13:00:21.799336 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:21.799320    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 07 13:00:21.799832 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:21.799810    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n7562"]
Sep 07 13:00:21.809625 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:21.809601    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:21.878541 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:21.878516    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e745f4b-1d80-4c19-91ae-9fbe643572de-metrics-certs\") pod \"router-default-848fc6765d-blcdh\" (UID: \"4e745f4b-1d80-4c19-91ae-9fbe643572de\") " pod="openshift-ingress/router-default-848fc6765d-blcdh"
Sep 07 13:00:21.878662 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:21.878549    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b22bc703-6502-4474-b93c-9a040ce34a18-crio-socket\") pod \"insights-runtime-extractor-n7562\" (UID: \"b22bc703-6502-4474-b93c-9a040ce34a18\") " pod="openshift-insights/insights-runtime-extractor-n7562"
Sep 07 13:00:21.878662 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:21.878568    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b22bc703-6502-4474-b93c-9a040ce34a18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n7562\" (UID: \"b22bc703-6502-4474-b93c-9a040ce34a18\") " pod="openshift-insights/insights-runtime-extractor-n7562"
Sep 07 13:00:21.878843 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:21.878666    2576 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 07 13:00:21.878843 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:21.878699    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e745f4b-1d80-4c19-91ae-9fbe643572de-service-ca-bundle\") pod \"router-default-848fc6765d-blcdh\" (UID: \"4e745f4b-1d80-4c19-91ae-9fbe643572de\") " pod="openshift-ingress/router-default-848fc6765d-blcdh"
Sep 07 13:00:21.878843 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:21.878731    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e745f4b-1d80-4c19-91ae-9fbe643572de-metrics-certs podName:4e745f4b-1d80-4c19-91ae-9fbe643572de nodeName:}" failed. No retries permitted until 2026-09-07 13:00:29.878712487 +0000 UTC m=+56.935594145 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4e745f4b-1d80-4c19-91ae-9fbe643572de-metrics-certs") pod "router-default-848fc6765d-blcdh" (UID: "4e745f4b-1d80-4c19-91ae-9fbe643572de") : secret "router-metrics-certs-default" not found
Sep 07 13:00:21.878843 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:21.878801    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqfjm\" (UniqueName: \"kubernetes.io/projected/b22bc703-6502-4474-b93c-9a040ce34a18-kube-api-access-nqfjm\") pod \"insights-runtime-extractor-n7562\" (UID: \"b22bc703-6502-4474-b93c-9a040ce34a18\") " pod="openshift-insights/insights-runtime-extractor-n7562"
Sep 07 13:00:21.878843 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:21.878811    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e745f4b-1d80-4c19-91ae-9fbe643572de-service-ca-bundle podName:4e745f4b-1d80-4c19-91ae-9fbe643572de nodeName:}" failed. No retries permitted until 2026-09-07 13:00:29.878797845 +0000 UTC m=+56.935679496 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4e745f4b-1d80-4c19-91ae-9fbe643572de-service-ca-bundle") pod "router-default-848fc6765d-blcdh" (UID: "4e745f4b-1d80-4c19-91ae-9fbe643572de") : configmap references non-existent config key: service-ca.crt
Sep 07 13:00:21.879096 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:21.878847    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b22bc703-6502-4474-b93c-9a040ce34a18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n7562\" (UID: \"b22bc703-6502-4474-b93c-9a040ce34a18\") " pod="openshift-insights/insights-runtime-extractor-n7562"
Sep 07 13:00:21.879096 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:21.878883    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b22bc703-6502-4474-b93c-9a040ce34a18-data-volume\") pod \"insights-runtime-extractor-n7562\" (UID: \"b22bc703-6502-4474-b93c-9a040ce34a18\") " pod="openshift-insights/insights-runtime-extractor-n7562"
Sep 07 13:00:21.916443 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:21.916416    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:21.979859 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:21.979830    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b22bc703-6502-4474-b93c-9a040ce34a18-data-volume\") pod \"insights-runtime-extractor-n7562\" (UID: \"b22bc703-6502-4474-b93c-9a040ce34a18\") " pod="openshift-insights/insights-runtime-extractor-n7562"
Sep 07 13:00:21.979988 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:21.979874    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b22bc703-6502-4474-b93c-9a040ce34a18-crio-socket\") pod \"insights-runtime-extractor-n7562\" (UID: \"b22bc703-6502-4474-b93c-9a040ce34a18\") " pod="openshift-insights/insights-runtime-extractor-n7562"
Sep 07 13:00:21.979988 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:21.979894    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b22bc703-6502-4474-b93c-9a040ce34a18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n7562\" (UID: \"b22bc703-6502-4474-b93c-9a040ce34a18\") " pod="openshift-insights/insights-runtime-extractor-n7562"
Sep 07 13:00:21.979988 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:21.979951    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqfjm\" (UniqueName: \"kubernetes.io/projected/b22bc703-6502-4474-b93c-9a040ce34a18-kube-api-access-nqfjm\") pod \"insights-runtime-extractor-n7562\" (UID: \"b22bc703-6502-4474-b93c-9a040ce34a18\") " pod="openshift-insights/insights-runtime-extractor-n7562"
Sep 07 13:00:21.979988 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:21.979975    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b22bc703-6502-4474-b93c-9a040ce34a18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n7562\" (UID: \"b22bc703-6502-4474-b93c-9a040ce34a18\") " pod="openshift-insights/insights-runtime-extractor-n7562"
Sep 07 13:00:21.980189 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:21.980063    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 13:00:21.980189 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:21.980072    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b22bc703-6502-4474-b93c-9a040ce34a18-crio-socket\") pod \"insights-runtime-extractor-n7562\" (UID: \"b22bc703-6502-4474-b93c-9a040ce34a18\") " pod="openshift-insights/insights-runtime-extractor-n7562"
Sep 07 13:00:21.980189 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:21.980079    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 13:00:21.980189 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:21.980107    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b22bc703-6502-4474-b93c-9a040ce34a18-kube-rbac-proxy-cm podName:b22bc703-6502-4474-b93c-9a040ce34a18 nodeName:}" failed. No retries permitted until 2026-09-07 13:00:22.480094702 +0000 UTC m=+49.536976339 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b22bc703-6502-4474-b93c-9a040ce34a18-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n7562" (UID: "b22bc703-6502-4474-b93c-9a040ce34a18") : configmap "kube-rbac-proxy" not found
Sep 07 13:00:21.980189 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:21.980155    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b22bc703-6502-4474-b93c-9a040ce34a18-insights-runtime-extractor-tls podName:b22bc703-6502-4474-b93c-9a040ce34a18 nodeName:}" failed. No retries permitted until 2026-09-07 13:00:22.480139801 +0000 UTC m=+49.537021453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b22bc703-6502-4474-b93c-9a040ce34a18-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n7562" (UID: "b22bc703-6502-4474-b93c-9a040ce34a18") : secret "insights-runtime-extractor-tls" not found
Sep 07 13:00:21.980430 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:21.980207    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b22bc703-6502-4474-b93c-9a040ce34a18-data-volume\") pod \"insights-runtime-extractor-n7562\" (UID: \"b22bc703-6502-4474-b93c-9a040ce34a18\") " pod="openshift-insights/insights-runtime-extractor-n7562"
Sep 07 13:00:21.991881 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:21.991855    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqfjm\" (UniqueName: \"kubernetes.io/projected/b22bc703-6502-4474-b93c-9a040ce34a18-kube-api-access-nqfjm\") pod \"insights-runtime-extractor-n7562\" (UID: \"b22bc703-6502-4474-b93c-9a040ce34a18\") " pod="openshift-insights/insights-runtime-extractor-n7562"
Sep 07 13:00:22.156457 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:22.156383    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:22.233133 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:22.233105    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:22.406656 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:22.406577    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:22.484064 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:22.484035    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b22bc703-6502-4474-b93c-9a040ce34a18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n7562\" (UID: \"b22bc703-6502-4474-b93c-9a040ce34a18\") " pod="openshift-insights/insights-runtime-extractor-n7562"
Sep 07 13:00:22.484204 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:22.484103    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b22bc703-6502-4474-b93c-9a040ce34a18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n7562\" (UID: \"b22bc703-6502-4474-b93c-9a040ce34a18\") " pod="openshift-insights/insights-runtime-extractor-n7562"
Sep 07 13:00:22.484204 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:22.484171    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 13:00:22.484204 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:22.484191    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 13:00:22.484298 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:22.484236    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b22bc703-6502-4474-b93c-9a040ce34a18-kube-rbac-proxy-cm podName:b22bc703-6502-4474-b93c-9a040ce34a18 nodeName:}" failed. No retries permitted until 2026-09-07 13:00:23.484221307 +0000 UTC m=+50.541102948 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b22bc703-6502-4474-b93c-9a040ce34a18-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n7562" (UID: "b22bc703-6502-4474-b93c-9a040ce34a18") : configmap "kube-rbac-proxy" not found
Sep 07 13:00:22.484298 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:22.484287    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b22bc703-6502-4474-b93c-9a040ce34a18-insights-runtime-extractor-tls podName:b22bc703-6502-4474-b93c-9a040ce34a18 nodeName:}" failed. No retries permitted until 2026-09-07 13:00:23.484273982 +0000 UTC m=+50.541155645 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b22bc703-6502-4474-b93c-9a040ce34a18-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n7562" (UID: "b22bc703-6502-4474-b93c-9a040ce34a18") : secret "insights-runtime-extractor-tls" not found
Sep 07 13:00:22.593290 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:22.593264    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-v9pd8_d2bb2527-1a29-4b7e-b6fb-9be32693a5cd/console-operator/1.log"
Sep 07 13:00:22.593722 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:22.593628    2576 scope.go:117] "RemoveContainer" containerID="b34313d80f407b773dea0f4e254c0f7c80dcf0deec1fa31fbaba8d3cfa6658a5"
Sep 07 13:00:22.593850 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:22.593827    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-v9pd8_openshift-console-operator(d2bb2527-1a29-4b7e-b6fb-9be32693a5cd)\"" pod="openshift-console-operator/console-operator-85b454874b-v9pd8" podUID="d2bb2527-1a29-4b7e-b6fb-9be32693a5cd"
Sep 07 13:00:22.623947 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:22.623907    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:23.491492 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:23.491457    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b22bc703-6502-4474-b93c-9a040ce34a18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n7562\" (UID: \"b22bc703-6502-4474-b93c-9a040ce34a18\") " pod="openshift-insights/insights-runtime-extractor-n7562"
Sep 07 13:00:23.491669 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:23.491542    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b22bc703-6502-4474-b93c-9a040ce34a18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n7562\" (UID: \"b22bc703-6502-4474-b93c-9a040ce34a18\") " pod="openshift-insights/insights-runtime-extractor-n7562"
Sep 07 13:00:23.491669 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:23.491606    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 13:00:23.491669 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:23.491616    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 13:00:23.491791 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:23.491677    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b22bc703-6502-4474-b93c-9a040ce34a18-kube-rbac-proxy-cm podName:b22bc703-6502-4474-b93c-9a040ce34a18 nodeName:}" failed. No retries permitted until 2026-09-07 13:00:25.491662584 +0000 UTC m=+52.548544220 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b22bc703-6502-4474-b93c-9a040ce34a18-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n7562" (UID: "b22bc703-6502-4474-b93c-9a040ce34a18") : configmap "kube-rbac-proxy" not found
Sep 07 13:00:23.491791 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:23.491688    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b22bc703-6502-4474-b93c-9a040ce34a18-insights-runtime-extractor-tls podName:b22bc703-6502-4474-b93c-9a040ce34a18 nodeName:}" failed. No retries permitted until 2026-09-07 13:00:25.491682645 +0000 UTC m=+52.548564282 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b22bc703-6502-4474-b93c-9a040ce34a18-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n7562" (UID: "b22bc703-6502-4474-b93c-9a040ce34a18") : secret "insights-runtime-extractor-tls" not found
Sep 07 13:00:24.038674 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:24.038641    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:24.161823 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:24.161762    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:24.197887 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:24.197857    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0ec59be-b6b6-47de-8b39-41cd853d72ac-metrics-tls\") pod \"dns-default-hpwk6\" (UID: \"e0ec59be-b6b6-47de-8b39-41cd853d72ac\") " pod="openshift-dns/dns-default-hpwk6"
Sep 07 13:00:24.198013 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:24.197969    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 07 13:00:24.198062 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:24.198021    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0ec59be-b6b6-47de-8b39-41cd853d72ac-metrics-tls podName:e0ec59be-b6b6-47de-8b39-41cd853d72ac nodeName:}" failed. No retries permitted until 2026-09-07 13:00:40.198008606 +0000 UTC m=+67.254890243 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e0ec59be-b6b6-47de-8b39-41cd853d72ac-metrics-tls") pod "dns-default-hpwk6" (UID: "e0ec59be-b6b6-47de-8b39-41cd853d72ac") : secret "dns-default-metrics-tls" not found
Sep 07 13:00:24.285144 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:24.285113    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:24.318309 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:24.318245    2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-v9pd8"
Sep 07 13:00:24.318424 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:24.318331    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-v9pd8"
Sep 07 13:00:24.318615 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:24.318604    2576 scope.go:117] "RemoveContainer" containerID="b34313d80f407b773dea0f4e254c0f7c80dcf0deec1fa31fbaba8d3cfa6658a5"
Sep 07 13:00:24.318799 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:24.318752    2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-v9pd8_openshift-console-operator(d2bb2527-1a29-4b7e-b6fb-9be32693a5cd)\"" pod="openshift-console-operator/console-operator-85b454874b-v9pd8" podUID="d2bb2527-1a29-4b7e-b6fb-9be32693a5cd"
Sep 07 13:00:24.351037 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:24.351016    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-75jvc_a81301be-0f84-4fbb-a496-08f21fe21ad7/dns-node-resolver/0.log"
Sep 07 13:00:24.457005 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:24.456975    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:24.554250 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:24.554222    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:24.631784 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:24.631739    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:25.508525 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:25.508493    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b22bc703-6502-4474-b93c-9a040ce34a18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n7562\" (UID: \"b22bc703-6502-4474-b93c-9a040ce34a18\") " pod="openshift-insights/insights-runtime-extractor-n7562"
Sep 07 13:00:25.508926 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:25.508572    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b22bc703-6502-4474-b93c-9a040ce34a18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n7562\" (UID: \"b22bc703-6502-4474-b93c-9a040ce34a18\") " pod="openshift-insights/insights-runtime-extractor-n7562"
Sep 07 13:00:25.508926 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:25.508634    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 13:00:25.508926 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:25.508646    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 13:00:25.508926 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:25.508682    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b22bc703-6502-4474-b93c-9a040ce34a18-kube-rbac-proxy-cm podName:b22bc703-6502-4474-b93c-9a040ce34a18 nodeName:}" failed. No retries permitted until 2026-09-07 13:00:29.50866628 +0000 UTC m=+56.565547931 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b22bc703-6502-4474-b93c-9a040ce34a18-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n7562" (UID: "b22bc703-6502-4474-b93c-9a040ce34a18") : configmap "kube-rbac-proxy" not found
Sep 07 13:00:25.508926 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:25.508706    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b22bc703-6502-4474-b93c-9a040ce34a18-insights-runtime-extractor-tls podName:b22bc703-6502-4474-b93c-9a040ce34a18 nodeName:}" failed. No retries permitted until 2026-09-07 13:00:29.508692227 +0000 UTC m=+56.565573888 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b22bc703-6502-4474-b93c-9a040ce34a18-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n7562" (UID: "b22bc703-6502-4474-b93c-9a040ce34a18") : secret "insights-runtime-extractor-tls" not found
Sep 07 13:00:25.690678 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:25.690640    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:25.740873 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:25.740847    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wwf4n_c42a485d-29e3-41f3-aa5e-d1100b1b0c54/node-ca/0.log"
Sep 07 13:00:25.775283 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:25.775214    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:26.109639 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:26.109558    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:26.338939 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:26.338906    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m5qjt_14038337-346f-4a5e-96bc-d4004f778bc1/serve-healthcheck-canary/0.log"
Sep 07 13:00:26.339190 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:26.339166    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:26.763101 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:26.763052    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:26.925499 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:26.925460    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:27.527721 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:27.527681    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:27.717129 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:27.717094    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:27.818926 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:27.818837    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:28.130417 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:28.130378    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:28.552560 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:28.552477    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:28.650293 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:28.650259    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:28.780143 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:28.780107    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:29.146264 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:29.146222    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:29.269468 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:29.269436    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:29.539576 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:29.539494    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b22bc703-6502-4474-b93c-9a040ce34a18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n7562\" (UID: \"b22bc703-6502-4474-b93c-9a040ce34a18\") " pod="openshift-insights/insights-runtime-extractor-n7562"
Sep 07 13:00:29.539576 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:29.539563    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b22bc703-6502-4474-b93c-9a040ce34a18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n7562\" (UID: \"b22bc703-6502-4474-b93c-9a040ce34a18\") " pod="openshift-insights/insights-runtime-extractor-n7562"
Sep 07 13:00:29.539748 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:29.539611    2576 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 07 13:00:29.539748 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:29.539653    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 07 13:00:29.539748 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:29.539671    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b22bc703-6502-4474-b93c-9a040ce34a18-kube-rbac-proxy-cm podName:b22bc703-6502-4474-b93c-9a040ce34a18 nodeName:}" failed. No retries permitted until 2026-09-07 13:00:37.539657074 +0000 UTC m=+64.596538715 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b22bc703-6502-4474-b93c-9a040ce34a18-kube-rbac-proxy-cm") pod "insights-runtime-extractor-n7562" (UID: "b22bc703-6502-4474-b93c-9a040ce34a18") : configmap "kube-rbac-proxy" not found
Sep 07 13:00:29.539748 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:29.539709    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b22bc703-6502-4474-b93c-9a040ce34a18-insights-runtime-extractor-tls podName:b22bc703-6502-4474-b93c-9a040ce34a18 nodeName:}" failed. No retries permitted until 2026-09-07 13:00:37.539702828 +0000 UTC m=+64.596584464 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b22bc703-6502-4474-b93c-9a040ce34a18-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n7562" (UID: "b22bc703-6502-4474-b93c-9a040ce34a18") : secret "insights-runtime-extractor-tls" not found
Sep 07 13:00:29.545563 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:29.545527    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:29.728903 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:29.728865    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:29.945830 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:29.945799    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e745f4b-1d80-4c19-91ae-9fbe643572de-metrics-certs\") pod \"router-default-848fc6765d-blcdh\" (UID: \"4e745f4b-1d80-4c19-91ae-9fbe643572de\") " pod="openshift-ingress/router-default-848fc6765d-blcdh"
Sep 07 13:00:29.945987 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:29.945867    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e745f4b-1d80-4c19-91ae-9fbe643572de-service-ca-bundle\") pod \"router-default-848fc6765d-blcdh\" (UID: \"4e745f4b-1d80-4c19-91ae-9fbe643572de\") " pod="openshift-ingress/router-default-848fc6765d-blcdh"
Sep 07 13:00:29.946066 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:00:29.946049    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e745f4b-1d80-4c19-91ae-9fbe643572de-service-ca-bundle podName:4e745f4b-1d80-4c19-91ae-9fbe643572de nodeName:}" failed. No retries permitted until 2026-09-07 13:00:45.946030925 +0000 UTC m=+73.002912562 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4e745f4b-1d80-4c19-91ae-9fbe643572de-service-ca-bundle") pod "router-default-848fc6765d-blcdh" (UID: "4e745f4b-1d80-4c19-91ae-9fbe643572de") : configmap references non-existent config key: service-ca.crt
Sep 07 13:00:29.948297 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:29.948268    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4e745f4b-1d80-4c19-91ae-9fbe643572de-metrics-certs\") pod \"router-default-848fc6765d-blcdh\" (UID: \"4e745f4b-1d80-4c19-91ae-9fbe643572de\") " pod="openshift-ingress/router-default-848fc6765d-blcdh"
Sep 07 13:00:30.394760 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:30.394722    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:30.727087 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:30.727000    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:31.363804 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:31.363755    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:31.516096 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:31.516061    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:31.622568 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:31.622493    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:31.984286 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:31.984253    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:32.132921 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:32.132893    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:32.370185 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:32.370100    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:32.523302 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:32.523277    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5wqcp"
Sep 07 13:00:34.080266 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:34.080228    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:34.169149 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:34.169115    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:34.315452 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:34.315419    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:34.828332 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:34.828296    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:36.462234 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:36.462188    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:37.360789 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:37.360742    2576 scope.go:117] "RemoveContainer" containerID="b34313d80f407b773dea0f4e254c0f7c80dcf0deec1fa31fbaba8d3cfa6658a5"
Sep 07 13:00:37.604736 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:37.604699    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b22bc703-6502-4474-b93c-9a040ce34a18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n7562\" (UID: \"b22bc703-6502-4474-b93c-9a040ce34a18\") " pod="openshift-insights/insights-runtime-extractor-n7562"
Sep 07 13:00:37.605119 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:37.604807    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b22bc703-6502-4474-b93c-9a040ce34a18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n7562\" (UID: \"b22bc703-6502-4474-b93c-9a040ce34a18\") " pod="openshift-insights/insights-runtime-extractor-n7562"
Sep 07 13:00:37.605310 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:37.605281    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b22bc703-6502-4474-b93c-9a040ce34a18-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n7562\" (UID: \"b22bc703-6502-4474-b93c-9a040ce34a18\") " pod="openshift-insights/insights-runtime-extractor-n7562"
Sep 07 13:00:37.607264 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:37.607242    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b22bc703-6502-4474-b93c-9a040ce34a18-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n7562\" (UID: \"b22bc703-6502-4474-b93c-9a040ce34a18\") " pod="openshift-insights/insights-runtime-extractor-n7562"
Sep 07 13:00:37.637220 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:37.637197    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-v9pd8_d2bb2527-1a29-4b7e-b6fb-9be32693a5cd/console-operator/1.log"
Sep 07 13:00:37.637351 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:37.637255    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-v9pd8" event={"ID":"d2bb2527-1a29-4b7e-b6fb-9be32693a5cd","Type":"ContainerStarted","Data":"203a3ac4980af6904ddf80ebf56f105b1239ceac12f78d2a77732de0ea9afa0f"}
Sep 07 13:00:37.637564 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:37.637545    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-v9pd8"
Sep 07 13:00:37.655381 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:37.655331    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-v9pd8" podStartSLOduration=19.221837596 podStartE2EDuration="24.655314912s" totalImagesPullingTime="5.433477316s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:00:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:00:37.654382306 +0000 UTC m=+64.711263966" watchObservedRunningTime="2026-09-07 13:00:37.655314912 +0000 UTC m=+64.712196571"
Sep 07 13:00:37.704654 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:37.704633    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9l2d6\""
Sep 07 13:00:37.704966 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:37.704952    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-v9pd8"
Sep 07 13:00:37.712895 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:37.712877    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n7562"
Sep 07 13:00:37.993863 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:37.993791    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n7562"]
Sep 07 13:00:37.996862 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:00:37.996831    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb22bc703_6502_4474_b93c_9a040ce34a18.slice/crio-454283bcecdfe54981365036ee475f1e2dfac0f26b8c68a6e4331ff0855cc428 WatchSource:0}: Error finding container 454283bcecdfe54981365036ee475f1e2dfac0f26b8c68a6e4331ff0855cc428: Status 404 returned error can't find the container with id 454283bcecdfe54981365036ee475f1e2dfac0f26b8c68a6e4331ff0855cc428
Sep 07 13:00:38.262905 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:38.262824    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:38.331549 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:38.331519    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:38.574135 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:38.574048    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:38.642033 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:38.642002    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n7562" event={"ID":"b22bc703-6502-4474-b93c-9a040ce34a18","Type":"ContainerStarted","Data":"cff6f7be7bc8b9c2c880ac2c0cad245f3ff153188f7b209012b1152034f4ddac"}
Sep 07 13:00:38.642406 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:38.642057    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n7562" event={"ID":"b22bc703-6502-4474-b93c-9a040ce34a18","Type":"ContainerStarted","Data":"454283bcecdfe54981365036ee475f1e2dfac0f26b8c68a6e4331ff0855cc428"}
Sep 07 13:00:38.701839 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:38.701806    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:38.978774 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:38.978742    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:39.117105 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:39.117039    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b68768bd-84ba-4756-834a-ad023bd05cd3-metrics-certs\") pod \"network-metrics-daemon-jj8gw\" (UID: \"b68768bd-84ba-4756-834a-ad023bd05cd3\") " pod="openshift-multus/network-metrics-daemon-jj8gw"
Sep 07 13:00:39.119532 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:39.119511    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 07 13:00:39.129685 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:39.129658    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b68768bd-84ba-4756-834a-ad023bd05cd3-metrics-certs\") pod \"network-metrics-daemon-jj8gw\" (UID: \"b68768bd-84ba-4756-834a-ad023bd05cd3\") " pod="openshift-multus/network-metrics-daemon-jj8gw"
Sep 07 13:00:39.218018 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:39.217990    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nfq4\" (UniqueName: \"kubernetes.io/projected/87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1-kube-api-access-8nfq4\") pod \"network-check-target-fgv8s\" (UID: \"87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1\") " pod="openshift-network-diagnostics/network-check-target-fgv8s"
Sep 07 13:00:39.218132 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:39.218038    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5d02c03-a753-4457-ab6a-99c8285ca9aa-original-pull-secret\") pod \"global-pull-secret-syncer-sjggc\" (UID: \"a5d02c03-a753-4457-ab6a-99c8285ca9aa\") " pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 13:00:39.220544 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:39.220527    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nfq4\" (UniqueName: \"kubernetes.io/projected/87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1-kube-api-access-8nfq4\") pod \"network-check-target-fgv8s\" (UID: \"87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1\") " pod="openshift-network-diagnostics/network-check-target-fgv8s"
Sep 07 13:00:39.220714 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:39.220699    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 07 13:00:39.230593 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:39.230574    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a5d02c03-a753-4457-ab6a-99c8285ca9aa-original-pull-secret\") pod \"global-pull-secret-syncer-sjggc\" (UID: \"a5d02c03-a753-4457-ab6a-99c8285ca9aa\") " pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 13:00:39.275200 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:39.275177    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5v9xw\""
Sep 07 13:00:39.282990 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:39.282971    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8d5qt\""
Sep 07 13:00:39.282990 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:39.282989    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jj8gw"
Sep 07 13:00:39.289803 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:39.289786    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sjggc"
Sep 07 13:00:39.291901 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:39.291887    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fgv8s"
Sep 07 13:00:39.390887 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:39.390809    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:39.571410 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:39.571377    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:39.579740 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:39.579711    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jj8gw"]
Sep 07 13:00:39.582838 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:00:39.582754    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb68768bd_84ba_4756_834a_ad023bd05cd3.slice/crio-d446b4546bbf554d22962e90954ed5577e3081d82b28db79b20424f2f4a89c2b WatchSource:0}: Error finding container d446b4546bbf554d22962e90954ed5577e3081d82b28db79b20424f2f4a89c2b: Status 404 returned error can't find the container with id d446b4546bbf554d22962e90954ed5577e3081d82b28db79b20424f2f4a89c2b
Sep 07 13:00:39.609599 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:39.609578    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sjggc"]
Sep 07 13:00:39.612667 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:00:39.612639    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5d02c03_a753_4457_ab6a_99c8285ca9aa.slice/crio-4e2cb57de2a10bde9cc6835654e445f1dc2ff5d0589a7fd0687d2190c002e454 WatchSource:0}: Error finding container 4e2cb57de2a10bde9cc6835654e445f1dc2ff5d0589a7fd0687d2190c002e454: Status 404 returned error can't find the container with id 4e2cb57de2a10bde9cc6835654e445f1dc2ff5d0589a7fd0687d2190c002e454
Sep 07 13:00:39.633469 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:39.633445    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fgv8s"]
Sep 07 13:00:39.636029 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:00:39.635975    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87bf3b3f_27ed_40b2_98e0_ef3d2f913cd1.slice/crio-cd1c0e5171368c89c66428c27dd38a062e7f97058b98ae330195f0f12ba51530 WatchSource:0}: Error finding container cd1c0e5171368c89c66428c27dd38a062e7f97058b98ae330195f0f12ba51530: Status 404 returned error can't find the container with id cd1c0e5171368c89c66428c27dd38a062e7f97058b98ae330195f0f12ba51530
Sep 07 13:00:39.645966 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:39.645933    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sjggc" event={"ID":"a5d02c03-a753-4457-ab6a-99c8285ca9aa","Type":"ContainerStarted","Data":"4e2cb57de2a10bde9cc6835654e445f1dc2ff5d0589a7fd0687d2190c002e454"}
Sep 07 13:00:39.647076 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:39.647044    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:39.648055 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:39.648030    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n7562" event={"ID":"b22bc703-6502-4474-b93c-9a040ce34a18","Type":"ContainerStarted","Data":"cc7e67a21c71516bc6c96bcade3f92afe03b766604470ee1c2120d38e4281be1"}
Sep 07 13:00:39.649185 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:39.649164    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fgv8s" event={"ID":"87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1","Type":"ContainerStarted","Data":"cd1c0e5171368c89c66428c27dd38a062e7f97058b98ae330195f0f12ba51530"}
Sep 07 13:00:39.650221 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:39.650201    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jj8gw" event={"ID":"b68768bd-84ba-4756-834a-ad023bd05cd3","Type":"ContainerStarted","Data":"d446b4546bbf554d22962e90954ed5577e3081d82b28db79b20424f2f4a89c2b"}
Sep 07 13:00:39.728226 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:39.728154    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:40.227222 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:40.227179    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0ec59be-b6b6-47de-8b39-41cd853d72ac-metrics-tls\") pod \"dns-default-hpwk6\" (UID: \"e0ec59be-b6b6-47de-8b39-41cd853d72ac\") " pod="openshift-dns/dns-default-hpwk6"
Sep 07 13:00:40.229508 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:40.229490    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0ec59be-b6b6-47de-8b39-41cd853d72ac-metrics-tls\") pod \"dns-default-hpwk6\" (UID: \"e0ec59be-b6b6-47de-8b39-41cd853d72ac\") " pod="openshift-dns/dns-default-hpwk6"
Sep 07 13:00:40.498884 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:40.498808    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rqgx2\""
Sep 07 13:00:40.506798 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:40.506680    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hpwk6"
Sep 07 13:00:40.593409 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:40.593350    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:40.656843 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:40.656811    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fgv8s" event={"ID":"87bf3b3f-27ed-40b2-98e0-ef3d2f913cd1","Type":"ContainerStarted","Data":"30de245228cd110da4c5921c9653feb1d9fff34506da584e367c51071744344b"}
Sep 07 13:00:40.657223 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:40.656986    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fgv8s"
Sep 07 13:00:40.674024 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:40.673352    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fgv8s" podStartSLOduration=67.673330632 podStartE2EDuration="1m7.673330632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:59:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:00:40.672584646 +0000 UTC m=+67.729466306" watchObservedRunningTime="2026-09-07 13:00:40.673330632 +0000 UTC m=+67.730212296"
Sep 07 13:00:40.899077 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:40.899046    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hpwk6"]
Sep 07 13:00:40.901849 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:00:40.901819    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0ec59be_b6b6_47de_8b39_41cd853d72ac.slice/crio-2effa54459c39495934ec345eceeaca6417768a69663b3fed5556f8297516a4f WatchSource:0}: Error finding container 2effa54459c39495934ec345eceeaca6417768a69663b3fed5556f8297516a4f: Status 404 returned error can't find the container with id 2effa54459c39495934ec345eceeaca6417768a69663b3fed5556f8297516a4f
Sep 07 13:00:41.127033 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:41.127001    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:41.663950 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:41.663913    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n7562" event={"ID":"b22bc703-6502-4474-b93c-9a040ce34a18","Type":"ContainerStarted","Data":"0e328d18db80faedc1122c130cca5a4412415ce2aae21eaba96e27eab33f1c92"}
Sep 07 13:00:41.665445 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:41.665417    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hpwk6" event={"ID":"e0ec59be-b6b6-47de-8b39-41cd853d72ac","Type":"ContainerStarted","Data":"2effa54459c39495934ec345eceeaca6417768a69663b3fed5556f8297516a4f"}
Sep 07 13:00:41.688025 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:41.687976    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-n7562" podStartSLOduration=18.13668755 podStartE2EDuration="20.68795656s" totalImagesPullingTime="2.55126901s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:00:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:00:41.686922045 +0000 UTC m=+68.743803706" watchObservedRunningTime="2026-09-07 13:00:41.68795656 +0000 UTC m=+68.744838219"
Sep 07 13:00:42.675887 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:42.675839    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jj8gw" event={"ID":"b68768bd-84ba-4756-834a-ad023bd05cd3","Type":"ContainerStarted","Data":"4a6f82bf08e9009b25ed1839c481671122d90394520a9c731746888266bb3dea"}
Sep 07 13:00:42.676345 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:42.675908    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jj8gw" event={"ID":"b68768bd-84ba-4756-834a-ad023bd05cd3","Type":"ContainerStarted","Data":"bd5e3a644a596a269f9dabc8ca9f0bc002725d11df787b9ef6e3d7a6e2b14aa0"}
Sep 07 13:00:42.697951 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:42.697467    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jj8gw" podStartSLOduration=67.585797728 podStartE2EDuration="1m9.697444812s" totalImagesPullingTime="2.111647084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 12:59:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:00:42.696314493 +0000 UTC m=+69.753196187" watchObservedRunningTime="2026-09-07 13:00:42.697444812 +0000 UTC m=+69.754326473"
Sep 07 13:00:44.684814 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:44.684758    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sjggc" event={"ID":"a5d02c03-a753-4457-ab6a-99c8285ca9aa","Type":"ContainerStarted","Data":"4492b662516af107afa1ab6288b69b962ccb9e0cd319e3f4766ad382be6f4192"}
Sep 07 13:00:44.687801 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:44.687756    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hpwk6" event={"ID":"e0ec59be-b6b6-47de-8b39-41cd853d72ac","Type":"ContainerStarted","Data":"dbfe0abe8e8dfa3ff498564ddc4dee8c4d7bba2abe58b73a3710d5dc2326cd4a"}
Sep 07 13:00:44.687891 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:44.687839    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hpwk6"
Sep 07 13:00:44.701866 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:44.701814    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-sjggc" podStartSLOduration=66.819463444 podStartE2EDuration="1m11.701799445s" totalImagesPullingTime="4.882336001s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 12:59:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:00:44.700862224 +0000 UTC m=+71.757743883" watchObservedRunningTime="2026-09-07 13:00:44.701799445 +0000 UTC m=+71.758681234"
Sep 07 13:00:44.718983 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:44.718932    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hpwk6" podStartSLOduration=33.137397247 podStartE2EDuration="36.718913237s" totalImagesPullingTime="3.58151599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:00:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:00:44.718437559 +0000 UTC m=+71.775319219" watchObservedRunningTime="2026-09-07 13:00:44.718913237 +0000 UTC m=+71.775794889"
Sep 07 13:00:45.692486 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:45.692453    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hpwk6" event={"ID":"e0ec59be-b6b6-47de-8b39-41cd853d72ac","Type":"ContainerStarted","Data":"cf12b1d9d93c0f773772d953610a9c8faa9d10a628aece98c9f23cb2a9314846"}
Sep 07 13:00:45.976094 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:45.976023    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e745f4b-1d80-4c19-91ae-9fbe643572de-service-ca-bundle\") pod \"router-default-848fc6765d-blcdh\" (UID: \"4e745f4b-1d80-4c19-91ae-9fbe643572de\") " pod="openshift-ingress/router-default-848fc6765d-blcdh"
Sep 07 13:00:45.976549 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:45.976531    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e745f4b-1d80-4c19-91ae-9fbe643572de-service-ca-bundle\") pod \"router-default-848fc6765d-blcdh\" (UID: \"4e745f4b-1d80-4c19-91ae-9fbe643572de\") " pod="openshift-ingress/router-default-848fc6765d-blcdh"
Sep 07 13:00:46.034362 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:46.034329    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd5f5f678-nmhgz"]
Sep 07 13:00:46.039257 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:46.039237    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd5f5f678-nmhgz"
Sep 07 13:00:46.041375 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:46.041351    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-xrn9d\""
Sep 07 13:00:46.041546 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:46.041529    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 07 13:00:46.042352 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:46.042332    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 07 13:00:46.042352 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:46.042346    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 07 13:00:46.042481 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:46.042350    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 07 13:00:46.051527 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:46.051504    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd5f5f678-nmhgz"]
Sep 07 13:00:46.134377 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:46.134345    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-9ls99\""
Sep 07 13:00:46.142661 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:46.142647    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-848fc6765d-blcdh"
Sep 07 13:00:46.177712 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:46.177686    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9c6cf2c9-352c-4595-ae6d-0b933658959f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5fd5f5f678-nmhgz\" (UID: \"9c6cf2c9-352c-4595-ae6d-0b933658959f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd5f5f678-nmhgz"
Sep 07 13:00:46.177822 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:46.177740    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwtrb\" (UniqueName: \"kubernetes.io/projected/9c6cf2c9-352c-4595-ae6d-0b933658959f-kube-api-access-gwtrb\") pod \"managed-serviceaccount-addon-agent-5fd5f5f678-nmhgz\" (UID: \"9c6cf2c9-352c-4595-ae6d-0b933658959f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd5f5f678-nmhgz"
Sep 07 13:00:46.234293 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:46.234230    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:46.279155 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:46.279120    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwtrb\" (UniqueName: \"kubernetes.io/projected/9c6cf2c9-352c-4595-ae6d-0b933658959f-kube-api-access-gwtrb\") pod \"managed-serviceaccount-addon-agent-5fd5f5f678-nmhgz\" (UID: \"9c6cf2c9-352c-4595-ae6d-0b933658959f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd5f5f678-nmhgz"
Sep 07 13:00:46.279287 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:46.279179    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9c6cf2c9-352c-4595-ae6d-0b933658959f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5fd5f5f678-nmhgz\" (UID: \"9c6cf2c9-352c-4595-ae6d-0b933658959f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd5f5f678-nmhgz"
Sep 07 13:00:46.281751 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:46.281717    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9c6cf2c9-352c-4595-ae6d-0b933658959f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5fd5f5f678-nmhgz\" (UID: \"9c6cf2c9-352c-4595-ae6d-0b933658959f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd5f5f678-nmhgz"
Sep 07 13:00:46.288824 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:46.288804    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwtrb\" (UniqueName: \"kubernetes.io/projected/9c6cf2c9-352c-4595-ae6d-0b933658959f-kube-api-access-gwtrb\") pod \"managed-serviceaccount-addon-agent-5fd5f5f678-nmhgz\" (UID: \"9c6cf2c9-352c-4595-ae6d-0b933658959f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd5f5f678-nmhgz"
Sep 07 13:00:46.338652 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:46.338614    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:46.356871 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:46.356855    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd5f5f678-nmhgz"
Sep 07 13:00:46.438550 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:46.438524    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-848fc6765d-blcdh"]
Sep 07 13:00:46.439152 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:46.439137    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:46.441987 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:00:46.441954    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e745f4b_1d80_4c19_91ae_9fbe643572de.slice/crio-6a4a23a95bc290b3fba04a9683e542437db370250404aa87a1955a3804b563cc WatchSource:0}: Error finding container 6a4a23a95bc290b3fba04a9683e542437db370250404aa87a1955a3804b563cc: Status 404 returned error can't find the container with id 6a4a23a95bc290b3fba04a9683e542437db370250404aa87a1955a3804b563cc
Sep 07 13:00:46.537100 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:46.537060    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:46.656609 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:46.656569    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd5f5f678-nmhgz"]
Sep 07 13:00:46.661064 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:00:46.661032    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c6cf2c9_352c_4595_ae6d_0b933658959f.slice/crio-9ec3625e1ad027fe1acc34ba58471f1c70e24c3aafa0e4a0e7d9eba9129d7096 WatchSource:0}: Error finding container 9ec3625e1ad027fe1acc34ba58471f1c70e24c3aafa0e4a0e7d9eba9129d7096: Status 404 returned error can't find the container with id 9ec3625e1ad027fe1acc34ba58471f1c70e24c3aafa0e4a0e7d9eba9129d7096
Sep 07 13:00:46.698957 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:46.698923    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd5f5f678-nmhgz" event={"ID":"9c6cf2c9-352c-4595-ae6d-0b933658959f","Type":"ContainerStarted","Data":"9ec3625e1ad027fe1acc34ba58471f1c70e24c3aafa0e4a0e7d9eba9129d7096"}
Sep 07 13:00:46.700732 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:46.700698    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-848fc6765d-blcdh" event={"ID":"4e745f4b-1d80-4c19-91ae-9fbe643572de","Type":"ContainerStarted","Data":"2b8c5e977cf164d0e5db764e409bf96d78547a9f356d90d9bdad5e3a988383a5"}
Sep 07 13:00:46.700879 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:46.700746    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-848fc6765d-blcdh" event={"ID":"4e745f4b-1d80-4c19-91ae-9fbe643572de","Type":"ContainerStarted","Data":"6a4a23a95bc290b3fba04a9683e542437db370250404aa87a1955a3804b563cc"}
Sep 07 13:00:46.726576 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:46.726529    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-848fc6765d-blcdh" podStartSLOduration=33.726512531 podStartE2EDuration="33.726512531s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:00:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:00:46.725667242 +0000 UTC m=+73.782548902" watchObservedRunningTime="2026-09-07 13:00:46.726512531 +0000 UTC m=+73.783394190"
Sep 07 13:00:46.815972 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:46.815899    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:46.885920 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:46.885893    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:47.143348 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:47.143320    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-848fc6765d-blcdh"
Sep 07 13:00:47.145909 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:47.145889    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-848fc6765d-blcdh"
Sep 07 13:00:47.705006 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:47.704978    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-848fc6765d-blcdh"
Sep 07 13:00:47.706456 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:47.706435    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-848fc6765d-blcdh"
Sep 07 13:00:48.274416 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:48.274379    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:48.348786 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:48.348738    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:49.590577 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:49.590502    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:49.713244 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:49.713205    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd5f5f678-nmhgz" event={"ID":"9c6cf2c9-352c-4595-ae6d-0b933658959f","Type":"ContainerStarted","Data":"654ee2090ba35f7aa0ca4671ddc0e1a3e212feec23d6389b6196af177c509d3b"}
Sep 07 13:00:49.729920 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:49.729870    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5fd5f5f678-nmhgz" podStartSLOduration=1.099556511 podStartE2EDuration="3.729853024s" totalImagesPullingTime="2.630296513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:00:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:00:49.728831552 +0000 UTC m=+76.785713235" watchObservedRunningTime="2026-09-07 13:00:49.729853024 +0000 UTC m=+76.786734682"
Sep 07 13:00:50.213661 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:50.213623    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:52.338759 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:52.338728    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:52.445231 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:52.445199    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:52.501440 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:52.501411    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-wsd6j"]
Sep 07 13:00:52.534045 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:52.534013    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-wsd6j"]
Sep 07 13:00:52.534207 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:52.534119    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-wsd6j"
Sep 07 13:00:52.536591 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:52.536567    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-lbrzz\""
Sep 07 13:00:52.537243 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:52.537226    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 07 13:00:52.538951 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:52.538925    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:52.624567 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:52.624546    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e804131e-7b54-4039-b95b-802ca1bde3da-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-wsd6j\" (UID: \"e804131e-7b54-4039-b95b-802ca1bde3da\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-wsd6j"
Sep 07 13:00:52.725024 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:52.725001    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e804131e-7b54-4039-b95b-802ca1bde3da-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-wsd6j\" (UID: \"e804131e-7b54-4039-b95b-802ca1bde3da\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-wsd6j"
Sep 07 13:00:52.727594 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:52.727567    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e804131e-7b54-4039-b95b-802ca1bde3da-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-wsd6j\" (UID: \"e804131e-7b54-4039-b95b-802ca1bde3da\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-wsd6j"
Sep 07 13:00:52.729316 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:52.729285    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:52.843428 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:52.843402    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-wsd6j"
Sep 07 13:00:53.127482 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:53.127451    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-wsd6j"]
Sep 07 13:00:53.130333 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:00:53.130306    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode804131e_7b54_4039_b95b_802ca1bde3da.slice/crio-1b51ab13ba4ee7cd9e77dfa0f0601cba731b074debd5d9af9c48c3ed40ee87a6 WatchSource:0}: Error finding container 1b51ab13ba4ee7cd9e77dfa0f0601cba731b074debd5d9af9c48c3ed40ee87a6: Status 404 returned error can't find the container with id 1b51ab13ba4ee7cd9e77dfa0f0601cba731b074debd5d9af9c48c3ed40ee87a6
Sep 07 13:00:53.727941 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:53.727902    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-wsd6j" event={"ID":"e804131e-7b54-4039-b95b-802ca1bde3da","Type":"ContainerStarted","Data":"1b51ab13ba4ee7cd9e77dfa0f0601cba731b074debd5d9af9c48c3ed40ee87a6"}
Sep 07 13:00:54.296622 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:54.296584    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:55.011651 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.011615    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:55.076735 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.076705    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f4fb8c88f-4mr95"]
Sep 07 13:00:55.079554 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.079536    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f4fb8c88f-4mr95"
Sep 07 13:00:55.082621 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.082600    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 07 13:00:55.082730 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.082710    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 07 13:00:55.082792 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.082725    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 07 13:00:55.083070 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.083049    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 07 13:00:55.083114 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.083055    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 07 13:00:55.083161 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.083133    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 07 13:00:55.083417 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.083401    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 07 13:00:55.083497 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.083402    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-lmn88\""
Sep 07 13:00:55.090878 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.090859    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f4fb8c88f-4mr95"]
Sep 07 13:00:55.242580 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.242554    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aafc3ab8-ecdd-460e-ac83-af695e0101b2-console-serving-cert\") pod \"console-5f4fb8c88f-4mr95\" (UID: \"aafc3ab8-ecdd-460e-ac83-af695e0101b2\") " pod="openshift-console/console-5f4fb8c88f-4mr95"
Sep 07 13:00:55.242726 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.242589    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aafc3ab8-ecdd-460e-ac83-af695e0101b2-service-ca\") pod \"console-5f4fb8c88f-4mr95\" (UID: \"aafc3ab8-ecdd-460e-ac83-af695e0101b2\") " pod="openshift-console/console-5f4fb8c88f-4mr95"
Sep 07 13:00:55.242726 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.242612    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aafc3ab8-ecdd-460e-ac83-af695e0101b2-console-config\") pod \"console-5f4fb8c88f-4mr95\" (UID: \"aafc3ab8-ecdd-460e-ac83-af695e0101b2\") " pod="openshift-console/console-5f4fb8c88f-4mr95"
Sep 07 13:00:55.242726 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.242674    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aafc3ab8-ecdd-460e-ac83-af695e0101b2-console-oauth-config\") pod \"console-5f4fb8c88f-4mr95\" (UID: \"aafc3ab8-ecdd-460e-ac83-af695e0101b2\") " pod="openshift-console/console-5f4fb8c88f-4mr95"
Sep 07 13:00:55.242859 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.242729    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbp5s\" (UniqueName: \"kubernetes.io/projected/aafc3ab8-ecdd-460e-ac83-af695e0101b2-kube-api-access-mbp5s\") pod \"console-5f4fb8c88f-4mr95\" (UID: \"aafc3ab8-ecdd-460e-ac83-af695e0101b2\") " pod="openshift-console/console-5f4fb8c88f-4mr95"
Sep 07 13:00:55.242859 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.242756    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aafc3ab8-ecdd-460e-ac83-af695e0101b2-oauth-serving-cert\") pod \"console-5f4fb8c88f-4mr95\" (UID: \"aafc3ab8-ecdd-460e-ac83-af695e0101b2\") " pod="openshift-console/console-5f4fb8c88f-4mr95"
Sep 07 13:00:55.343216 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.343179    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aafc3ab8-ecdd-460e-ac83-af695e0101b2-service-ca\") pod \"console-5f4fb8c88f-4mr95\" (UID: \"aafc3ab8-ecdd-460e-ac83-af695e0101b2\") " pod="openshift-console/console-5f4fb8c88f-4mr95"
Sep 07 13:00:55.343355 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.343230    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aafc3ab8-ecdd-460e-ac83-af695e0101b2-console-config\") pod \"console-5f4fb8c88f-4mr95\" (UID: \"aafc3ab8-ecdd-460e-ac83-af695e0101b2\") " pod="openshift-console/console-5f4fb8c88f-4mr95"
Sep 07 13:00:55.343355 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.343266    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aafc3ab8-ecdd-460e-ac83-af695e0101b2-console-oauth-config\") pod \"console-5f4fb8c88f-4mr95\" (UID: \"aafc3ab8-ecdd-460e-ac83-af695e0101b2\") " pod="openshift-console/console-5f4fb8c88f-4mr95"
Sep 07 13:00:55.343355 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.343302    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbp5s\" (UniqueName: \"kubernetes.io/projected/aafc3ab8-ecdd-460e-ac83-af695e0101b2-kube-api-access-mbp5s\") pod \"console-5f4fb8c88f-4mr95\" (UID: \"aafc3ab8-ecdd-460e-ac83-af695e0101b2\") " pod="openshift-console/console-5f4fb8c88f-4mr95"
Sep 07 13:00:55.343355 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.343324    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aafc3ab8-ecdd-460e-ac83-af695e0101b2-oauth-serving-cert\") pod \"console-5f4fb8c88f-4mr95\" (UID: \"aafc3ab8-ecdd-460e-ac83-af695e0101b2\") " pod="openshift-console/console-5f4fb8c88f-4mr95"
Sep 07 13:00:55.343355 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.343349    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aafc3ab8-ecdd-460e-ac83-af695e0101b2-console-serving-cert\") pod \"console-5f4fb8c88f-4mr95\" (UID: \"aafc3ab8-ecdd-460e-ac83-af695e0101b2\") " pod="openshift-console/console-5f4fb8c88f-4mr95"
Sep 07 13:00:55.344017 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.343995    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aafc3ab8-ecdd-460e-ac83-af695e0101b2-console-config\") pod \"console-5f4fb8c88f-4mr95\" (UID: \"aafc3ab8-ecdd-460e-ac83-af695e0101b2\") " pod="openshift-console/console-5f4fb8c88f-4mr95"
Sep 07 13:00:55.344107 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.344065    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aafc3ab8-ecdd-460e-ac83-af695e0101b2-service-ca\") pod \"console-5f4fb8c88f-4mr95\" (UID: \"aafc3ab8-ecdd-460e-ac83-af695e0101b2\") " pod="openshift-console/console-5f4fb8c88f-4mr95"
Sep 07 13:00:55.344107 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.344065    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aafc3ab8-ecdd-460e-ac83-af695e0101b2-oauth-serving-cert\") pod \"console-5f4fb8c88f-4mr95\" (UID: \"aafc3ab8-ecdd-460e-ac83-af695e0101b2\") " pod="openshift-console/console-5f4fb8c88f-4mr95"
Sep 07 13:00:55.345839 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.345818    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aafc3ab8-ecdd-460e-ac83-af695e0101b2-console-serving-cert\") pod \"console-5f4fb8c88f-4mr95\" (UID: \"aafc3ab8-ecdd-460e-ac83-af695e0101b2\") " pod="openshift-console/console-5f4fb8c88f-4mr95"
Sep 07 13:00:55.345945 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.345927    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aafc3ab8-ecdd-460e-ac83-af695e0101b2-console-oauth-config\") pod \"console-5f4fb8c88f-4mr95\" (UID: \"aafc3ab8-ecdd-460e-ac83-af695e0101b2\") " pod="openshift-console/console-5f4fb8c88f-4mr95"
Sep 07 13:00:55.353293 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.353272    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbp5s\" (UniqueName: \"kubernetes.io/projected/aafc3ab8-ecdd-460e-ac83-af695e0101b2-kube-api-access-mbp5s\") pod \"console-5f4fb8c88f-4mr95\" (UID: \"aafc3ab8-ecdd-460e-ac83-af695e0101b2\") " pod="openshift-console/console-5f4fb8c88f-4mr95"
Sep 07 13:00:55.388297 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.388273    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f4fb8c88f-4mr95"
Sep 07 13:00:55.536955 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.536879    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:55.606510 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.606449    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:55.674557 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.674527    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f4fb8c88f-4mr95"]
Sep 07 13:00:55.678317 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:00:55.678293    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaafc3ab8_ecdd_460e_ac83_af695e0101b2.slice/crio-907f94b5529b64d0f059845de97eae2bc57f687c12db0d6cf856517a6c18d108 WatchSource:0}: Error finding container 907f94b5529b64d0f059845de97eae2bc57f687c12db0d6cf856517a6c18d108: Status 404 returned error can't find the container with id 907f94b5529b64d0f059845de97eae2bc57f687c12db0d6cf856517a6c18d108
Sep 07 13:00:55.702647 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.702621    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hpwk6"
Sep 07 13:00:55.736523 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.736496    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-wsd6j" event={"ID":"e804131e-7b54-4039-b95b-802ca1bde3da","Type":"ContainerStarted","Data":"d7e086a6e6b6b20619c4038e647251446c51ddcec93838be06c93e69b4de5900"}
Sep 07 13:00:55.736667 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.736650    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-wsd6j"
Sep 07 13:00:55.737939 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.737912    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f4fb8c88f-4mr95" event={"ID":"aafc3ab8-ecdd-460e-ac83-af695e0101b2","Type":"ContainerStarted","Data":"907f94b5529b64d0f059845de97eae2bc57f687c12db0d6cf856517a6c18d108"}
Sep 07 13:00:55.741858 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.741840    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-wsd6j"
Sep 07 13:00:55.754628 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:55.754541    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-wsd6j" podStartSLOduration=2.026844692 podStartE2EDuration="3.754525931s" totalImagesPullingTime="1.727681239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:00:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:00:55.754487538 +0000 UTC m=+82.811369199" watchObservedRunningTime="2026-09-07 13:00:55.754525931 +0000 UTC m=+82.811407591"
Sep 07 13:00:56.210684 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:56.210640    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:56.311993 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:56.311930    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:56.542579 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:56.542463    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:56.648836 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:56.648802    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:56.861626 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:56.861541    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:58.751933 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:58.751893    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f4fb8c88f-4mr95" event={"ID":"aafc3ab8-ecdd-460e-ac83-af695e0101b2","Type":"ContainerStarted","Data":"9473ab6da37f02240ad46590f48e55e939f77557197684deb5ad82e64e488cce"}
Sep 07 13:00:58.785106 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:58.785053    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5f4fb8c88f-4mr95" podStartSLOduration=0.899151132 podStartE2EDuration="3.785033837s" totalImagesPullingTime="2.885882705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:00:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:00:58.781685885 +0000 UTC m=+85.838567544" watchObservedRunningTime="2026-09-07 13:00:58.785033837 +0000 UTC m=+85.841915497"
Sep 07 13:00:59.766288 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:59.766252    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:00:59.860628 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:00:59.860593    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:00.394515 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:00.394480    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-567c89f9c9-zc6vr"]
Sep 07 13:01:00.397645 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:00.397629    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567c89f9c9-zc6vr"
Sep 07 13:01:00.404794 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:00.404744    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 07 13:01:00.408234 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:00.408214    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-567c89f9c9-zc6vr"]
Sep 07 13:01:00.485854 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:00.485822    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b72dac0e-7d7e-4279-ac78-47a6174a16f5-console-oauth-config\") pod \"console-567c89f9c9-zc6vr\" (UID: \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\") " pod="openshift-console/console-567c89f9c9-zc6vr"
Sep 07 13:01:00.485854 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:00.485856    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b72dac0e-7d7e-4279-ac78-47a6174a16f5-console-config\") pod \"console-567c89f9c9-zc6vr\" (UID: \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\") " pod="openshift-console/console-567c89f9c9-zc6vr"
Sep 07 13:01:00.486040 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:00.485897    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b72dac0e-7d7e-4279-ac78-47a6174a16f5-oauth-serving-cert\") pod \"console-567c89f9c9-zc6vr\" (UID: \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\") " pod="openshift-console/console-567c89f9c9-zc6vr"
Sep 07 13:01:00.486040 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:00.485955    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhmgq\" (UniqueName: \"kubernetes.io/projected/b72dac0e-7d7e-4279-ac78-47a6174a16f5-kube-api-access-rhmgq\") pod \"console-567c89f9c9-zc6vr\" (UID: \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\") " pod="openshift-console/console-567c89f9c9-zc6vr"
Sep 07 13:01:00.486040 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:00.485973    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b72dac0e-7d7e-4279-ac78-47a6174a16f5-trusted-ca-bundle\") pod \"console-567c89f9c9-zc6vr\" (UID: \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\") " pod="openshift-console/console-567c89f9c9-zc6vr"
Sep 07 13:01:00.486040 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:00.485998    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b72dac0e-7d7e-4279-ac78-47a6174a16f5-console-serving-cert\") pod \"console-567c89f9c9-zc6vr\" (UID: \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\") " pod="openshift-console/console-567c89f9c9-zc6vr"
Sep 07 13:01:00.486040 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:00.486017    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b72dac0e-7d7e-4279-ac78-47a6174a16f5-service-ca\") pod \"console-567c89f9c9-zc6vr\" (UID: \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\") " pod="openshift-console/console-567c89f9c9-zc6vr"
Sep 07 13:01:00.587119 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:00.587084    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b72dac0e-7d7e-4279-ac78-47a6174a16f5-console-oauth-config\") pod \"console-567c89f9c9-zc6vr\" (UID: \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\") " pod="openshift-console/console-567c89f9c9-zc6vr"
Sep 07 13:01:00.587119 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:00.587118    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b72dac0e-7d7e-4279-ac78-47a6174a16f5-console-config\") pod \"console-567c89f9c9-zc6vr\" (UID: \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\") " pod="openshift-console/console-567c89f9c9-zc6vr"
Sep 07 13:01:00.587355 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:00.587175    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b72dac0e-7d7e-4279-ac78-47a6174a16f5-oauth-serving-cert\") pod \"console-567c89f9c9-zc6vr\" (UID: \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\") " pod="openshift-console/console-567c89f9c9-zc6vr"
Sep 07 13:01:00.587355 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:00.587196    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhmgq\" (UniqueName: \"kubernetes.io/projected/b72dac0e-7d7e-4279-ac78-47a6174a16f5-kube-api-access-rhmgq\") pod \"console-567c89f9c9-zc6vr\" (UID: \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\") " pod="openshift-console/console-567c89f9c9-zc6vr"
Sep 07 13:01:00.587355 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:00.587213    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b72dac0e-7d7e-4279-ac78-47a6174a16f5-trusted-ca-bundle\") pod \"console-567c89f9c9-zc6vr\" (UID: \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\") " pod="openshift-console/console-567c89f9c9-zc6vr"
Sep 07 13:01:00.587355 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:00.587271    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b72dac0e-7d7e-4279-ac78-47a6174a16f5-console-serving-cert\") pod \"console-567c89f9c9-zc6vr\" (UID: \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\") " pod="openshift-console/console-567c89f9c9-zc6vr"
Sep 07 13:01:00.587355 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:00.587299    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b72dac0e-7d7e-4279-ac78-47a6174a16f5-service-ca\") pod \"console-567c89f9c9-zc6vr\" (UID: \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\") " pod="openshift-console/console-567c89f9c9-zc6vr"
Sep 07 13:01:00.588163 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:00.588135    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b72dac0e-7d7e-4279-ac78-47a6174a16f5-oauth-serving-cert\") pod \"console-567c89f9c9-zc6vr\" (UID: \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\") " pod="openshift-console/console-567c89f9c9-zc6vr"
Sep 07 13:01:00.588378 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:00.588259    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b72dac0e-7d7e-4279-ac78-47a6174a16f5-console-config\") pod \"console-567c89f9c9-zc6vr\" (UID: \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\") " pod="openshift-console/console-567c89f9c9-zc6vr"
Sep 07 13:01:00.588479 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:00.588307    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b72dac0e-7d7e-4279-ac78-47a6174a16f5-service-ca\") pod \"console-567c89f9c9-zc6vr\" (UID: \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\") " pod="openshift-console/console-567c89f9c9-zc6vr"
Sep 07 13:01:00.588534 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:00.588516    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b72dac0e-7d7e-4279-ac78-47a6174a16f5-trusted-ca-bundle\") pod \"console-567c89f9c9-zc6vr\" (UID: \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\") " pod="openshift-console/console-567c89f9c9-zc6vr"
Sep 07 13:01:00.589710 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:00.589682    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b72dac0e-7d7e-4279-ac78-47a6174a16f5-console-oauth-config\") pod \"console-567c89f9c9-zc6vr\" (UID: \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\") " pod="openshift-console/console-567c89f9c9-zc6vr"
Sep 07 13:01:00.589857 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:00.589841    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b72dac0e-7d7e-4279-ac78-47a6174a16f5-console-serving-cert\") pod \"console-567c89f9c9-zc6vr\" (UID: \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\") " pod="openshift-console/console-567c89f9c9-zc6vr"
Sep 07 13:01:00.595560 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:00.595540    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhmgq\" (UniqueName: \"kubernetes.io/projected/b72dac0e-7d7e-4279-ac78-47a6174a16f5-kube-api-access-rhmgq\") pod \"console-567c89f9c9-zc6vr\" (UID: \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\") " pod="openshift-console/console-567c89f9c9-zc6vr"
Sep 07 13:01:00.707748 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:00.707660    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567c89f9c9-zc6vr"
Sep 07 13:01:00.984823 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:00.984726    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-567c89f9c9-zc6vr"]
Sep 07 13:01:00.987818 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:01:00.987789    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb72dac0e_7d7e_4279_ac78_47a6174a16f5.slice/crio-fb434afe89e4f220c07409ac3d8942eac1ec2fa0883ac62cfebb1c488550fff7 WatchSource:0}: Error finding container fb434afe89e4f220c07409ac3d8942eac1ec2fa0883ac62cfebb1c488550fff7: Status 404 returned error can't find the container with id fb434afe89e4f220c07409ac3d8942eac1ec2fa0883ac62cfebb1c488550fff7
Sep 07 13:01:01.226288 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:01.226250    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:01.326907 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:01.326806    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:01.426979 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:01.426933    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:01.765386 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:01.765346    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567c89f9c9-zc6vr" event={"ID":"b72dac0e-7d7e-4279-ac78-47a6174a16f5","Type":"ContainerStarted","Data":"9454b4a461c46096b50421ccaf0f9177b37ff1ea02bf4edb5d26f12a92e6e4fc"}
Sep 07 13:01:01.765550 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:01.765442    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567c89f9c9-zc6vr" event={"ID":"b72dac0e-7d7e-4279-ac78-47a6174a16f5","Type":"ContainerStarted","Data":"fb434afe89e4f220c07409ac3d8942eac1ec2fa0883ac62cfebb1c488550fff7"}
Sep 07 13:01:01.786922 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:01.786869    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-567c89f9c9-zc6vr" podStartSLOduration=1.786854982 podStartE2EDuration="1.786854982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:01:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:01:01.786270153 +0000 UTC m=+88.843151811" watchObservedRunningTime="2026-09-07 13:01:01.786854982 +0000 UTC m=+88.843736643"
Sep 07 13:01:04.661194 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:04.661155    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:04.759480 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:04.759443    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:04.865266 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:04.865232    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:04.952227 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:04.952146    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:05.389083 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:05.389053    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f4fb8c88f-4mr95"
Sep 07 13:01:05.389242 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:05.389112    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f4fb8c88f-4mr95"
Sep 07 13:01:05.393910 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:05.393889    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f4fb8c88f-4mr95"
Sep 07 13:01:05.783412 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:05.783340    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f4fb8c88f-4mr95"
Sep 07 13:01:05.977291 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:05.977251    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:06.076421 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:06.076343    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:08.327574 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:08.327537    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:08.428846 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:08.428815    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:08.521847 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:08.521817    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:09.587865 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:09.587824    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:09.688402 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:09.688352    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:10.554078 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:10.554046    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:10.708585 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:10.708555    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-567c89f9c9-zc6vr"
Sep 07 13:01:10.708962 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:10.708827    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-567c89f9c9-zc6vr"
Sep 07 13:01:10.713216 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:10.713196    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-567c89f9c9-zc6vr"
Sep 07 13:01:10.800704 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:10.800683    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-567c89f9c9-zc6vr"
Sep 07 13:01:10.850871 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:10.850741    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f4fb8c88f-4mr95"]
Sep 07 13:01:11.012829 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:11.012789    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:11.113147 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:11.113063    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:11.667989 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:11.667961    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fgv8s"
Sep 07 13:01:12.744702 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:12.744664    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:12.881299 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:12.881261    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:13.054615 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.054527    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:13.103097 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.103067    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-827pf"]
Sep 07 13:01:13.108798 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.108759    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-827pf"
Sep 07 13:01:13.112358 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.112335    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 07 13:01:13.112911 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.112884    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 07 13:01:13.113032 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.112913    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-zm6rm\""
Sep 07 13:01:13.113032 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.112965    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 07 13:01:13.113032 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.112966    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 07 13:01:13.113159 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.113069    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 07 13:01:13.134089 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.134068    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-827pf"]
Sep 07 13:01:13.179811 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.179788    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qw8s6"]
Sep 07 13:01:13.183648 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.183633    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qw8s6"
Sep 07 13:01:13.186358 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:01:13.186323    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"node-exporter-qw8s6\" is forbidden: User \"system:node:ip-10-0-142-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-142-74.ec2.internal' and this object" podUID="801449fb-a088-44ae-acf7-2e6da783b37e" pod="openshift-monitoring/node-exporter-qw8s6"
Sep 07 13:01:13.186647 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:01:13.186615    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"node-exporter-accelerators-collector-config\" is forbidden: User \"system:node:ip-10-0-142-74.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-142-74.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" type="*v1.ConfigMap"
Sep 07 13:01:13.186761 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:01:13.186714    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-kube-rbac-proxy-config\" is forbidden: User \"system:node:ip-10-0-142-74.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-142-74.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" type="*v1.Secret"
Sep 07 13:01:13.186898 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:01:13.186867    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-tls\" is forbidden: User \"system:node:ip-10-0-142-74.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-142-74.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" type="*v1.Secret"
Sep 07 13:01:13.186981 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:01:13.186899    2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-dockercfg-2jq42\" is forbidden: User \"system:node:ip-10-0-142-74.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-142-74.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2jq42\"" type="*v1.Secret"
Sep 07 13:01:13.240512 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.240484    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:13.273738 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.273707    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed7a2c54-2a5f-47b8-9704-5aee9061ff2d-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-827pf\" (UID: \"ed7a2c54-2a5f-47b8-9704-5aee9061ff2d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-827pf"
Sep 07 13:01:13.273890 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.273789    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed7a2c54-2a5f-47b8-9704-5aee9061ff2d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-827pf\" (UID: \"ed7a2c54-2a5f-47b8-9704-5aee9061ff2d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-827pf"
Sep 07 13:01:13.273890 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.273823    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed7a2c54-2a5f-47b8-9704-5aee9061ff2d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-827pf\" (UID: \"ed7a2c54-2a5f-47b8-9704-5aee9061ff2d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-827pf"
Sep 07 13:01:13.273890 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.273857    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqrw2\" (UniqueName: \"kubernetes.io/projected/ed7a2c54-2a5f-47b8-9704-5aee9061ff2d-kube-api-access-cqrw2\") pod \"openshift-state-metrics-657fd6c54-827pf\" (UID: \"ed7a2c54-2a5f-47b8-9704-5aee9061ff2d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-827pf"
Sep 07 13:01:13.374212 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.374180    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed7a2c54-2a5f-47b8-9704-5aee9061ff2d-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-827pf\" (UID: \"ed7a2c54-2a5f-47b8-9704-5aee9061ff2d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-827pf"
Sep 07 13:01:13.374357 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.374237    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/801449fb-a088-44ae-acf7-2e6da783b37e-node-exporter-wtmp\") pod \"node-exporter-qw8s6\" (UID: \"801449fb-a088-44ae-acf7-2e6da783b37e\") " pod="openshift-monitoring/node-exporter-qw8s6"
Sep 07 13:01:13.374357 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.374270    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/801449fb-a088-44ae-acf7-2e6da783b37e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qw8s6\" (UID: \"801449fb-a088-44ae-acf7-2e6da783b37e\") " pod="openshift-monitoring/node-exporter-qw8s6"
Sep 07 13:01:13.374357 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.374296    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdpnh\" (UniqueName: \"kubernetes.io/projected/801449fb-a088-44ae-acf7-2e6da783b37e-kube-api-access-bdpnh\") pod \"node-exporter-qw8s6\" (UID: \"801449fb-a088-44ae-acf7-2e6da783b37e\") " pod="openshift-monitoring/node-exporter-qw8s6"
Sep 07 13:01:13.374357 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.374341    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed7a2c54-2a5f-47b8-9704-5aee9061ff2d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-827pf\" (UID: \"ed7a2c54-2a5f-47b8-9704-5aee9061ff2d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-827pf"
Sep 07 13:01:13.374540 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.374373    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed7a2c54-2a5f-47b8-9704-5aee9061ff2d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-827pf\" (UID: \"ed7a2c54-2a5f-47b8-9704-5aee9061ff2d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-827pf"
Sep 07 13:01:13.374540 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.374410    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqrw2\" (UniqueName: \"kubernetes.io/projected/ed7a2c54-2a5f-47b8-9704-5aee9061ff2d-kube-api-access-cqrw2\") pod \"openshift-state-metrics-657fd6c54-827pf\" (UID: \"ed7a2c54-2a5f-47b8-9704-5aee9061ff2d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-827pf"
Sep 07 13:01:13.374540 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.374434    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/801449fb-a088-44ae-acf7-2e6da783b37e-metrics-client-ca\") pod \"node-exporter-qw8s6\" (UID: \"801449fb-a088-44ae-acf7-2e6da783b37e\") " pod="openshift-monitoring/node-exporter-qw8s6"
Sep 07 13:01:13.374540 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.374459    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/801449fb-a088-44ae-acf7-2e6da783b37e-node-exporter-accelerators-collector-config\") pod \"node-exporter-qw8s6\" (UID: \"801449fb-a088-44ae-acf7-2e6da783b37e\") " pod="openshift-monitoring/node-exporter-qw8s6"
Sep 07 13:01:13.374540 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.374484    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/801449fb-a088-44ae-acf7-2e6da783b37e-sys\") pod \"node-exporter-qw8s6\" (UID: \"801449fb-a088-44ae-acf7-2e6da783b37e\") " pod="openshift-monitoring/node-exporter-qw8s6"
Sep 07 13:01:13.374540 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.374504    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/801449fb-a088-44ae-acf7-2e6da783b37e-node-exporter-textfile\") pod \"node-exporter-qw8s6\" (UID: \"801449fb-a088-44ae-acf7-2e6da783b37e\") " pod="openshift-monitoring/node-exporter-qw8s6"
Sep 07 13:01:13.374893 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.374572    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/801449fb-a088-44ae-acf7-2e6da783b37e-node-exporter-tls\") pod \"node-exporter-qw8s6\" (UID: \"801449fb-a088-44ae-acf7-2e6da783b37e\") " pod="openshift-monitoring/node-exporter-qw8s6"
Sep 07 13:01:13.374893 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:01:13.374628    2576 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 07 13:01:13.374893 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.374695    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/801449fb-a088-44ae-acf7-2e6da783b37e-root\") pod \"node-exporter-qw8s6\" (UID: \"801449fb-a088-44ae-acf7-2e6da783b37e\") " pod="openshift-monitoring/node-exporter-qw8s6"
Sep 07 13:01:13.374893 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:01:13.374721    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed7a2c54-2a5f-47b8-9704-5aee9061ff2d-openshift-state-metrics-tls podName:ed7a2c54-2a5f-47b8-9704-5aee9061ff2d nodeName:}" failed. No retries permitted until 2026-09-07 13:01:13.874702545 +0000 UTC m=+100.931584195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ed7a2c54-2a5f-47b8-9704-5aee9061ff2d-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-827pf" (UID: "ed7a2c54-2a5f-47b8-9704-5aee9061ff2d") : secret "openshift-state-metrics-tls" not found
Sep 07 13:01:13.375066 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.375028    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ed7a2c54-2a5f-47b8-9704-5aee9061ff2d-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-827pf\" (UID: \"ed7a2c54-2a5f-47b8-9704-5aee9061ff2d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-827pf"
Sep 07 13:01:13.377341 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.377320    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ed7a2c54-2a5f-47b8-9704-5aee9061ff2d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-827pf\" (UID: \"ed7a2c54-2a5f-47b8-9704-5aee9061ff2d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-827pf"
Sep 07 13:01:13.396375 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.396349    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqrw2\" (UniqueName: \"kubernetes.io/projected/ed7a2c54-2a5f-47b8-9704-5aee9061ff2d-kube-api-access-cqrw2\") pod \"openshift-state-metrics-657fd6c54-827pf\" (UID: \"ed7a2c54-2a5f-47b8-9704-5aee9061ff2d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-827pf"
Sep 07 13:01:13.408151 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.408121    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:13.475030 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.475005    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/801449fb-a088-44ae-acf7-2e6da783b37e-node-exporter-wtmp\") pod \"node-exporter-qw8s6\" (UID: \"801449fb-a088-44ae-acf7-2e6da783b37e\") " pod="openshift-monitoring/node-exporter-qw8s6"
Sep 07 13:01:13.475153 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.475033    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/801449fb-a088-44ae-acf7-2e6da783b37e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qw8s6\" (UID: \"801449fb-a088-44ae-acf7-2e6da783b37e\") " pod="openshift-monitoring/node-exporter-qw8s6"
Sep 07 13:01:13.475153 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.475051    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdpnh\" (UniqueName: \"kubernetes.io/projected/801449fb-a088-44ae-acf7-2e6da783b37e-kube-api-access-bdpnh\") pod \"node-exporter-qw8s6\" (UID: \"801449fb-a088-44ae-acf7-2e6da783b37e\") " pod="openshift-monitoring/node-exporter-qw8s6"
Sep 07 13:01:13.475268 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.475149    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/801449fb-a088-44ae-acf7-2e6da783b37e-metrics-client-ca\") pod \"node-exporter-qw8s6\" (UID: \"801449fb-a088-44ae-acf7-2e6da783b37e\") " pod="openshift-monitoring/node-exporter-qw8s6"
Sep 07 13:01:13.475268 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.475180    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/801449fb-a088-44ae-acf7-2e6da783b37e-node-exporter-accelerators-collector-config\") pod \"node-exporter-qw8s6\" (UID: \"801449fb-a088-44ae-acf7-2e6da783b37e\") " pod="openshift-monitoring/node-exporter-qw8s6"
Sep 07 13:01:13.475268 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.475192    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/801449fb-a088-44ae-acf7-2e6da783b37e-node-exporter-wtmp\") pod \"node-exporter-qw8s6\" (UID: \"801449fb-a088-44ae-acf7-2e6da783b37e\") " pod="openshift-monitoring/node-exporter-qw8s6"
Sep 07 13:01:13.475268 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.475204    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/801449fb-a088-44ae-acf7-2e6da783b37e-sys\") pod \"node-exporter-qw8s6\" (UID: \"801449fb-a088-44ae-acf7-2e6da783b37e\") " pod="openshift-monitoring/node-exporter-qw8s6"
Sep 07 13:01:13.475268 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.475229    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/801449fb-a088-44ae-acf7-2e6da783b37e-node-exporter-textfile\") pod \"node-exporter-qw8s6\" (UID: \"801449fb-a088-44ae-acf7-2e6da783b37e\") " pod="openshift-monitoring/node-exporter-qw8s6"
Sep 07 13:01:13.475268 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.475255    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/801449fb-a088-44ae-acf7-2e6da783b37e-sys\") pod \"node-exporter-qw8s6\" (UID: \"801449fb-a088-44ae-acf7-2e6da783b37e\") " pod="openshift-monitoring/node-exporter-qw8s6"
Sep 07 13:01:13.475268 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.475260    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/801449fb-a088-44ae-acf7-2e6da783b37e-node-exporter-tls\") pod \"node-exporter-qw8s6\" (UID: \"801449fb-a088-44ae-acf7-2e6da783b37e\") " pod="openshift-monitoring/node-exporter-qw8s6"
Sep 07 13:01:13.475496 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.475303    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/801449fb-a088-44ae-acf7-2e6da783b37e-root\") pod \"node-exporter-qw8s6\" (UID: \"801449fb-a088-44ae-acf7-2e6da783b37e\") " pod="openshift-monitoring/node-exporter-qw8s6"
Sep 07 13:01:13.475496 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.475380    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/801449fb-a088-44ae-acf7-2e6da783b37e-root\") pod \"node-exporter-qw8s6\" (UID: \"801449fb-a088-44ae-acf7-2e6da783b37e\") " pod="openshift-monitoring/node-exporter-qw8s6"
Sep 07 13:01:13.475496 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.475481    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/801449fb-a088-44ae-acf7-2e6da783b37e-node-exporter-textfile\") pod \"node-exporter-qw8s6\" (UID: \"801449fb-a088-44ae-acf7-2e6da783b37e\") " pod="openshift-monitoring/node-exporter-qw8s6"
Sep 07 13:01:13.475601 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.475584    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/801449fb-a088-44ae-acf7-2e6da783b37e-metrics-client-ca\") pod \"node-exporter-qw8s6\" (UID: \"801449fb-a088-44ae-acf7-2e6da783b37e\") " pod="openshift-monitoring/node-exporter-qw8s6"
Sep 07 13:01:13.490036 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.490015    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdpnh\" (UniqueName: \"kubernetes.io/projected/801449fb-a088-44ae-acf7-2e6da783b37e-kube-api-access-bdpnh\") pod \"node-exporter-qw8s6\" (UID: \"801449fb-a088-44ae-acf7-2e6da783b37e\") " pod="openshift-monitoring/node-exporter-qw8s6"
Sep 07 13:01:13.544614 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.544574    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:13.673547 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.673465    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:13.877637 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.877603    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed7a2c54-2a5f-47b8-9704-5aee9061ff2d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-827pf\" (UID: \"ed7a2c54-2a5f-47b8-9704-5aee9061ff2d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-827pf"
Sep 07 13:01:13.880080 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:13.880061    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ed7a2c54-2a5f-47b8-9704-5aee9061ff2d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-827pf\" (UID: \"ed7a2c54-2a5f-47b8-9704-5aee9061ff2d\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-827pf"
Sep 07 13:01:14.018110 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.018033    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-827pf"
Sep 07 13:01:14.150192 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.150156    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 13:01:14.155533 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.155514    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.158724 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.158698    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 07 13:01:14.159053 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.159035    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rkqdw\""
Sep 07 13:01:14.159145 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.159079    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 07 13:01:14.159277 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.159265    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 07 13:01:14.159375 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.159345    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 07 13:01:14.159501 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.159476    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 07 13:01:14.159614 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.159567    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 07 13:01:14.159795 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.159757    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 07 13:01:14.159970 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.159957    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 07 13:01:14.162031 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.162015    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 07 13:01:14.173494 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.173470    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 07 13:01:14.176803 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.176728    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/801449fb-a088-44ae-acf7-2e6da783b37e-node-exporter-accelerators-collector-config\") pod \"node-exporter-qw8s6\" (UID: \"801449fb-a088-44ae-acf7-2e6da783b37e\") " pod="openshift-monitoring/node-exporter-qw8s6"
Sep 07 13:01:14.192697 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.192674    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 13:01:14.281041 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.280976    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pph6\" (UniqueName: \"kubernetes.io/projected/1ac6d895-9120-47ac-875f-61b200114449-kube-api-access-4pph6\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.281041 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.281009    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.281041 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.281033    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ac6d895-9120-47ac-875f-61b200114449-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.281213 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.281097    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ac6d895-9120-47ac-875f-61b200114449-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.281213 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.281174    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.281213 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.281195    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ac6d895-9120-47ac-875f-61b200114449-config-out\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.281301 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.281215    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.281301 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.281241    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-web-config\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.281301 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.281269    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ac6d895-9120-47ac-875f-61b200114449-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.281401 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.281328    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1ac6d895-9120-47ac-875f-61b200114449-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.281401 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.281366    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-config-volume\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.281401 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.281390    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.281492 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.281445    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.296863 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.296837    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-827pf"]
Sep 07 13:01:14.300058 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:01:14.300032    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded7a2c54_2a5f_47b8_9704_5aee9061ff2d.slice/crio-af57ace717132a97599162fd624da95e09a464b1b1e1629e62888be2ddd34120 WatchSource:0}: Error finding container af57ace717132a97599162fd624da95e09a464b1b1e1629e62888be2ddd34120: Status 404 returned error can't find the container with id af57ace717132a97599162fd624da95e09a464b1b1e1629e62888be2ddd34120
Sep 07 13:01:14.336513 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.336489    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2jq42\""
Sep 07 13:01:14.382373 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.382344    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1ac6d895-9120-47ac-875f-61b200114449-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.382465 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.382395    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-config-volume\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.382465 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.382424    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.382546 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.382471    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.382546 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.382513    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pph6\" (UniqueName: \"kubernetes.io/projected/1ac6d895-9120-47ac-875f-61b200114449-kube-api-access-4pph6\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.382546 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.382542    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.382684 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.382569    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ac6d895-9120-47ac-875f-61b200114449-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.382684 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.382596    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ac6d895-9120-47ac-875f-61b200114449-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.382684 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.382640    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.382684 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.382666    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ac6d895-9120-47ac-875f-61b200114449-config-out\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.382926 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.382692    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.382926 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.382715    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-web-config\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.382926 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.382726    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1ac6d895-9120-47ac-875f-61b200114449-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.382926 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.382740    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ac6d895-9120-47ac-875f-61b200114449-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.383426 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.383403    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ac6d895-9120-47ac-875f-61b200114449-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.383926 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.383857    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ac6d895-9120-47ac-875f-61b200114449-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.385509 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.385467    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-config-volume\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.386048 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.386028    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.386351 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.386303    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ac6d895-9120-47ac-875f-61b200114449-config-out\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.387671 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.387627    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.387671 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.387640    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ac6d895-9120-47ac-875f-61b200114449-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.387851 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.387723    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.387851 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.387810    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-web-config\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.388391 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.388361    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.389239 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.389221    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.392677 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.392653    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pph6\" (UniqueName: \"kubernetes.io/projected/1ac6d895-9120-47ac-875f-61b200114449-kube-api-access-4pph6\") pod \"alertmanager-main-0\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.405490 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.405471    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 07 13:01:14.417972 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.417954    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/801449fb-a088-44ae-acf7-2e6da783b37e-node-exporter-tls\") pod \"node-exporter-qw8s6\" (UID: \"801449fb-a088-44ae-acf7-2e6da783b37e\") " pod="openshift-monitoring/node-exporter-qw8s6"
Sep 07 13:01:14.465241 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.465217    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:01:14.475320 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:01:14.475296    2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-kube-rbac-proxy-config: failed to sync secret cache: timed out waiting for the condition
Sep 07 13:01:14.475420 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:01:14.475380    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/801449fb-a088-44ae-acf7-2e6da783b37e-node-exporter-kube-rbac-proxy-config podName:801449fb-a088-44ae-acf7-2e6da783b37e nodeName:}" failed. No retries permitted until 2026-09-07 13:01:14.975359913 +0000 UTC m=+102.032241565 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-kube-rbac-proxy-config" (UniqueName: "kubernetes.io/secret/801449fb-a088-44ae-acf7-2e6da783b37e-node-exporter-kube-rbac-proxy-config") pod "node-exporter-qw8s6" (UID: "801449fb-a088-44ae-acf7-2e6da783b37e") : failed to sync secret cache: timed out waiting for the condition
Sep 07 13:01:14.751873 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.751840    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 07 13:01:14.753896 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.753878    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 13:01:14.755861 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:01:14.755836    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ac6d895_9120_47ac_875f_61b200114449.slice/crio-f170b10421c124f6623f36361a99ca176a3cf0ca777da1f894244c72903f1d61 WatchSource:0}: Error finding container f170b10421c124f6623f36361a99ca176a3cf0ca777da1f894244c72903f1d61: Status 404 returned error can't find the container with id f170b10421c124f6623f36361a99ca176a3cf0ca777da1f894244c72903f1d61
Sep 07 13:01:14.814675 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.814638    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ac6d895-9120-47ac-875f-61b200114449","Type":"ContainerStarted","Data":"f170b10421c124f6623f36361a99ca176a3cf0ca777da1f894244c72903f1d61"}
Sep 07 13:01:14.816305 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.816286    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-827pf" event={"ID":"ed7a2c54-2a5f-47b8-9704-5aee9061ff2d","Type":"ContainerStarted","Data":"02e71c617e109bd256ba90b9a9de44296a2a638e0d11ffd3b8cffe23d2fd17b9"}
Sep 07 13:01:14.816398 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.816335    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-827pf" event={"ID":"ed7a2c54-2a5f-47b8-9704-5aee9061ff2d","Type":"ContainerStarted","Data":"7549c0bf043484bba9220b3d631b5b22165d8eb049ef0d6d87bb442b6adada0c"}
Sep 07 13:01:14.816398 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.816357    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-827pf" event={"ID":"ed7a2c54-2a5f-47b8-9704-5aee9061ff2d","Type":"ContainerStarted","Data":"af57ace717132a97599162fd624da95e09a464b1b1e1629e62888be2ddd34120"}
Sep 07 13:01:14.946430 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.946401    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:14.989384 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.989354    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/801449fb-a088-44ae-acf7-2e6da783b37e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qw8s6\" (UID: \"801449fb-a088-44ae-acf7-2e6da783b37e\") " pod="openshift-monitoring/node-exporter-qw8s6"
Sep 07 13:01:14.991749 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:14.991724    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/801449fb-a088-44ae-acf7-2e6da783b37e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qw8s6\" (UID: \"801449fb-a088-44ae-acf7-2e6da783b37e\") " pod="openshift-monitoring/node-exporter-qw8s6"
Sep 07 13:01:15.291985 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:15.291950    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qw8s6"
Sep 07 13:01:15.302815 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:01:15.302760    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod801449fb_a088_44ae_acf7_2e6da783b37e.slice/crio-a851bc1f0ab2bc7a6845d519c58843d70ac2845a3a3939f5f6f8da92cc4618cc WatchSource:0}: Error finding container a851bc1f0ab2bc7a6845d519c58843d70ac2845a3a3939f5f6f8da92cc4618cc: Status 404 returned error can't find the container with id a851bc1f0ab2bc7a6845d519c58843d70ac2845a3a3939f5f6f8da92cc4618cc
Sep 07 13:01:15.673475 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:15.673441    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:15.823544 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:15.823497    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-827pf" event={"ID":"ed7a2c54-2a5f-47b8-9704-5aee9061ff2d","Type":"ContainerStarted","Data":"75118ebfd9081a6c12d3dd87832c7c341d352a19391141c5d38088c81b1e4928"}
Sep 07 13:01:15.825234 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:15.825192    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qw8s6" event={"ID":"801449fb-a088-44ae-acf7-2e6da783b37e","Type":"ContainerStarted","Data":"a851bc1f0ab2bc7a6845d519c58843d70ac2845a3a3939f5f6f8da92cc4618cc"}
Sep 07 13:01:15.826497 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:15.826474    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:15.924573 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:15.924478    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:16.126951 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:16.126865    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:16.299000 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:16.298976    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:16.831175 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:16.831134    2576 generic.go:356] "Generic (PLEG): container finished" podID="801449fb-a088-44ae-acf7-2e6da783b37e" containerID="6b743caf20536a6de817575cb3d71953db54de71900ac92be3cd645982b1242d" exitCode=0
Sep 07 13:01:16.831362 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:16.831225    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qw8s6" event={"ID":"801449fb-a088-44ae-acf7-2e6da783b37e","Type":"ContainerDied","Data":"6b743caf20536a6de817575cb3d71953db54de71900ac92be3cd645982b1242d"}
Sep 07 13:01:16.832946 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:16.832922    2576 generic.go:356] "Generic (PLEG): container finished" podID="1ac6d895-9120-47ac-875f-61b200114449" containerID="95f24f99339a24569a6523cdc32ec4cdda0b450ee1e27e3a85901c9ebc7c5450" exitCode=0
Sep 07 13:01:16.833077 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:16.833009    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ac6d895-9120-47ac-875f-61b200114449","Type":"ContainerDied","Data":"95f24f99339a24569a6523cdc32ec4cdda0b450ee1e27e3a85901c9ebc7c5450"}
Sep 07 13:01:16.853807 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:16.853742    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-827pf" podStartSLOduration=2.662740543 podStartE2EDuration="3.853724624s" totalImagesPullingTime="1.190984081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:01:15.852272313 +0000 UTC m=+102.909153985" watchObservedRunningTime="2026-09-07 13:01:16.853724624 +0000 UTC m=+103.910606283"
Sep 07 13:01:16.907860 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:16.907831    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:17.806997 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:17.806966    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6f447977d6-dssfr"]
Sep 07 13:01:17.822261 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:17.822235    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f447977d6-dssfr"
Sep 07 13:01:17.833383 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:17.833360    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f447977d6-dssfr"]
Sep 07 13:01:17.839391 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:17.839362    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qw8s6" event={"ID":"801449fb-a088-44ae-acf7-2e6da783b37e","Type":"ContainerStarted","Data":"5adb24dd997e1de9da946ed42cf9408428d9ffc996a9e5927e07165360f0cc26"}
Sep 07 13:01:17.839500 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:17.839427    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qw8s6" event={"ID":"801449fb-a088-44ae-acf7-2e6da783b37e","Type":"ContainerStarted","Data":"e927b22767962c04d63c5c5401f6949ccff3a52c8ee4d56a901a7ff4e527d693"}
Sep 07 13:01:17.891485 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:17.891433    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qw8s6" podStartSLOduration=3.845113358 podStartE2EDuration="4.891417194s" totalImagesPullingTime="963.894045ms" totalInitContainerRuntime="82.409791ms" isStatefulPod=true podCreationTimestamp="2026-09-07 13:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:01:17.889755738 +0000 UTC m=+104.946637397" watchObservedRunningTime="2026-09-07 13:01:17.891417194 +0000 UTC m=+104.948298852"
Sep 07 13:01:18.014682 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:18.014653    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-console-oauth-config\") pod \"console-6f447977d6-dssfr\" (UID: \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\") " pod="openshift-console/console-6f447977d6-dssfr"
Sep 07 13:01:18.014878 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:18.014702    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-service-ca\") pod \"console-6f447977d6-dssfr\" (UID: \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\") " pod="openshift-console/console-6f447977d6-dssfr"
Sep 07 13:01:18.014878 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:18.014732    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-console-serving-cert\") pod \"console-6f447977d6-dssfr\" (UID: \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\") " pod="openshift-console/console-6f447977d6-dssfr"
Sep 07 13:01:18.014878 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:18.014754    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsscr\" (UniqueName: \"kubernetes.io/projected/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-kube-api-access-gsscr\") pod \"console-6f447977d6-dssfr\" (UID: \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\") " pod="openshift-console/console-6f447977d6-dssfr"
Sep 07 13:01:18.014878 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:18.014847    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-trusted-ca-bundle\") pod \"console-6f447977d6-dssfr\" (UID: \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\") " pod="openshift-console/console-6f447977d6-dssfr"
Sep 07 13:01:18.015034 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:18.014882    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-oauth-serving-cert\") pod \"console-6f447977d6-dssfr\" (UID: \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\") " pod="openshift-console/console-6f447977d6-dssfr"
Sep 07 13:01:18.015034 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:18.014924    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-console-config\") pod \"console-6f447977d6-dssfr\" (UID: \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\") " pod="openshift-console/console-6f447977d6-dssfr"
Sep 07 13:01:18.115645 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:18.115565    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-console-config\") pod \"console-6f447977d6-dssfr\" (UID: \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\") " pod="openshift-console/console-6f447977d6-dssfr"
Sep 07 13:01:18.115645 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:18.115641    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-console-oauth-config\") pod \"console-6f447977d6-dssfr\" (UID: \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\") " pod="openshift-console/console-6f447977d6-dssfr"
Sep 07 13:01:18.115876 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:18.115686    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-service-ca\") pod \"console-6f447977d6-dssfr\" (UID: \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\") " pod="openshift-console/console-6f447977d6-dssfr"
Sep 07 13:01:18.115876 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:18.115730    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-console-serving-cert\") pod \"console-6f447977d6-dssfr\" (UID: \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\") " pod="openshift-console/console-6f447977d6-dssfr"
Sep 07 13:01:18.115876 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:18.115756    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsscr\" (UniqueName: \"kubernetes.io/projected/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-kube-api-access-gsscr\") pod \"console-6f447977d6-dssfr\" (UID: \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\") " pod="openshift-console/console-6f447977d6-dssfr"
Sep 07 13:01:18.115876 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:18.115823    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-trusted-ca-bundle\") pod \"console-6f447977d6-dssfr\" (UID: \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\") " pod="openshift-console/console-6f447977d6-dssfr"
Sep 07 13:01:18.115876 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:18.115857    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-oauth-serving-cert\") pod \"console-6f447977d6-dssfr\" (UID: \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\") " pod="openshift-console/console-6f447977d6-dssfr"
Sep 07 13:01:18.116416 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:18.116366    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-console-config\") pod \"console-6f447977d6-dssfr\" (UID: \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\") " pod="openshift-console/console-6f447977d6-dssfr"
Sep 07 13:01:18.116711 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:18.116545    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-oauth-serving-cert\") pod \"console-6f447977d6-dssfr\" (UID: \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\") " pod="openshift-console/console-6f447977d6-dssfr"
Sep 07 13:01:18.116711 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:18.116618    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-service-ca\") pod \"console-6f447977d6-dssfr\" (UID: \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\") " pod="openshift-console/console-6f447977d6-dssfr"
Sep 07 13:01:18.117151 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:18.117124    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-trusted-ca-bundle\") pod \"console-6f447977d6-dssfr\" (UID: \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\") " pod="openshift-console/console-6f447977d6-dssfr"
Sep 07 13:01:18.118456 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:18.118435    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-console-oauth-config\") pod \"console-6f447977d6-dssfr\" (UID: \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\") " pod="openshift-console/console-6f447977d6-dssfr"
Sep 07 13:01:18.118545 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:18.118523    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-console-serving-cert\") pod \"console-6f447977d6-dssfr\" (UID: \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\") " pod="openshift-console/console-6f447977d6-dssfr"
Sep 07 13:01:18.126896 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:18.126875    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsscr\" (UniqueName: \"kubernetes.io/projected/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-kube-api-access-gsscr\") pod \"console-6f447977d6-dssfr\" (UID: \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\") " pod="openshift-console/console-6f447977d6-dssfr"
Sep 07 13:01:18.131716 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:18.131693    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f447977d6-dssfr"
Sep 07 13:01:18.444502 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:18.444471    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6f447977d6-dssfr"]
Sep 07 13:01:18.448547 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:01:18.448523    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31b49ded_a917_4cf4_8a0c_1ecbf7576e4a.slice/crio-e355ee759d8a80a6001039f681acc316fd4f31a316d65092a2e2db53eea6219a WatchSource:0}: Error finding container e355ee759d8a80a6001039f681acc316fd4f31a316d65092a2e2db53eea6219a: Status 404 returned error can't find the container with id e355ee759d8a80a6001039f681acc316fd4f31a316d65092a2e2db53eea6219a
Sep 07 13:01:18.458373 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:18.458339    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:18.548488 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:18.548461    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:18.848695 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:18.848606    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f447977d6-dssfr" event={"ID":"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a","Type":"ContainerStarted","Data":"1103cd990c2e2768a86f803285a60f59e3910c877f9deb6734cbdf1a4b1411d3"}
Sep 07 13:01:18.848695 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:18.848684    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f447977d6-dssfr" event={"ID":"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a","Type":"ContainerStarted","Data":"e355ee759d8a80a6001039f681acc316fd4f31a316d65092a2e2db53eea6219a"}
Sep 07 13:01:18.870185 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:18.870133    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6f447977d6-dssfr" podStartSLOduration=1.870119133 podStartE2EDuration="1.870119133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:01:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:01:18.869105281 +0000 UTC m=+105.925986940" watchObservedRunningTime="2026-09-07 13:01:18.870119133 +0000 UTC m=+105.927000853"
Sep 07 13:01:19.427981 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:19.427946    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:20.860085 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:20.860047    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ac6d895-9120-47ac-875f-61b200114449","Type":"ContainerStarted","Data":"2fc99cdb19fa4e622e50a1a65cda9a25e24ac38e8aa69d278dafaf2d1e68e573"}
Sep 07 13:01:20.860441 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:20.860114    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ac6d895-9120-47ac-875f-61b200114449","Type":"ContainerStarted","Data":"e07561c76aaca2836c9d81ae30a2f2c2492d463de534f1898a0f26a6ba430427"}
Sep 07 13:01:20.860441 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:20.860141    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ac6d895-9120-47ac-875f-61b200114449","Type":"ContainerStarted","Data":"1606215774a866d59f937e8ea6468b6aff629243e9075232575f7d371a20ec99"}
Sep 07 13:01:20.860441 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:20.860164    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ac6d895-9120-47ac-875f-61b200114449","Type":"ContainerStarted","Data":"9c0333fcabaab87a4181efc8651da124530a88ccaddc4ef840121d9ff64865bd"}
Sep 07 13:01:20.860441 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:20.860186    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ac6d895-9120-47ac-875f-61b200114449","Type":"ContainerStarted","Data":"536446be9d6f9c30d8df0d0ed66a8bcdb48ae2d9e463640823a83cdec103a0c3"}
Sep 07 13:01:22.870872 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:22.870835    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ac6d895-9120-47ac-875f-61b200114449","Type":"ContainerStarted","Data":"82fd490d47f76fd2cf04d04cbe157bfbb20d688f4a888a108d7ca2fb45afed88"}
Sep 07 13:01:22.907751 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:22.907706    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.4156591929999998 podStartE2EDuration="8.907689478s" totalImagesPullingTime="6.466678688s" totalInitContainerRuntime="25.351597ms" isStatefulPod=false podCreationTimestamp="2026-09-07 13:01:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:01:22.904530665 +0000 UTC m=+109.961412323" watchObservedRunningTime="2026-09-07 13:01:22.907689478 +0000 UTC m=+109.964571137"
Sep 07 13:01:24.564661 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:24.564624    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:24.643657 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:24.643625    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:27.935820 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:27.935758    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:28.044349 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:28.044315    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:28.132444 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:28.132410    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6f447977d6-dssfr"
Sep 07 13:01:28.132586 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:28.132480    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6f447977d6-dssfr"
Sep 07 13:01:28.137381 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:28.137352    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6f447977d6-dssfr"
Sep 07 13:01:28.225716 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:28.225638    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:28.898970 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:28.898941    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6f447977d6-dssfr"
Sep 07 13:01:28.967441 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:28.967391    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-567c89f9c9-zc6vr"]
Sep 07 13:01:29.120515 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:29.120469    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:29.259680 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:29.259589    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:29.359956 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:29.359918    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:35.872603 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:35.872555    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5f4fb8c88f-4mr95" podUID="aafc3ab8-ecdd-460e-ac83-af695e0101b2" containerName="console" containerID="cri-o://9473ab6da37f02240ad46590f48e55e939f77557197684deb5ad82e64e488cce" gracePeriod=15
Sep 07 13:01:36.110980 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:36.110950    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f4fb8c88f-4mr95"
Sep 07 13:01:36.151382 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:36.151351    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbp5s\" (UniqueName: \"kubernetes.io/projected/aafc3ab8-ecdd-460e-ac83-af695e0101b2-kube-api-access-mbp5s\") pod \"aafc3ab8-ecdd-460e-ac83-af695e0101b2\" (UID: \"aafc3ab8-ecdd-460e-ac83-af695e0101b2\") "
Sep 07 13:01:36.151575 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:36.151400    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aafc3ab8-ecdd-460e-ac83-af695e0101b2-service-ca\") pod \"aafc3ab8-ecdd-460e-ac83-af695e0101b2\" (UID: \"aafc3ab8-ecdd-460e-ac83-af695e0101b2\") "
Sep 07 13:01:36.151575 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:36.151457    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aafc3ab8-ecdd-460e-ac83-af695e0101b2-oauth-serving-cert\") pod \"aafc3ab8-ecdd-460e-ac83-af695e0101b2\" (UID: \"aafc3ab8-ecdd-460e-ac83-af695e0101b2\") "
Sep 07 13:01:36.151575 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:36.151488    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aafc3ab8-ecdd-460e-ac83-af695e0101b2-console-serving-cert\") pod \"aafc3ab8-ecdd-460e-ac83-af695e0101b2\" (UID: \"aafc3ab8-ecdd-460e-ac83-af695e0101b2\") "
Sep 07 13:01:36.151575 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:36.151506    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aafc3ab8-ecdd-460e-ac83-af695e0101b2-console-oauth-config\") pod \"aafc3ab8-ecdd-460e-ac83-af695e0101b2\" (UID: \"aafc3ab8-ecdd-460e-ac83-af695e0101b2\") "
Sep 07 13:01:36.151575 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:36.151529    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aafc3ab8-ecdd-460e-ac83-af695e0101b2-console-config\") pod \"aafc3ab8-ecdd-460e-ac83-af695e0101b2\" (UID: \"aafc3ab8-ecdd-460e-ac83-af695e0101b2\") "
Sep 07 13:01:36.151925 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:36.151890    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aafc3ab8-ecdd-460e-ac83-af695e0101b2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "aafc3ab8-ecdd-460e-ac83-af695e0101b2" (UID: "aafc3ab8-ecdd-460e-ac83-af695e0101b2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:01:36.152052 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:36.151926    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aafc3ab8-ecdd-460e-ac83-af695e0101b2-service-ca" (OuterVolumeSpecName: "service-ca") pod "aafc3ab8-ecdd-460e-ac83-af695e0101b2" (UID: "aafc3ab8-ecdd-460e-ac83-af695e0101b2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:01:36.152233 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:36.152187    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aafc3ab8-ecdd-460e-ac83-af695e0101b2-console-config" (OuterVolumeSpecName: "console-config") pod "aafc3ab8-ecdd-460e-ac83-af695e0101b2" (UID: "aafc3ab8-ecdd-460e-ac83-af695e0101b2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:01:36.154062 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:36.154032    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aafc3ab8-ecdd-460e-ac83-af695e0101b2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "aafc3ab8-ecdd-460e-ac83-af695e0101b2" (UID: "aafc3ab8-ecdd-460e-ac83-af695e0101b2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:01:36.154062 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:36.154046    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aafc3ab8-ecdd-460e-ac83-af695e0101b2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "aafc3ab8-ecdd-460e-ac83-af695e0101b2" (UID: "aafc3ab8-ecdd-460e-ac83-af695e0101b2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:01:36.154235 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:36.154077    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aafc3ab8-ecdd-460e-ac83-af695e0101b2-kube-api-access-mbp5s" (OuterVolumeSpecName: "kube-api-access-mbp5s") pod "aafc3ab8-ecdd-460e-ac83-af695e0101b2" (UID: "aafc3ab8-ecdd-460e-ac83-af695e0101b2"). InnerVolumeSpecName "kube-api-access-mbp5s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:01:36.253069 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:36.253027    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/aafc3ab8-ecdd-460e-ac83-af695e0101b2-console-config\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:01:36.253069 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:36.253063    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbp5s\" (UniqueName: \"kubernetes.io/projected/aafc3ab8-ecdd-460e-ac83-af695e0101b2-kube-api-access-mbp5s\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:01:36.253069 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:36.253078    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/aafc3ab8-ecdd-460e-ac83-af695e0101b2-service-ca\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:01:36.253285 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:36.253087    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/aafc3ab8-ecdd-460e-ac83-af695e0101b2-oauth-serving-cert\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:01:36.253285 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:36.253097    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/aafc3ab8-ecdd-460e-ac83-af695e0101b2-console-serving-cert\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:01:36.253285 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:36.253104    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/aafc3ab8-ecdd-460e-ac83-af695e0101b2-console-oauth-config\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:01:36.924987 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:36.924948    2576 generic.go:356] "Generic (PLEG): container finished" podID="aafc3ab8-ecdd-460e-ac83-af695e0101b2" containerID="9473ab6da37f02240ad46590f48e55e939f77557197684deb5ad82e64e488cce" exitCode=0
Sep 07 13:01:36.925420 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:36.925011    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f4fb8c88f-4mr95"
Sep 07 13:01:36.925420 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:36.925032    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f4fb8c88f-4mr95" event={"ID":"aafc3ab8-ecdd-460e-ac83-af695e0101b2","Type":"ContainerDied","Data":"9473ab6da37f02240ad46590f48e55e939f77557197684deb5ad82e64e488cce"}
Sep 07 13:01:36.925420 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:36.925108    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f4fb8c88f-4mr95" event={"ID":"aafc3ab8-ecdd-460e-ac83-af695e0101b2","Type":"ContainerDied","Data":"907f94b5529b64d0f059845de97eae2bc57f687c12db0d6cf856517a6c18d108"}
Sep 07 13:01:36.925420 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:36.925130    2576 scope.go:117] "RemoveContainer" containerID="9473ab6da37f02240ad46590f48e55e939f77557197684deb5ad82e64e488cce"
Sep 07 13:01:36.933744 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:36.933726    2576 scope.go:117] "RemoveContainer" containerID="9473ab6da37f02240ad46590f48e55e939f77557197684deb5ad82e64e488cce"
Sep 07 13:01:36.934037 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:01:36.934009    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9473ab6da37f02240ad46590f48e55e939f77557197684deb5ad82e64e488cce\": container with ID starting with 9473ab6da37f02240ad46590f48e55e939f77557197684deb5ad82e64e488cce not found: ID does not exist" containerID="9473ab6da37f02240ad46590f48e55e939f77557197684deb5ad82e64e488cce"
Sep 07 13:01:36.934106 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:36.934050    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9473ab6da37f02240ad46590f48e55e939f77557197684deb5ad82e64e488cce"} err="failed to get container status \"9473ab6da37f02240ad46590f48e55e939f77557197684deb5ad82e64e488cce\": rpc error: code = NotFound desc = could not find container \"9473ab6da37f02240ad46590f48e55e939f77557197684deb5ad82e64e488cce\": container with ID starting with 9473ab6da37f02240ad46590f48e55e939f77557197684deb5ad82e64e488cce not found: ID does not exist"
Sep 07 13:01:36.948850 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:36.948826    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5f4fb8c88f-4mr95"]
Sep 07 13:01:36.951940 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:36.951920    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5f4fb8c88f-4mr95"]
Sep 07 13:01:37.365261 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:37.365170    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aafc3ab8-ecdd-460e-ac83-af695e0101b2" path="/var/lib/kubelet/pods/aafc3ab8-ecdd-460e-ac83-af695e0101b2/volumes"
Sep 07 13:01:39.597646 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:39.597612    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:39.673142 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:39.673108    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:01:41.947737 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:41.947702    2576 generic.go:356] "Generic (PLEG): container finished" podID="9a2c14fb-81d2-4056-bf98-ac72b0b69aae" containerID="c654132cd19f7e0d73acb7a17d7f98d84b2f40741805f02f67fe7ddcfa715d27" exitCode=0
Sep 07 13:01:41.948109 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:41.947792    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-hk2dx" event={"ID":"9a2c14fb-81d2-4056-bf98-ac72b0b69aae","Type":"ContainerDied","Data":"c654132cd19f7e0d73acb7a17d7f98d84b2f40741805f02f67fe7ddcfa715d27"}
Sep 07 13:01:41.948154 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:41.948121    2576 scope.go:117] "RemoveContainer" containerID="c654132cd19f7e0d73acb7a17d7f98d84b2f40741805f02f67fe7ddcfa715d27"
Sep 07 13:01:42.954303 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:42.954264    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-hk2dx" event={"ID":"9a2c14fb-81d2-4056-bf98-ac72b0b69aae","Type":"ContainerStarted","Data":"5e513658344b445b68240c941e9873a1b93336047958f9f0fa475979f27c38a2"}
Sep 07 13:01:53.989982 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:53.989939    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-567c89f9c9-zc6vr" podUID="b72dac0e-7d7e-4279-ac78-47a6174a16f5" containerName="console" containerID="cri-o://9454b4a461c46096b50421ccaf0f9177b37ff1ea02bf4edb5d26f12a92e6e4fc" gracePeriod=15
Sep 07 13:01:54.257995 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:54.257965    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567c89f9c9-zc6vr"
Sep 07 13:01:54.394900 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:54.394869    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhmgq\" (UniqueName: \"kubernetes.io/projected/b72dac0e-7d7e-4279-ac78-47a6174a16f5-kube-api-access-rhmgq\") pod \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\" (UID: \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\") "
Sep 07 13:01:54.395061 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:54.394931    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b72dac0e-7d7e-4279-ac78-47a6174a16f5-console-oauth-config\") pod \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\" (UID: \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\") "
Sep 07 13:01:54.395061 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:54.394966    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b72dac0e-7d7e-4279-ac78-47a6174a16f5-oauth-serving-cert\") pod \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\" (UID: \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\") "
Sep 07 13:01:54.395061 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:54.394990    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b72dac0e-7d7e-4279-ac78-47a6174a16f5-service-ca\") pod \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\" (UID: \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\") "
Sep 07 13:01:54.395061 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:54.395013    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b72dac0e-7d7e-4279-ac78-47a6174a16f5-console-serving-cert\") pod \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\" (UID: \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\") "
Sep 07 13:01:54.395061 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:54.395050    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b72dac0e-7d7e-4279-ac78-47a6174a16f5-console-config\") pod \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\" (UID: \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\") "
Sep 07 13:01:54.395300 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:54.395077    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b72dac0e-7d7e-4279-ac78-47a6174a16f5-trusted-ca-bundle\") pod \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\" (UID: \"b72dac0e-7d7e-4279-ac78-47a6174a16f5\") "
Sep 07 13:01:54.395379 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:54.395342    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b72dac0e-7d7e-4279-ac78-47a6174a16f5-service-ca" (OuterVolumeSpecName: "service-ca") pod "b72dac0e-7d7e-4279-ac78-47a6174a16f5" (UID: "b72dac0e-7d7e-4279-ac78-47a6174a16f5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:01:54.395448 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:54.395350    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b72dac0e-7d7e-4279-ac78-47a6174a16f5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b72dac0e-7d7e-4279-ac78-47a6174a16f5" (UID: "b72dac0e-7d7e-4279-ac78-47a6174a16f5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:01:54.395537 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:54.395512    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b72dac0e-7d7e-4279-ac78-47a6174a16f5-console-config" (OuterVolumeSpecName: "console-config") pod "b72dac0e-7d7e-4279-ac78-47a6174a16f5" (UID: "b72dac0e-7d7e-4279-ac78-47a6174a16f5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:01:54.395858 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:54.395755    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b72dac0e-7d7e-4279-ac78-47a6174a16f5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b72dac0e-7d7e-4279-ac78-47a6174a16f5" (UID: "b72dac0e-7d7e-4279-ac78-47a6174a16f5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:01:54.397683 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:54.397652    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b72dac0e-7d7e-4279-ac78-47a6174a16f5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b72dac0e-7d7e-4279-ac78-47a6174a16f5" (UID: "b72dac0e-7d7e-4279-ac78-47a6174a16f5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:01:54.397683 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:54.397661    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b72dac0e-7d7e-4279-ac78-47a6174a16f5-kube-api-access-rhmgq" (OuterVolumeSpecName: "kube-api-access-rhmgq") pod "b72dac0e-7d7e-4279-ac78-47a6174a16f5" (UID: "b72dac0e-7d7e-4279-ac78-47a6174a16f5"). InnerVolumeSpecName "kube-api-access-rhmgq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:01:54.397848 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:54.397826    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b72dac0e-7d7e-4279-ac78-47a6174a16f5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b72dac0e-7d7e-4279-ac78-47a6174a16f5" (UID: "b72dac0e-7d7e-4279-ac78-47a6174a16f5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:01:54.496892 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:54.496819    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b72dac0e-7d7e-4279-ac78-47a6174a16f5-console-oauth-config\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:01:54.496892 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:54.496851    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b72dac0e-7d7e-4279-ac78-47a6174a16f5-oauth-serving-cert\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:01:54.496892 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:54.496866    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b72dac0e-7d7e-4279-ac78-47a6174a16f5-service-ca\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:01:54.496892 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:54.496880    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b72dac0e-7d7e-4279-ac78-47a6174a16f5-console-serving-cert\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:01:54.496892 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:54.496894    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b72dac0e-7d7e-4279-ac78-47a6174a16f5-console-config\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:01:54.497145 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:54.496907    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b72dac0e-7d7e-4279-ac78-47a6174a16f5-trusted-ca-bundle\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:01:54.497145 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:54.496920    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhmgq\" (UniqueName: \"kubernetes.io/projected/b72dac0e-7d7e-4279-ac78-47a6174a16f5-kube-api-access-rhmgq\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:01:55.002880 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:55.002843    2576 generic.go:356] "Generic (PLEG): container finished" podID="b72dac0e-7d7e-4279-ac78-47a6174a16f5" containerID="9454b4a461c46096b50421ccaf0f9177b37ff1ea02bf4edb5d26f12a92e6e4fc" exitCode=0
Sep 07 13:01:55.003495 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:55.003469    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567c89f9c9-zc6vr" event={"ID":"b72dac0e-7d7e-4279-ac78-47a6174a16f5","Type":"ContainerDied","Data":"9454b4a461c46096b50421ccaf0f9177b37ff1ea02bf4edb5d26f12a92e6e4fc"}
Sep 07 13:01:55.003656 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:55.003639    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-567c89f9c9-zc6vr" event={"ID":"b72dac0e-7d7e-4279-ac78-47a6174a16f5","Type":"ContainerDied","Data":"fb434afe89e4f220c07409ac3d8942eac1ec2fa0883ac62cfebb1c488550fff7"}
Sep 07 13:01:55.003790 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:55.003758    2576 scope.go:117] "RemoveContainer" containerID="9454b4a461c46096b50421ccaf0f9177b37ff1ea02bf4edb5d26f12a92e6e4fc"
Sep 07 13:01:55.004074 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:55.004057    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-567c89f9c9-zc6vr"
Sep 07 13:01:55.027394 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:55.027370    2576 scope.go:117] "RemoveContainer" containerID="9454b4a461c46096b50421ccaf0f9177b37ff1ea02bf4edb5d26f12a92e6e4fc"
Sep 07 13:01:55.027703 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:01:55.027682    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9454b4a461c46096b50421ccaf0f9177b37ff1ea02bf4edb5d26f12a92e6e4fc\": container with ID starting with 9454b4a461c46096b50421ccaf0f9177b37ff1ea02bf4edb5d26f12a92e6e4fc not found: ID does not exist" containerID="9454b4a461c46096b50421ccaf0f9177b37ff1ea02bf4edb5d26f12a92e6e4fc"
Sep 07 13:01:55.027808 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:55.027717    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9454b4a461c46096b50421ccaf0f9177b37ff1ea02bf4edb5d26f12a92e6e4fc"} err="failed to get container status \"9454b4a461c46096b50421ccaf0f9177b37ff1ea02bf4edb5d26f12a92e6e4fc\": rpc error: code = NotFound desc = could not find container \"9454b4a461c46096b50421ccaf0f9177b37ff1ea02bf4edb5d26f12a92e6e4fc\": container with ID starting with 9454b4a461c46096b50421ccaf0f9177b37ff1ea02bf4edb5d26f12a92e6e4fc not found: ID does not exist"
Sep 07 13:01:55.038929 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:55.038905    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-567c89f9c9-zc6vr"]
Sep 07 13:01:55.046238 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:55.046215    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-567c89f9c9-zc6vr"]
Sep 07 13:01:55.365720 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:01:55.365644    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b72dac0e-7d7e-4279-ac78-47a6174a16f5" path="/var/lib/kubelet/pods/b72dac0e-7d7e-4279-ac78-47a6174a16f5/volumes"
Sep 07 13:02:30.687337 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:30.687239    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:02:32.662137 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:32.662091    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:02:33.447303 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:33.447261    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:02:33.673404 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:33.673374    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 13:02:33.673803 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:33.673748    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1ac6d895-9120-47ac-875f-61b200114449" containerName="alertmanager" containerID="cri-o://536446be9d6f9c30d8df0d0ed66a8bcdb48ae2d9e463640823a83cdec103a0c3" gracePeriod=120
Sep 07 13:02:33.673877 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:33.673831    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1ac6d895-9120-47ac-875f-61b200114449" containerName="kube-rbac-proxy-metric" containerID="cri-o://2fc99cdb19fa4e622e50a1a65cda9a25e24ac38e8aa69d278dafaf2d1e68e573" gracePeriod=120
Sep 07 13:02:33.673877 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:33.673831    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1ac6d895-9120-47ac-875f-61b200114449" containerName="kube-rbac-proxy-web" containerID="cri-o://1606215774a866d59f937e8ea6468b6aff629243e9075232575f7d371a20ec99" gracePeriod=120
Sep 07 13:02:33.673982 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:33.673869    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1ac6d895-9120-47ac-875f-61b200114449" containerName="prom-label-proxy" containerID="cri-o://82fd490d47f76fd2cf04d04cbe157bfbb20d688f4a888a108d7ca2fb45afed88" gracePeriod=120
Sep 07 13:02:33.673982 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:33.673895    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1ac6d895-9120-47ac-875f-61b200114449" containerName="config-reloader" containerID="cri-o://9c0333fcabaab87a4181efc8651da124530a88ccaddc4ef840121d9ff64865bd" gracePeriod=120
Sep 07 13:02:33.674079 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:33.673889    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1ac6d895-9120-47ac-875f-61b200114449" containerName="kube-rbac-proxy" containerID="cri-o://e07561c76aaca2836c9d81ae30a2f2c2492d463de534f1898a0f26a6ba430427" gracePeriod=120
Sep 07 13:02:34.155398 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:34.155369    2576 generic.go:356] "Generic (PLEG): container finished" podID="1ac6d895-9120-47ac-875f-61b200114449" containerID="82fd490d47f76fd2cf04d04cbe157bfbb20d688f4a888a108d7ca2fb45afed88" exitCode=0
Sep 07 13:02:34.155398 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:34.155395    2576 generic.go:356] "Generic (PLEG): container finished" podID="1ac6d895-9120-47ac-875f-61b200114449" containerID="e07561c76aaca2836c9d81ae30a2f2c2492d463de534f1898a0f26a6ba430427" exitCode=0
Sep 07 13:02:34.155398 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:34.155402    2576 generic.go:356] "Generic (PLEG): container finished" podID="1ac6d895-9120-47ac-875f-61b200114449" containerID="9c0333fcabaab87a4181efc8651da124530a88ccaddc4ef840121d9ff64865bd" exitCode=0
Sep 07 13:02:34.155398 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:34.155409    2576 generic.go:356] "Generic (PLEG): container finished" podID="1ac6d895-9120-47ac-875f-61b200114449" containerID="536446be9d6f9c30d8df0d0ed66a8bcdb48ae2d9e463640823a83cdec103a0c3" exitCode=0
Sep 07 13:02:34.155651 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:34.155442    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ac6d895-9120-47ac-875f-61b200114449","Type":"ContainerDied","Data":"82fd490d47f76fd2cf04d04cbe157bfbb20d688f4a888a108d7ca2fb45afed88"}
Sep 07 13:02:34.155651 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:34.155510    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ac6d895-9120-47ac-875f-61b200114449","Type":"ContainerDied","Data":"e07561c76aaca2836c9d81ae30a2f2c2492d463de534f1898a0f26a6ba430427"}
Sep 07 13:02:34.155651 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:34.155537    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ac6d895-9120-47ac-875f-61b200114449","Type":"ContainerDied","Data":"9c0333fcabaab87a4181efc8651da124530a88ccaddc4ef840121d9ff64865bd"}
Sep 07 13:02:34.155651 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:34.155560    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ac6d895-9120-47ac-875f-61b200114449","Type":"ContainerDied","Data":"536446be9d6f9c30d8df0d0ed66a8bcdb48ae2d9e463640823a83cdec103a0c3"}
Sep 07 13:02:34.929754 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:34.929729    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.021882 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.021799    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-cluster-tls-config\") pod \"1ac6d895-9120-47ac-875f-61b200114449\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") "
Sep 07 13:02:35.021882 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.021835    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-secret-alertmanager-kube-rbac-proxy-web\") pod \"1ac6d895-9120-47ac-875f-61b200114449\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") "
Sep 07 13:02:35.021882 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.021867    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ac6d895-9120-47ac-875f-61b200114449-config-out\") pod \"1ac6d895-9120-47ac-875f-61b200114449\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") "
Sep 07 13:02:35.022143 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.021888    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1ac6d895-9120-47ac-875f-61b200114449-alertmanager-main-db\") pod \"1ac6d895-9120-47ac-875f-61b200114449\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") "
Sep 07 13:02:35.022143 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.021912    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4pph6\" (UniqueName: \"kubernetes.io/projected/1ac6d895-9120-47ac-875f-61b200114449-kube-api-access-4pph6\") pod \"1ac6d895-9120-47ac-875f-61b200114449\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") "
Sep 07 13:02:35.022143 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.021944    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ac6d895-9120-47ac-875f-61b200114449-metrics-client-ca\") pod \"1ac6d895-9120-47ac-875f-61b200114449\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") "
Sep 07 13:02:35.022143 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.021975    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ac6d895-9120-47ac-875f-61b200114449-tls-assets\") pod \"1ac6d895-9120-47ac-875f-61b200114449\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") "
Sep 07 13:02:35.022143 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.021997    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-web-config\") pod \"1ac6d895-9120-47ac-875f-61b200114449\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") "
Sep 07 13:02:35.022143 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.022020    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-config-volume\") pod \"1ac6d895-9120-47ac-875f-61b200114449\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") "
Sep 07 13:02:35.022143 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.022087    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-secret-alertmanager-main-tls\") pod \"1ac6d895-9120-47ac-875f-61b200114449\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") "
Sep 07 13:02:35.022143 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.022121    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-secret-alertmanager-kube-rbac-proxy\") pod \"1ac6d895-9120-47ac-875f-61b200114449\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") "
Sep 07 13:02:35.022546 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.022155    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-secret-alertmanager-kube-rbac-proxy-metric\") pod \"1ac6d895-9120-47ac-875f-61b200114449\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") "
Sep 07 13:02:35.022546 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.022184    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ac6d895-9120-47ac-875f-61b200114449-alertmanager-trusted-ca-bundle\") pod \"1ac6d895-9120-47ac-875f-61b200114449\" (UID: \"1ac6d895-9120-47ac-875f-61b200114449\") "
Sep 07 13:02:35.022546 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.022215    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ac6d895-9120-47ac-875f-61b200114449-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "1ac6d895-9120-47ac-875f-61b200114449" (UID: "1ac6d895-9120-47ac-875f-61b200114449"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:02:35.022546 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.022403    2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1ac6d895-9120-47ac-875f-61b200114449-alertmanager-main-db\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:02:35.022742 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.022631    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ac6d895-9120-47ac-875f-61b200114449-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "1ac6d895-9120-47ac-875f-61b200114449" (UID: "1ac6d895-9120-47ac-875f-61b200114449"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:02:35.023009 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.022946    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ac6d895-9120-47ac-875f-61b200114449-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "1ac6d895-9120-47ac-875f-61b200114449" (UID: "1ac6d895-9120-47ac-875f-61b200114449"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:02:35.026117 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.026066    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "1ac6d895-9120-47ac-875f-61b200114449" (UID: "1ac6d895-9120-47ac-875f-61b200114449"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:02:35.026645 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.026551    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "1ac6d895-9120-47ac-875f-61b200114449" (UID: "1ac6d895-9120-47ac-875f-61b200114449"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:02:35.026645 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.026602    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ac6d895-9120-47ac-875f-61b200114449-config-out" (OuterVolumeSpecName: "config-out") pod "1ac6d895-9120-47ac-875f-61b200114449" (UID: "1ac6d895-9120-47ac-875f-61b200114449"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:02:35.026821 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.026682    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "1ac6d895-9120-47ac-875f-61b200114449" (UID: "1ac6d895-9120-47ac-875f-61b200114449"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:02:35.026890 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.026872    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-config-volume" (OuterVolumeSpecName: "config-volume") pod "1ac6d895-9120-47ac-875f-61b200114449" (UID: "1ac6d895-9120-47ac-875f-61b200114449"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:02:35.026945 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.026898    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "1ac6d895-9120-47ac-875f-61b200114449" (UID: "1ac6d895-9120-47ac-875f-61b200114449"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:02:35.027549 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.027521    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ac6d895-9120-47ac-875f-61b200114449-kube-api-access-4pph6" (OuterVolumeSpecName: "kube-api-access-4pph6") pod "1ac6d895-9120-47ac-875f-61b200114449" (UID: "1ac6d895-9120-47ac-875f-61b200114449"). InnerVolumeSpecName "kube-api-access-4pph6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:02:35.028281 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.028253    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ac6d895-9120-47ac-875f-61b200114449-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1ac6d895-9120-47ac-875f-61b200114449" (UID: "1ac6d895-9120-47ac-875f-61b200114449"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:02:35.030036 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.030008    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "1ac6d895-9120-47ac-875f-61b200114449" (UID: "1ac6d895-9120-47ac-875f-61b200114449"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:02:35.036892 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.036866    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-web-config" (OuterVolumeSpecName: "web-config") pod "1ac6d895-9120-47ac-875f-61b200114449" (UID: "1ac6d895-9120-47ac-875f-61b200114449"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:02:35.123344 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.123308    2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ac6d895-9120-47ac-875f-61b200114449-config-out\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:02:35.123344 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.123339    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4pph6\" (UniqueName: \"kubernetes.io/projected/1ac6d895-9120-47ac-875f-61b200114449-kube-api-access-4pph6\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:02:35.123344 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.123352    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ac6d895-9120-47ac-875f-61b200114449-metrics-client-ca\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:02:35.123582 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.123363    2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ac6d895-9120-47ac-875f-61b200114449-tls-assets\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:02:35.123582 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.123372    2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-web-config\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:02:35.123582 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.123380    2576 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-config-volume\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:02:35.123582 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.123388    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-secret-alertmanager-main-tls\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:02:35.123582 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.123397    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:02:35.123582 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.123405    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:02:35.123582 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.123416    2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ac6d895-9120-47ac-875f-61b200114449-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:02:35.123582 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.123424    2576 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-cluster-tls-config\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:02:35.123582 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.123432    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ac6d895-9120-47ac-875f-61b200114449-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:02:35.162576 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.162543    2576 generic.go:356] "Generic (PLEG): container finished" podID="1ac6d895-9120-47ac-875f-61b200114449" containerID="2fc99cdb19fa4e622e50a1a65cda9a25e24ac38e8aa69d278dafaf2d1e68e573" exitCode=0
Sep 07 13:02:35.162576 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.162567    2576 generic.go:356] "Generic (PLEG): container finished" podID="1ac6d895-9120-47ac-875f-61b200114449" containerID="1606215774a866d59f937e8ea6468b6aff629243e9075232575f7d371a20ec99" exitCode=0
Sep 07 13:02:35.162752 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.162626    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.162752 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.162635    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ac6d895-9120-47ac-875f-61b200114449","Type":"ContainerDied","Data":"2fc99cdb19fa4e622e50a1a65cda9a25e24ac38e8aa69d278dafaf2d1e68e573"}
Sep 07 13:02:35.162752 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.162721    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ac6d895-9120-47ac-875f-61b200114449","Type":"ContainerDied","Data":"1606215774a866d59f937e8ea6468b6aff629243e9075232575f7d371a20ec99"}
Sep 07 13:02:35.162861 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.162791    2576 scope.go:117] "RemoveContainer" containerID="82fd490d47f76fd2cf04d04cbe157bfbb20d688f4a888a108d7ca2fb45afed88"
Sep 07 13:02:35.162898 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.162792    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1ac6d895-9120-47ac-875f-61b200114449","Type":"ContainerDied","Data":"f170b10421c124f6623f36361a99ca176a3cf0ca777da1f894244c72903f1d61"}
Sep 07 13:02:35.170637 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.170619    2576 scope.go:117] "RemoveContainer" containerID="2fc99cdb19fa4e622e50a1a65cda9a25e24ac38e8aa69d278dafaf2d1e68e573"
Sep 07 13:02:35.177718 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.177698    2576 scope.go:117] "RemoveContainer" containerID="e07561c76aaca2836c9d81ae30a2f2c2492d463de534f1898a0f26a6ba430427"
Sep 07 13:02:35.184348 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.184332    2576 scope.go:117] "RemoveContainer" containerID="1606215774a866d59f937e8ea6468b6aff629243e9075232575f7d371a20ec99"
Sep 07 13:02:35.191188 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.191173    2576 scope.go:117] "RemoveContainer" containerID="9c0333fcabaab87a4181efc8651da124530a88ccaddc4ef840121d9ff64865bd"
Sep 07 13:02:35.192026 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.192007    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 13:02:35.198398 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.198380    2576 scope.go:117] "RemoveContainer" containerID="536446be9d6f9c30d8df0d0ed66a8bcdb48ae2d9e463640823a83cdec103a0c3"
Sep 07 13:02:35.199188 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.199170    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 13:02:35.205299 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.205282    2576 scope.go:117] "RemoveContainer" containerID="95f24f99339a24569a6523cdc32ec4cdda0b450ee1e27e3a85901c9ebc7c5450"
Sep 07 13:02:35.212023 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.212004    2576 scope.go:117] "RemoveContainer" containerID="82fd490d47f76fd2cf04d04cbe157bfbb20d688f4a888a108d7ca2fb45afed88"
Sep 07 13:02:35.212313 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:02:35.212278    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82fd490d47f76fd2cf04d04cbe157bfbb20d688f4a888a108d7ca2fb45afed88\": container with ID starting with 82fd490d47f76fd2cf04d04cbe157bfbb20d688f4a888a108d7ca2fb45afed88 not found: ID does not exist" containerID="82fd490d47f76fd2cf04d04cbe157bfbb20d688f4a888a108d7ca2fb45afed88"
Sep 07 13:02:35.212359 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.212322    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82fd490d47f76fd2cf04d04cbe157bfbb20d688f4a888a108d7ca2fb45afed88"} err="failed to get container status \"82fd490d47f76fd2cf04d04cbe157bfbb20d688f4a888a108d7ca2fb45afed88\": rpc error: code = NotFound desc = could not find container \"82fd490d47f76fd2cf04d04cbe157bfbb20d688f4a888a108d7ca2fb45afed88\": container with ID starting with 82fd490d47f76fd2cf04d04cbe157bfbb20d688f4a888a108d7ca2fb45afed88 not found: ID does not exist"
Sep 07 13:02:35.212359 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.212340    2576 scope.go:117] "RemoveContainer" containerID="2fc99cdb19fa4e622e50a1a65cda9a25e24ac38e8aa69d278dafaf2d1e68e573"
Sep 07 13:02:35.212578 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:02:35.212563    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fc99cdb19fa4e622e50a1a65cda9a25e24ac38e8aa69d278dafaf2d1e68e573\": container with ID starting with 2fc99cdb19fa4e622e50a1a65cda9a25e24ac38e8aa69d278dafaf2d1e68e573 not found: ID does not exist" containerID="2fc99cdb19fa4e622e50a1a65cda9a25e24ac38e8aa69d278dafaf2d1e68e573"
Sep 07 13:02:35.212622 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.212582    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fc99cdb19fa4e622e50a1a65cda9a25e24ac38e8aa69d278dafaf2d1e68e573"} err="failed to get container status \"2fc99cdb19fa4e622e50a1a65cda9a25e24ac38e8aa69d278dafaf2d1e68e573\": rpc error: code = NotFound desc = could not find container \"2fc99cdb19fa4e622e50a1a65cda9a25e24ac38e8aa69d278dafaf2d1e68e573\": container with ID starting with 2fc99cdb19fa4e622e50a1a65cda9a25e24ac38e8aa69d278dafaf2d1e68e573 not found: ID does not exist"
Sep 07 13:02:35.212622 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.212595    2576 scope.go:117] "RemoveContainer" containerID="e07561c76aaca2836c9d81ae30a2f2c2492d463de534f1898a0f26a6ba430427"
Sep 07 13:02:35.212828 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:02:35.212812    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e07561c76aaca2836c9d81ae30a2f2c2492d463de534f1898a0f26a6ba430427\": container with ID starting with e07561c76aaca2836c9d81ae30a2f2c2492d463de534f1898a0f26a6ba430427 not found: ID does not exist" containerID="e07561c76aaca2836c9d81ae30a2f2c2492d463de534f1898a0f26a6ba430427"
Sep 07 13:02:35.212876 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.212833    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e07561c76aaca2836c9d81ae30a2f2c2492d463de534f1898a0f26a6ba430427"} err="failed to get container status \"e07561c76aaca2836c9d81ae30a2f2c2492d463de534f1898a0f26a6ba430427\": rpc error: code = NotFound desc = could not find container \"e07561c76aaca2836c9d81ae30a2f2c2492d463de534f1898a0f26a6ba430427\": container with ID starting with e07561c76aaca2836c9d81ae30a2f2c2492d463de534f1898a0f26a6ba430427 not found: ID does not exist"
Sep 07 13:02:35.212876 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.212845    2576 scope.go:117] "RemoveContainer" containerID="1606215774a866d59f937e8ea6468b6aff629243e9075232575f7d371a20ec99"
Sep 07 13:02:35.213050 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:02:35.213035    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1606215774a866d59f937e8ea6468b6aff629243e9075232575f7d371a20ec99\": container with ID starting with 1606215774a866d59f937e8ea6468b6aff629243e9075232575f7d371a20ec99 not found: ID does not exist" containerID="1606215774a866d59f937e8ea6468b6aff629243e9075232575f7d371a20ec99"
Sep 07 13:02:35.213094 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.213054    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1606215774a866d59f937e8ea6468b6aff629243e9075232575f7d371a20ec99"} err="failed to get container status \"1606215774a866d59f937e8ea6468b6aff629243e9075232575f7d371a20ec99\": rpc error: code = NotFound desc = could not find container \"1606215774a866d59f937e8ea6468b6aff629243e9075232575f7d371a20ec99\": container with ID starting with 1606215774a866d59f937e8ea6468b6aff629243e9075232575f7d371a20ec99 not found: ID does not exist"
Sep 07 13:02:35.213094 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.213066    2576 scope.go:117] "RemoveContainer" containerID="9c0333fcabaab87a4181efc8651da124530a88ccaddc4ef840121d9ff64865bd"
Sep 07 13:02:35.213283 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:02:35.213262    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c0333fcabaab87a4181efc8651da124530a88ccaddc4ef840121d9ff64865bd\": container with ID starting with 9c0333fcabaab87a4181efc8651da124530a88ccaddc4ef840121d9ff64865bd not found: ID does not exist" containerID="9c0333fcabaab87a4181efc8651da124530a88ccaddc4ef840121d9ff64865bd"
Sep 07 13:02:35.213335 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.213289    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c0333fcabaab87a4181efc8651da124530a88ccaddc4ef840121d9ff64865bd"} err="failed to get container status \"9c0333fcabaab87a4181efc8651da124530a88ccaddc4ef840121d9ff64865bd\": rpc error: code = NotFound desc = could not find container \"9c0333fcabaab87a4181efc8651da124530a88ccaddc4ef840121d9ff64865bd\": container with ID starting with 9c0333fcabaab87a4181efc8651da124530a88ccaddc4ef840121d9ff64865bd not found: ID does not exist"
Sep 07 13:02:35.213335 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.213306    2576 scope.go:117] "RemoveContainer" containerID="536446be9d6f9c30d8df0d0ed66a8bcdb48ae2d9e463640823a83cdec103a0c3"
Sep 07 13:02:35.213563 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:02:35.213542    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"536446be9d6f9c30d8df0d0ed66a8bcdb48ae2d9e463640823a83cdec103a0c3\": container with ID starting with 536446be9d6f9c30d8df0d0ed66a8bcdb48ae2d9e463640823a83cdec103a0c3 not found: ID does not exist" containerID="536446be9d6f9c30d8df0d0ed66a8bcdb48ae2d9e463640823a83cdec103a0c3"
Sep 07 13:02:35.213638 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.213566    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"536446be9d6f9c30d8df0d0ed66a8bcdb48ae2d9e463640823a83cdec103a0c3"} err="failed to get container status \"536446be9d6f9c30d8df0d0ed66a8bcdb48ae2d9e463640823a83cdec103a0c3\": rpc error: code = NotFound desc = could not find container \"536446be9d6f9c30d8df0d0ed66a8bcdb48ae2d9e463640823a83cdec103a0c3\": container with ID starting with 536446be9d6f9c30d8df0d0ed66a8bcdb48ae2d9e463640823a83cdec103a0c3 not found: ID does not exist"
Sep 07 13:02:35.213638 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.213582    2576 scope.go:117] "RemoveContainer" containerID="95f24f99339a24569a6523cdc32ec4cdda0b450ee1e27e3a85901c9ebc7c5450"
Sep 07 13:02:35.213852 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:02:35.213837    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95f24f99339a24569a6523cdc32ec4cdda0b450ee1e27e3a85901c9ebc7c5450\": container with ID starting with 95f24f99339a24569a6523cdc32ec4cdda0b450ee1e27e3a85901c9ebc7c5450 not found: ID does not exist" containerID="95f24f99339a24569a6523cdc32ec4cdda0b450ee1e27e3a85901c9ebc7c5450"
Sep 07 13:02:35.213908 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.213864    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95f24f99339a24569a6523cdc32ec4cdda0b450ee1e27e3a85901c9ebc7c5450"} err="failed to get container status \"95f24f99339a24569a6523cdc32ec4cdda0b450ee1e27e3a85901c9ebc7c5450\": rpc error: code = NotFound desc = could not find container \"95f24f99339a24569a6523cdc32ec4cdda0b450ee1e27e3a85901c9ebc7c5450\": container with ID starting with 95f24f99339a24569a6523cdc32ec4cdda0b450ee1e27e3a85901c9ebc7c5450 not found: ID does not exist"
Sep 07 13:02:35.213908 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.213877    2576 scope.go:117] "RemoveContainer" containerID="82fd490d47f76fd2cf04d04cbe157bfbb20d688f4a888a108d7ca2fb45afed88"
Sep 07 13:02:35.214130 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.214110    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82fd490d47f76fd2cf04d04cbe157bfbb20d688f4a888a108d7ca2fb45afed88"} err="failed to get container status \"82fd490d47f76fd2cf04d04cbe157bfbb20d688f4a888a108d7ca2fb45afed88\": rpc error: code = NotFound desc = could not find container \"82fd490d47f76fd2cf04d04cbe157bfbb20d688f4a888a108d7ca2fb45afed88\": container with ID starting with 82fd490d47f76fd2cf04d04cbe157bfbb20d688f4a888a108d7ca2fb45afed88 not found: ID does not exist"
Sep 07 13:02:35.214176 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.214133    2576 scope.go:117] "RemoveContainer" containerID="2fc99cdb19fa4e622e50a1a65cda9a25e24ac38e8aa69d278dafaf2d1e68e573"
Sep 07 13:02:35.214403 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.214386    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fc99cdb19fa4e622e50a1a65cda9a25e24ac38e8aa69d278dafaf2d1e68e573"} err="failed to get container status \"2fc99cdb19fa4e622e50a1a65cda9a25e24ac38e8aa69d278dafaf2d1e68e573\": rpc error: code = NotFound desc = could not find container \"2fc99cdb19fa4e622e50a1a65cda9a25e24ac38e8aa69d278dafaf2d1e68e573\": container with ID starting with 2fc99cdb19fa4e622e50a1a65cda9a25e24ac38e8aa69d278dafaf2d1e68e573 not found: ID does not exist"
Sep 07 13:02:35.214445 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.214403    2576 scope.go:117] "RemoveContainer" containerID="e07561c76aaca2836c9d81ae30a2f2c2492d463de534f1898a0f26a6ba430427"
Sep 07 13:02:35.214655 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.214636    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e07561c76aaca2836c9d81ae30a2f2c2492d463de534f1898a0f26a6ba430427"} err="failed to get container status \"e07561c76aaca2836c9d81ae30a2f2c2492d463de534f1898a0f26a6ba430427\": rpc error: code = NotFound desc = could not find container \"e07561c76aaca2836c9d81ae30a2f2c2492d463de534f1898a0f26a6ba430427\": container with ID starting with e07561c76aaca2836c9d81ae30a2f2c2492d463de534f1898a0f26a6ba430427 not found: ID does not exist"
Sep 07 13:02:35.214713 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.214657    2576 scope.go:117] "RemoveContainer" containerID="1606215774a866d59f937e8ea6468b6aff629243e9075232575f7d371a20ec99"
Sep 07 13:02:35.214952 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.214935    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1606215774a866d59f937e8ea6468b6aff629243e9075232575f7d371a20ec99"} err="failed to get container status \"1606215774a866d59f937e8ea6468b6aff629243e9075232575f7d371a20ec99\": rpc error: code = NotFound desc = could not find container \"1606215774a866d59f937e8ea6468b6aff629243e9075232575f7d371a20ec99\": container with ID starting with 1606215774a866d59f937e8ea6468b6aff629243e9075232575f7d371a20ec99 not found: ID does not exist"
Sep 07 13:02:35.214998 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.214953    2576 scope.go:117] "RemoveContainer" containerID="9c0333fcabaab87a4181efc8651da124530a88ccaddc4ef840121d9ff64865bd"
Sep 07 13:02:35.215183 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.215164    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c0333fcabaab87a4181efc8651da124530a88ccaddc4ef840121d9ff64865bd"} err="failed to get container status \"9c0333fcabaab87a4181efc8651da124530a88ccaddc4ef840121d9ff64865bd\": rpc error: code = NotFound desc = could not find container \"9c0333fcabaab87a4181efc8651da124530a88ccaddc4ef840121d9ff64865bd\": container with ID starting with 9c0333fcabaab87a4181efc8651da124530a88ccaddc4ef840121d9ff64865bd not found: ID does not exist"
Sep 07 13:02:35.215237 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.215183    2576 scope.go:117] "RemoveContainer" containerID="536446be9d6f9c30d8df0d0ed66a8bcdb48ae2d9e463640823a83cdec103a0c3"
Sep 07 13:02:35.215417 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.215402    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"536446be9d6f9c30d8df0d0ed66a8bcdb48ae2d9e463640823a83cdec103a0c3"} err="failed to get container status \"536446be9d6f9c30d8df0d0ed66a8bcdb48ae2d9e463640823a83cdec103a0c3\": rpc error: code = NotFound desc = could not find container \"536446be9d6f9c30d8df0d0ed66a8bcdb48ae2d9e463640823a83cdec103a0c3\": container with ID starting with 536446be9d6f9c30d8df0d0ed66a8bcdb48ae2d9e463640823a83cdec103a0c3 not found: ID does not exist"
Sep 07 13:02:35.215456 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.215417    2576 scope.go:117] "RemoveContainer" containerID="95f24f99339a24569a6523cdc32ec4cdda0b450ee1e27e3a85901c9ebc7c5450"
Sep 07 13:02:35.215636 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.215618    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95f24f99339a24569a6523cdc32ec4cdda0b450ee1e27e3a85901c9ebc7c5450"} err="failed to get container status \"95f24f99339a24569a6523cdc32ec4cdda0b450ee1e27e3a85901c9ebc7c5450\": rpc error: code = NotFound desc = could not find container \"95f24f99339a24569a6523cdc32ec4cdda0b450ee1e27e3a85901c9ebc7c5450\": container with ID starting with 95f24f99339a24569a6523cdc32ec4cdda0b450ee1e27e3a85901c9ebc7c5450 not found: ID does not exist"
Sep 07 13:02:35.266315 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.266286    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 13:02:35.266560 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.266547    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ac6d895-9120-47ac-875f-61b200114449" containerName="kube-rbac-proxy-web"
Sep 07 13:02:35.266602 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.266562    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ac6d895-9120-47ac-875f-61b200114449" containerName="kube-rbac-proxy-web"
Sep 07 13:02:35.266602 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.266572    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ac6d895-9120-47ac-875f-61b200114449" containerName="init-config-reloader"
Sep 07 13:02:35.266602 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.266577    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ac6d895-9120-47ac-875f-61b200114449" containerName="init-config-reloader"
Sep 07 13:02:35.266602 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.266588    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ac6d895-9120-47ac-875f-61b200114449" containerName="prom-label-proxy"
Sep 07 13:02:35.266602 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.266593    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ac6d895-9120-47ac-875f-61b200114449" containerName="prom-label-proxy"
Sep 07 13:02:35.266602 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.266602    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b72dac0e-7d7e-4279-ac78-47a6174a16f5" containerName="console"
Sep 07 13:02:35.266785 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.266608    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b72dac0e-7d7e-4279-ac78-47a6174a16f5" containerName="console"
Sep 07 13:02:35.266785 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.266615    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aafc3ab8-ecdd-460e-ac83-af695e0101b2" containerName="console"
Sep 07 13:02:35.266785 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.266620    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="aafc3ab8-ecdd-460e-ac83-af695e0101b2" containerName="console"
Sep 07 13:02:35.266785 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.266626    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ac6d895-9120-47ac-875f-61b200114449" containerName="alertmanager"
Sep 07 13:02:35.266785 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.266631    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ac6d895-9120-47ac-875f-61b200114449" containerName="alertmanager"
Sep 07 13:02:35.266785 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.266638    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ac6d895-9120-47ac-875f-61b200114449" containerName="kube-rbac-proxy-metric"
Sep 07 13:02:35.266785 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.266644    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ac6d895-9120-47ac-875f-61b200114449" containerName="kube-rbac-proxy-metric"
Sep 07 13:02:35.266785 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.266652    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ac6d895-9120-47ac-875f-61b200114449" containerName="config-reloader"
Sep 07 13:02:35.266785 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.266658    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ac6d895-9120-47ac-875f-61b200114449" containerName="config-reloader"
Sep 07 13:02:35.266785 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.266668    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ac6d895-9120-47ac-875f-61b200114449" containerName="kube-rbac-proxy"
Sep 07 13:02:35.266785 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.266672    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ac6d895-9120-47ac-875f-61b200114449" containerName="kube-rbac-proxy"
Sep 07 13:02:35.266785 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.266709    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ac6d895-9120-47ac-875f-61b200114449" containerName="kube-rbac-proxy"
Sep 07 13:02:35.266785 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.266717    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ac6d895-9120-47ac-875f-61b200114449" containerName="kube-rbac-proxy-web"
Sep 07 13:02:35.266785 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.266724    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="aafc3ab8-ecdd-460e-ac83-af695e0101b2" containerName="console"
Sep 07 13:02:35.266785 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.266729    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b72dac0e-7d7e-4279-ac78-47a6174a16f5" containerName="console"
Sep 07 13:02:35.266785 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.266733    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ac6d895-9120-47ac-875f-61b200114449" containerName="kube-rbac-proxy-metric"
Sep 07 13:02:35.266785 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.266738    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ac6d895-9120-47ac-875f-61b200114449" containerName="prom-label-proxy"
Sep 07 13:02:35.266785 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.266743    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ac6d895-9120-47ac-875f-61b200114449" containerName="alertmanager"
Sep 07 13:02:35.266785 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.266748    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ac6d895-9120-47ac-875f-61b200114449" containerName="config-reloader"
Sep 07 13:02:35.274748 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.274673    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.287344 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.287326    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 07 13:02:35.287614 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.287598    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 07 13:02:35.287664 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.287646    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 07 13:02:35.287843 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.287828    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 07 13:02:35.287888 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.287860    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 07 13:02:35.288116 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.288104    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 07 13:02:35.288186 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.288126    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 07 13:02:35.288397 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.288384    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rkqdw\""
Sep 07 13:02:35.290097 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.290081    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 07 13:02:35.300280 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.300257    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 13:02:35.302968 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.302947    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 07 13:02:35.324646 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.324619    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb44493e-dd4e-4932-8b77-a893b02b4282-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.324740 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.324652    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb44493e-dd4e-4932-8b77-a893b02b4282-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.324740 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.324673    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb44493e-dd4e-4932-8b77-a893b02b4282-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.324740 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.324698    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fb44493e-dd4e-4932-8b77-a893b02b4282-web-config\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.324860 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.324783    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9bmc\" (UniqueName: \"kubernetes.io/projected/fb44493e-dd4e-4932-8b77-a893b02b4282-kube-api-access-r9bmc\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.324860 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.324817    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fb44493e-dd4e-4932-8b77-a893b02b4282-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.324860 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.324840    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fb44493e-dd4e-4932-8b77-a893b02b4282-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.324949 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.324875    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fb44493e-dd4e-4932-8b77-a893b02b4282-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.324949 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.324900    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fb44493e-dd4e-4932-8b77-a893b02b4282-config-volume\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.324949 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.324918    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fb44493e-dd4e-4932-8b77-a893b02b4282-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.325038 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.324971    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fb44493e-dd4e-4932-8b77-a893b02b4282-config-out\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.325038 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.325003    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fb44493e-dd4e-4932-8b77-a893b02b4282-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.325038 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.325021    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb44493e-dd4e-4932-8b77-a893b02b4282-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.366338 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.366311    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ac6d895-9120-47ac-875f-61b200114449" path="/var/lib/kubelet/pods/1ac6d895-9120-47ac-875f-61b200114449/volumes"
Sep 07 13:02:35.426260 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.426234    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fb44493e-dd4e-4932-8b77-a893b02b4282-web-config\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.426405 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.426267    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9bmc\" (UniqueName: \"kubernetes.io/projected/fb44493e-dd4e-4932-8b77-a893b02b4282-kube-api-access-r9bmc\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.426405 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.426296    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fb44493e-dd4e-4932-8b77-a893b02b4282-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.426405 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.426324    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fb44493e-dd4e-4932-8b77-a893b02b4282-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.426405 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.426349    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fb44493e-dd4e-4932-8b77-a893b02b4282-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.426405 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.426387    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fb44493e-dd4e-4932-8b77-a893b02b4282-config-volume\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.426650 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.426409    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fb44493e-dd4e-4932-8b77-a893b02b4282-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.426650 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.426460    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fb44493e-dd4e-4932-8b77-a893b02b4282-config-out\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.426650 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.426485    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fb44493e-dd4e-4932-8b77-a893b02b4282-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.426650 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.426507    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb44493e-dd4e-4932-8b77-a893b02b4282-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.426650 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.426545    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb44493e-dd4e-4932-8b77-a893b02b4282-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.426650 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.426576    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb44493e-dd4e-4932-8b77-a893b02b4282-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.426650 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.426601    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb44493e-dd4e-4932-8b77-a893b02b4282-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.427019 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.426887    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/fb44493e-dd4e-4932-8b77-a893b02b4282-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.428051 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.427952    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fb44493e-dd4e-4932-8b77-a893b02b4282-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.428269 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.428240    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fb44493e-dd4e-4932-8b77-a893b02b4282-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.429737 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.429690    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/fb44493e-dd4e-4932-8b77-a893b02b4282-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.429853 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.429753    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fb44493e-dd4e-4932-8b77-a893b02b4282-tls-assets\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.429966 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.429941    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/fb44493e-dd4e-4932-8b77-a893b02b4282-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.430171 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.430149    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fb44493e-dd4e-4932-8b77-a893b02b4282-web-config\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.430276 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.430254    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fb44493e-dd4e-4932-8b77-a893b02b4282-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.430348 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.430338    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/fb44493e-dd4e-4932-8b77-a893b02b4282-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.430431 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.430414    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fb44493e-dd4e-4932-8b77-a893b02b4282-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.430951 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.430932    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/fb44493e-dd4e-4932-8b77-a893b02b4282-config-volume\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.431119 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.431103    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fb44493e-dd4e-4932-8b77-a893b02b4282-config-out\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.436715 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.436696    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9bmc\" (UniqueName: \"kubernetes.io/projected/fb44493e-dd4e-4932-8b77-a893b02b4282-kube-api-access-r9bmc\") pod \"alertmanager-main-0\" (UID: \"fb44493e-dd4e-4932-8b77-a893b02b4282\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.583744 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.583650    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 07 13:02:35.892667 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:02:35.892643    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb44493e_dd4e_4932_8b77_a893b02b4282.slice/crio-9e6bbbd7a154a0d48bdb7c42418495daa7952460461c44a5d2fbccc578685eb5 WatchSource:0}: Error finding container 9e6bbbd7a154a0d48bdb7c42418495daa7952460461c44a5d2fbccc578685eb5: Status 404 returned error can't find the container with id 9e6bbbd7a154a0d48bdb7c42418495daa7952460461c44a5d2fbccc578685eb5
Sep 07 13:02:35.895554 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:35.895528    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 07 13:02:36.169511 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:36.169422    2576 generic.go:356] "Generic (PLEG): container finished" podID="fb44493e-dd4e-4932-8b77-a893b02b4282" containerID="7bdb83236a3bb52a62d27f239d88ae92d7fc70d041208557b234a4522feea6ea" exitCode=0
Sep 07 13:02:36.169511 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:36.169469    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb44493e-dd4e-4932-8b77-a893b02b4282","Type":"ContainerDied","Data":"7bdb83236a3bb52a62d27f239d88ae92d7fc70d041208557b234a4522feea6ea"}
Sep 07 13:02:36.169900 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:36.169538    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb44493e-dd4e-4932-8b77-a893b02b4282","Type":"ContainerStarted","Data":"9e6bbbd7a154a0d48bdb7c42418495daa7952460461c44a5d2fbccc578685eb5"}
Sep 07 13:02:37.180959 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.180921    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb44493e-dd4e-4932-8b77-a893b02b4282","Type":"ContainerStarted","Data":"98394d765d717a8411adeaaa50935f858464392dd1921fdd75a2cff959556707"}
Sep 07 13:02:37.181404 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.181024    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb44493e-dd4e-4932-8b77-a893b02b4282","Type":"ContainerStarted","Data":"7b0fc8b5646f807ecce921a80219c1ef50960cd662b76a38fd631920812adc02"}
Sep 07 13:02:37.181404 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.181069    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb44493e-dd4e-4932-8b77-a893b02b4282","Type":"ContainerStarted","Data":"7b48a2acfa02047230942052cc51e10d40c7f250904bcbab9d194974ac924b1a"}
Sep 07 13:02:37.181404 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.181112    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb44493e-dd4e-4932-8b77-a893b02b4282","Type":"ContainerStarted","Data":"3361b8e4f1f099bc128c5e6532a1081f14eefb2eeb58ba44435fd59a9af94f38"}
Sep 07 13:02:37.181404 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.181151    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb44493e-dd4e-4932-8b77-a893b02b4282","Type":"ContainerStarted","Data":"1c8b5fa2841983b9355342a3a2e8615c72265d6288faa6013d31e136d860a2c9"}
Sep 07 13:02:37.181404 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.181188    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"fb44493e-dd4e-4932-8b77-a893b02b4282","Type":"ContainerStarted","Data":"6ee6f78eb575bda78580fe203879eb48707cc626e5626ef9f524fb6e8c63fddf"}
Sep 07 13:02:37.236611 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.236553    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.220856216 podStartE2EDuration="2.236532971s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.676755ms" isStatefulPod=false podCreationTimestamp="2026-09-07 13:02:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:02:37.230602738 +0000 UTC m=+184.287484396" watchObservedRunningTime="2026-09-07 13:02:37.236532971 +0000 UTC m=+184.293414631"
Sep 07 13:02:37.737542 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.737502    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-fb7f9d697-dnxtq"]
Sep 07 13:02:37.741367 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.741344    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-fb7f9d697-dnxtq"
Sep 07 13:02:37.745476 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.745441    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 07 13:02:37.745814 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.745797    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 07 13:02:37.746014 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.746001    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-ddllp\""
Sep 07 13:02:37.746323 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.746299    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 07 13:02:37.746546 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.746533    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 07 13:02:37.749212 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.749195    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 07 13:02:37.753159 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.753143    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 07 13:02:37.763175 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.763153    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-fb7f9d697-dnxtq"]
Sep 07 13:02:37.845983 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.845952    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c964cb6-84c7-4706-931a-d5d689cf59fe-serving-certs-ca-bundle\") pod \"telemeter-client-fb7f9d697-dnxtq\" (UID: \"5c964cb6-84c7-4706-931a-d5d689cf59fe\") " pod="openshift-monitoring/telemeter-client-fb7f9d697-dnxtq"
Sep 07 13:02:37.846161 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.846005    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c964cb6-84c7-4706-931a-d5d689cf59fe-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fb7f9d697-dnxtq\" (UID: \"5c964cb6-84c7-4706-931a-d5d689cf59fe\") " pod="openshift-monitoring/telemeter-client-fb7f9d697-dnxtq"
Sep 07 13:02:37.846161 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.846041    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5c964cb6-84c7-4706-931a-d5d689cf59fe-secret-telemeter-client\") pod \"telemeter-client-fb7f9d697-dnxtq\" (UID: \"5c964cb6-84c7-4706-931a-d5d689cf59fe\") " pod="openshift-monitoring/telemeter-client-fb7f9d697-dnxtq"
Sep 07 13:02:37.846161 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.846082    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c964cb6-84c7-4706-931a-d5d689cf59fe-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fb7f9d697-dnxtq\" (UID: \"5c964cb6-84c7-4706-931a-d5d689cf59fe\") " pod="openshift-monitoring/telemeter-client-fb7f9d697-dnxtq"
Sep 07 13:02:37.846161 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.846115    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5c964cb6-84c7-4706-931a-d5d689cf59fe-telemeter-client-tls\") pod \"telemeter-client-fb7f9d697-dnxtq\" (UID: \"5c964cb6-84c7-4706-931a-d5d689cf59fe\") " pod="openshift-monitoring/telemeter-client-fb7f9d697-dnxtq"
Sep 07 13:02:37.846332 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.846160    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5c964cb6-84c7-4706-931a-d5d689cf59fe-federate-client-tls\") pod \"telemeter-client-fb7f9d697-dnxtq\" (UID: \"5c964cb6-84c7-4706-931a-d5d689cf59fe\") " pod="openshift-monitoring/telemeter-client-fb7f9d697-dnxtq"
Sep 07 13:02:37.846332 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.846187    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c964cb6-84c7-4706-931a-d5d689cf59fe-metrics-client-ca\") pod \"telemeter-client-fb7f9d697-dnxtq\" (UID: \"5c964cb6-84c7-4706-931a-d5d689cf59fe\") " pod="openshift-monitoring/telemeter-client-fb7f9d697-dnxtq"
Sep 07 13:02:37.846332 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.846221    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-554dc\" (UniqueName: \"kubernetes.io/projected/5c964cb6-84c7-4706-931a-d5d689cf59fe-kube-api-access-554dc\") pod \"telemeter-client-fb7f9d697-dnxtq\" (UID: \"5c964cb6-84c7-4706-931a-d5d689cf59fe\") " pod="openshift-monitoring/telemeter-client-fb7f9d697-dnxtq"
Sep 07 13:02:37.946986 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.946953    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5c964cb6-84c7-4706-931a-d5d689cf59fe-telemeter-client-tls\") pod \"telemeter-client-fb7f9d697-dnxtq\" (UID: \"5c964cb6-84c7-4706-931a-d5d689cf59fe\") " pod="openshift-monitoring/telemeter-client-fb7f9d697-dnxtq"
Sep 07 13:02:37.947144 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.947005    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5c964cb6-84c7-4706-931a-d5d689cf59fe-federate-client-tls\") pod \"telemeter-client-fb7f9d697-dnxtq\" (UID: \"5c964cb6-84c7-4706-931a-d5d689cf59fe\") " pod="openshift-monitoring/telemeter-client-fb7f9d697-dnxtq"
Sep 07 13:02:37.947144 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.947026    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c964cb6-84c7-4706-931a-d5d689cf59fe-metrics-client-ca\") pod \"telemeter-client-fb7f9d697-dnxtq\" (UID: \"5c964cb6-84c7-4706-931a-d5d689cf59fe\") " pod="openshift-monitoring/telemeter-client-fb7f9d697-dnxtq"
Sep 07 13:02:37.947144 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.947045    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-554dc\" (UniqueName: \"kubernetes.io/projected/5c964cb6-84c7-4706-931a-d5d689cf59fe-kube-api-access-554dc\") pod \"telemeter-client-fb7f9d697-dnxtq\" (UID: \"5c964cb6-84c7-4706-931a-d5d689cf59fe\") " pod="openshift-monitoring/telemeter-client-fb7f9d697-dnxtq"
Sep 07 13:02:37.947144 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.947068    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c964cb6-84c7-4706-931a-d5d689cf59fe-serving-certs-ca-bundle\") pod \"telemeter-client-fb7f9d697-dnxtq\" (UID: \"5c964cb6-84c7-4706-931a-d5d689cf59fe\") " pod="openshift-monitoring/telemeter-client-fb7f9d697-dnxtq"
Sep 07 13:02:37.947144 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.947098    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c964cb6-84c7-4706-931a-d5d689cf59fe-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fb7f9d697-dnxtq\" (UID: \"5c964cb6-84c7-4706-931a-d5d689cf59fe\") " pod="openshift-monitoring/telemeter-client-fb7f9d697-dnxtq"
Sep 07 13:02:37.947144 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.947122    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5c964cb6-84c7-4706-931a-d5d689cf59fe-secret-telemeter-client\") pod \"telemeter-client-fb7f9d697-dnxtq\" (UID: \"5c964cb6-84c7-4706-931a-d5d689cf59fe\") " pod="openshift-monitoring/telemeter-client-fb7f9d697-dnxtq"
Sep 07 13:02:37.947471 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.947408    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c964cb6-84c7-4706-931a-d5d689cf59fe-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fb7f9d697-dnxtq\" (UID: \"5c964cb6-84c7-4706-931a-d5d689cf59fe\") " pod="openshift-monitoring/telemeter-client-fb7f9d697-dnxtq"
Sep 07 13:02:37.947914 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.947891    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c964cb6-84c7-4706-931a-d5d689cf59fe-metrics-client-ca\") pod \"telemeter-client-fb7f9d697-dnxtq\" (UID: \"5c964cb6-84c7-4706-931a-d5d689cf59fe\") " pod="openshift-monitoring/telemeter-client-fb7f9d697-dnxtq"
Sep 07 13:02:37.948016 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.947931    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c964cb6-84c7-4706-931a-d5d689cf59fe-serving-certs-ca-bundle\") pod \"telemeter-client-fb7f9d697-dnxtq\" (UID: \"5c964cb6-84c7-4706-931a-d5d689cf59fe\") " pod="openshift-monitoring/telemeter-client-fb7f9d697-dnxtq"
Sep 07 13:02:37.948385 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.948364    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c964cb6-84c7-4706-931a-d5d689cf59fe-telemeter-trusted-ca-bundle\") pod \"telemeter-client-fb7f9d697-dnxtq\" (UID: \"5c964cb6-84c7-4706-931a-d5d689cf59fe\") " pod="openshift-monitoring/telemeter-client-fb7f9d697-dnxtq"
Sep 07 13:02:37.950081 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.950049    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5c964cb6-84c7-4706-931a-d5d689cf59fe-secret-telemeter-client\") pod \"telemeter-client-fb7f9d697-dnxtq\" (UID: \"5c964cb6-84c7-4706-931a-d5d689cf59fe\") " pod="openshift-monitoring/telemeter-client-fb7f9d697-dnxtq"
Sep 07 13:02:37.950185 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.950088    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5c964cb6-84c7-4706-931a-d5d689cf59fe-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-fb7f9d697-dnxtq\" (UID: \"5c964cb6-84c7-4706-931a-d5d689cf59fe\") " pod="openshift-monitoring/telemeter-client-fb7f9d697-dnxtq"
Sep 07 13:02:37.950185 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.950108    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5c964cb6-84c7-4706-931a-d5d689cf59fe-federate-client-tls\") pod \"telemeter-client-fb7f9d697-dnxtq\" (UID: \"5c964cb6-84c7-4706-931a-d5d689cf59fe\") " pod="openshift-monitoring/telemeter-client-fb7f9d697-dnxtq"
Sep 07 13:02:37.950253 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.950194    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5c964cb6-84c7-4706-931a-d5d689cf59fe-telemeter-client-tls\") pod \"telemeter-client-fb7f9d697-dnxtq\" (UID: \"5c964cb6-84c7-4706-931a-d5d689cf59fe\") " pod="openshift-monitoring/telemeter-client-fb7f9d697-dnxtq"
Sep 07 13:02:37.955947 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:37.955931    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-554dc\" (UniqueName: \"kubernetes.io/projected/5c964cb6-84c7-4706-931a-d5d689cf59fe-kube-api-access-554dc\") pod \"telemeter-client-fb7f9d697-dnxtq\" (UID: \"5c964cb6-84c7-4706-931a-d5d689cf59fe\") " pod="openshift-monitoring/telemeter-client-fb7f9d697-dnxtq"
Sep 07 13:02:38.051247 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:38.051182    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-fb7f9d697-dnxtq"
Sep 07 13:02:38.340198 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:38.340175    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-fb7f9d697-dnxtq"]
Sep 07 13:02:38.342794 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:02:38.342756    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c964cb6_84c7_4706_931a_d5d689cf59fe.slice/crio-60ebd4f8595b6492f777cd9f07c11182ff797069b542fd90aa2f11f9d8b99ee9 WatchSource:0}: Error finding container 60ebd4f8595b6492f777cd9f07c11182ff797069b542fd90aa2f11f9d8b99ee9: Status 404 returned error can't find the container with id 60ebd4f8595b6492f777cd9f07c11182ff797069b542fd90aa2f11f9d8b99ee9
Sep 07 13:02:39.194494 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:39.194458    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fb7f9d697-dnxtq" event={"ID":"5c964cb6-84c7-4706-931a-d5d689cf59fe","Type":"ContainerStarted","Data":"60ebd4f8595b6492f777cd9f07c11182ff797069b542fd90aa2f11f9d8b99ee9"}
Sep 07 13:02:41.204539 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:41.204465    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fb7f9d697-dnxtq" event={"ID":"5c964cb6-84c7-4706-931a-d5d689cf59fe","Type":"ContainerStarted","Data":"3763ace021051725e81bb798a9051965ab60cd2204f228163ca3a9c99b40ecc7"}
Sep 07 13:02:41.204539 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:41.204519    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fb7f9d697-dnxtq" event={"ID":"5c964cb6-84c7-4706-931a-d5d689cf59fe","Type":"ContainerStarted","Data":"1679b53a6ae4aa92ff65bfd124f41192a229bb748a082270bec3c46107280478"}
Sep 07 13:02:41.204944 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:41.204542    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-fb7f9d697-dnxtq" event={"ID":"5c964cb6-84c7-4706-931a-d5d689cf59fe","Type":"ContainerStarted","Data":"f6c7af9034decc0c747a1940d1b6b4977804553cb756a98c4e588b0744ed25ea"}
Sep 07 13:02:41.228851 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:41.228795    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-fb7f9d697-dnxtq" podStartSLOduration=1.6288653069999999 podStartE2EDuration="4.228730116s" totalImagesPullingTime="2.599864809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:02:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:02:41.227384326 +0000 UTC m=+188.284265984" watchObservedRunningTime="2026-09-07 13:02:41.228730116 +0000 UTC m=+188.285611778"
Sep 07 13:02:41.346077 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:41.346048    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-64f96767cc-t6xkv"]
Sep 07 13:02:41.349517 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:41.349497    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64f96767cc-t6xkv"
Sep 07 13:02:41.368204 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:41.368183    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64f96767cc-t6xkv"]
Sep 07 13:02:41.419958 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:41.419921    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:02:41.480167 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:41.480087    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/900698e5-dc6d-4e20-b213-351deffa4568-console-config\") pod \"console-64f96767cc-t6xkv\" (UID: \"900698e5-dc6d-4e20-b213-351deffa4568\") " pod="openshift-console/console-64f96767cc-t6xkv"
Sep 07 13:02:41.480167 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:41.480150    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/900698e5-dc6d-4e20-b213-351deffa4568-trusted-ca-bundle\") pod \"console-64f96767cc-t6xkv\" (UID: \"900698e5-dc6d-4e20-b213-351deffa4568\") " pod="openshift-console/console-64f96767cc-t6xkv"
Sep 07 13:02:41.480373 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:41.480303    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/900698e5-dc6d-4e20-b213-351deffa4568-console-serving-cert\") pod \"console-64f96767cc-t6xkv\" (UID: \"900698e5-dc6d-4e20-b213-351deffa4568\") " pod="openshift-console/console-64f96767cc-t6xkv"
Sep 07 13:02:41.480427 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:41.480408    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/900698e5-dc6d-4e20-b213-351deffa4568-oauth-serving-cert\") pod \"console-64f96767cc-t6xkv\" (UID: \"900698e5-dc6d-4e20-b213-351deffa4568\") " pod="openshift-console/console-64f96767cc-t6xkv"
Sep 07 13:02:41.480482 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:41.480441    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/900698e5-dc6d-4e20-b213-351deffa4568-console-oauth-config\") pod \"console-64f96767cc-t6xkv\" (UID: \"900698e5-dc6d-4e20-b213-351deffa4568\") " pod="openshift-console/console-64f96767cc-t6xkv"
Sep 07 13:02:41.480534 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:41.480490    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/900698e5-dc6d-4e20-b213-351deffa4568-service-ca\") pod \"console-64f96767cc-t6xkv\" (UID: \"900698e5-dc6d-4e20-b213-351deffa4568\") " pod="openshift-console/console-64f96767cc-t6xkv"
Sep 07 13:02:41.480534 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:41.480528    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hbwk\" (UniqueName: \"kubernetes.io/projected/900698e5-dc6d-4e20-b213-351deffa4568-kube-api-access-8hbwk\") pod \"console-64f96767cc-t6xkv\" (UID: \"900698e5-dc6d-4e20-b213-351deffa4568\") " pod="openshift-console/console-64f96767cc-t6xkv"
Sep 07 13:02:41.531653 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:41.531618    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:02:41.581950 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:41.581918    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/900698e5-dc6d-4e20-b213-351deffa4568-oauth-serving-cert\") pod \"console-64f96767cc-t6xkv\" (UID: \"900698e5-dc6d-4e20-b213-351deffa4568\") " pod="openshift-console/console-64f96767cc-t6xkv"
Sep 07 13:02:41.581950 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:41.581954    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/900698e5-dc6d-4e20-b213-351deffa4568-console-oauth-config\") pod \"console-64f96767cc-t6xkv\" (UID: \"900698e5-dc6d-4e20-b213-351deffa4568\") " pod="openshift-console/console-64f96767cc-t6xkv"
Sep 07 13:02:41.582146 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:41.581978    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/900698e5-dc6d-4e20-b213-351deffa4568-service-ca\") pod \"console-64f96767cc-t6xkv\" (UID: \"900698e5-dc6d-4e20-b213-351deffa4568\") " pod="openshift-console/console-64f96767cc-t6xkv"
Sep 07 13:02:41.582146 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:41.582008    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hbwk\" (UniqueName: \"kubernetes.io/projected/900698e5-dc6d-4e20-b213-351deffa4568-kube-api-access-8hbwk\") pod \"console-64f96767cc-t6xkv\" (UID: \"900698e5-dc6d-4e20-b213-351deffa4568\") " pod="openshift-console/console-64f96767cc-t6xkv"
Sep 07 13:02:41.582146 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:41.582040    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/900698e5-dc6d-4e20-b213-351deffa4568-console-config\") pod \"console-64f96767cc-t6xkv\" (UID: \"900698e5-dc6d-4e20-b213-351deffa4568\") " pod="openshift-console/console-64f96767cc-t6xkv"
Sep 07 13:02:41.582286 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:41.582188    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/900698e5-dc6d-4e20-b213-351deffa4568-trusted-ca-bundle\") pod \"console-64f96767cc-t6xkv\" (UID: \"900698e5-dc6d-4e20-b213-351deffa4568\") " pod="openshift-console/console-64f96767cc-t6xkv"
Sep 07 13:02:41.582286 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:41.582240    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/900698e5-dc6d-4e20-b213-351deffa4568-console-serving-cert\") pod \"console-64f96767cc-t6xkv\" (UID: \"900698e5-dc6d-4e20-b213-351deffa4568\") " pod="openshift-console/console-64f96767cc-t6xkv"
Sep 07 13:02:41.582849 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:41.582824    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/900698e5-dc6d-4e20-b213-351deffa4568-console-config\") pod \"console-64f96767cc-t6xkv\" (UID: \"900698e5-dc6d-4e20-b213-351deffa4568\") " pod="openshift-console/console-64f96767cc-t6xkv"
Sep 07 13:02:41.582985 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:41.582830    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/900698e5-dc6d-4e20-b213-351deffa4568-oauth-serving-cert\") pod \"console-64f96767cc-t6xkv\" (UID: \"900698e5-dc6d-4e20-b213-351deffa4568\") " pod="openshift-console/console-64f96767cc-t6xkv"
Sep 07 13:02:41.582985 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:41.582845    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/900698e5-dc6d-4e20-b213-351deffa4568-service-ca\") pod \"console-64f96767cc-t6xkv\" (UID: \"900698e5-dc6d-4e20-b213-351deffa4568\") " pod="openshift-console/console-64f96767cc-t6xkv"
Sep 07 13:02:41.583061 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:41.583031    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/900698e5-dc6d-4e20-b213-351deffa4568-trusted-ca-bundle\") pod \"console-64f96767cc-t6xkv\" (UID: \"900698e5-dc6d-4e20-b213-351deffa4568\") " pod="openshift-console/console-64f96767cc-t6xkv"
Sep 07 13:02:41.584597 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:41.584578    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/900698e5-dc6d-4e20-b213-351deffa4568-console-oauth-config\") pod \"console-64f96767cc-t6xkv\" (UID: \"900698e5-dc6d-4e20-b213-351deffa4568\") " pod="openshift-console/console-64f96767cc-t6xkv"
Sep 07 13:02:41.584734 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:41.584717    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/900698e5-dc6d-4e20-b213-351deffa4568-console-serving-cert\") pod \"console-64f96767cc-t6xkv\" (UID: \"900698e5-dc6d-4e20-b213-351deffa4568\") " pod="openshift-console/console-64f96767cc-t6xkv"
Sep 07 13:02:41.591638 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:41.591609    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hbwk\" (UniqueName: \"kubernetes.io/projected/900698e5-dc6d-4e20-b213-351deffa4568-kube-api-access-8hbwk\") pod \"console-64f96767cc-t6xkv\" (UID: \"900698e5-dc6d-4e20-b213-351deffa4568\") " pod="openshift-console/console-64f96767cc-t6xkv"
Sep 07 13:02:41.628367 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:41.628320    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:02:41.659422 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:41.659400    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64f96767cc-t6xkv"
Sep 07 13:02:41.937336 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:41.937300    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-64f96767cc-t6xkv"]
Sep 07 13:02:41.941557 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:02:41.941528    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod900698e5_dc6d_4e20_b213_351deffa4568.slice/crio-bb4c7b5003b6f2f838cbe6108df9743010ab7cb53b9d29a5071d7030e01547dc WatchSource:0}: Error finding container bb4c7b5003b6f2f838cbe6108df9743010ab7cb53b9d29a5071d7030e01547dc: Status 404 returned error can't find the container with id bb4c7b5003b6f2f838cbe6108df9743010ab7cb53b9d29a5071d7030e01547dc
Sep 07 13:02:42.139499 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:42.139459    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:02:42.210883 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:42.210799    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64f96767cc-t6xkv" event={"ID":"900698e5-dc6d-4e20-b213-351deffa4568","Type":"ContainerStarted","Data":"8d3becf3a2ab44c9d6d07bf6c5743ade33877aecd6cc0786502075ba12880037"}
Sep 07 13:02:42.210883 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:42.210854    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64f96767cc-t6xkv" event={"ID":"900698e5-dc6d-4e20-b213-351deffa4568","Type":"ContainerStarted","Data":"bb4c7b5003b6f2f838cbe6108df9743010ab7cb53b9d29a5071d7030e01547dc"}
Sep 07 13:02:42.236400 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:42.236350    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-64f96767cc-t6xkv" podStartSLOduration=1.236333151 podStartE2EDuration="1.236333151s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:02:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:02:42.234304054 +0000 UTC m=+189.291185714" watchObservedRunningTime="2026-09-07 13:02:42.236333151 +0000 UTC m=+189.293214809"
Sep 07 13:02:42.242996 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:42.242969    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:02:51.660381 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:51.660342    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-64f96767cc-t6xkv"
Sep 07 13:02:51.660810 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:51.660401    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-64f96767cc-t6xkv"
Sep 07 13:02:51.665289 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:51.665266    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-64f96767cc-t6xkv"
Sep 07 13:02:52.256175 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:52.256144    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-64f96767cc-t6xkv"
Sep 07 13:02:52.331791 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:52.331742    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f447977d6-dssfr"]
Sep 07 13:02:52.565466 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:52.565381    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:02:52.666249 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:02:52.666215    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:03:12.906785 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:12.906719    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:03:13.055276 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:13.055248    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:03:17.352662 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:17.352619    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6f447977d6-dssfr" podUID="31b49ded-a917-4cf4-8a0c-1ecbf7576e4a" containerName="console" containerID="cri-o://1103cd990c2e2768a86f803285a60f59e3910c877f9deb6734cbdf1a4b1411d3" gracePeriod=15
Sep 07 13:03:17.597482 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:17.597459    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f447977d6-dssfr"
Sep 07 13:03:17.691644 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:17.691603    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-oauth-serving-cert\") pod \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\" (UID: \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\") "
Sep 07 13:03:17.691644 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:17.691656    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-trusted-ca-bundle\") pod \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\" (UID: \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\") "
Sep 07 13:03:17.691893 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:17.691692    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-console-serving-cert\") pod \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\" (UID: \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\") "
Sep 07 13:03:17.691893 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:17.691712    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-console-oauth-config\") pod \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\" (UID: \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\") "
Sep 07 13:03:17.691893 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:17.691737    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gsscr\" (UniqueName: \"kubernetes.io/projected/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-kube-api-access-gsscr\") pod \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\" (UID: \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\") "
Sep 07 13:03:17.691893 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:17.691756    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-service-ca\") pod \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\" (UID: \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\") "
Sep 07 13:03:17.691893 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:17.691850    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-console-config\") pod \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\" (UID: \"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a\") "
Sep 07 13:03:17.692227 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:17.692094    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "31b49ded-a917-4cf4-8a0c-1ecbf7576e4a" (UID: "31b49ded-a917-4cf4-8a0c-1ecbf7576e4a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:03:17.692318 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:17.692295    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-service-ca" (OuterVolumeSpecName: "service-ca") pod "31b49ded-a917-4cf4-8a0c-1ecbf7576e4a" (UID: "31b49ded-a917-4cf4-8a0c-1ecbf7576e4a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:03:17.692376 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:17.692327    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "31b49ded-a917-4cf4-8a0c-1ecbf7576e4a" (UID: "31b49ded-a917-4cf4-8a0c-1ecbf7576e4a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:03:17.692376 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:17.692362    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-console-config" (OuterVolumeSpecName: "console-config") pod "31b49ded-a917-4cf4-8a0c-1ecbf7576e4a" (UID: "31b49ded-a917-4cf4-8a0c-1ecbf7576e4a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:03:17.694127 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:17.694105    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "31b49ded-a917-4cf4-8a0c-1ecbf7576e4a" (UID: "31b49ded-a917-4cf4-8a0c-1ecbf7576e4a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:03:17.694217 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:17.694201    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-kube-api-access-gsscr" (OuterVolumeSpecName: "kube-api-access-gsscr") pod "31b49ded-a917-4cf4-8a0c-1ecbf7576e4a" (UID: "31b49ded-a917-4cf4-8a0c-1ecbf7576e4a"). InnerVolumeSpecName "kube-api-access-gsscr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:03:17.694270 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:17.694219    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "31b49ded-a917-4cf4-8a0c-1ecbf7576e4a" (UID: "31b49ded-a917-4cf4-8a0c-1ecbf7576e4a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:03:17.793030 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:17.792998    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-console-serving-cert\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:03:17.793030 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:17.793023    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-console-oauth-config\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:03:17.793030 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:17.793033    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gsscr\" (UniqueName: \"kubernetes.io/projected/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-kube-api-access-gsscr\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:03:17.793248 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:17.793042    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-service-ca\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:03:17.793248 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:17.793052    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-console-config\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:03:17.793248 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:17.793060    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-oauth-serving-cert\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:03:17.793248 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:17.793068    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a-trusted-ca-bundle\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:03:18.358090 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:18.358054    2576 generic.go:356] "Generic (PLEG): container finished" podID="31b49ded-a917-4cf4-8a0c-1ecbf7576e4a" containerID="1103cd990c2e2768a86f803285a60f59e3910c877f9deb6734cbdf1a4b1411d3" exitCode=0
Sep 07 13:03:18.358545 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:18.358096    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6f447977d6-dssfr"
Sep 07 13:03:18.358545 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:18.358124    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f447977d6-dssfr" event={"ID":"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a","Type":"ContainerDied","Data":"1103cd990c2e2768a86f803285a60f59e3910c877f9deb6734cbdf1a4b1411d3"}
Sep 07 13:03:18.358545 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:18.358172    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6f447977d6-dssfr" event={"ID":"31b49ded-a917-4cf4-8a0c-1ecbf7576e4a","Type":"ContainerDied","Data":"e355ee759d8a80a6001039f681acc316fd4f31a316d65092a2e2db53eea6219a"}
Sep 07 13:03:18.358545 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:18.358205    2576 scope.go:117] "RemoveContainer" containerID="1103cd990c2e2768a86f803285a60f59e3910c877f9deb6734cbdf1a4b1411d3"
Sep 07 13:03:18.367077 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:18.367059    2576 scope.go:117] "RemoveContainer" containerID="1103cd990c2e2768a86f803285a60f59e3910c877f9deb6734cbdf1a4b1411d3"
Sep 07 13:03:18.367361 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:03:18.367341    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1103cd990c2e2768a86f803285a60f59e3910c877f9deb6734cbdf1a4b1411d3\": container with ID starting with 1103cd990c2e2768a86f803285a60f59e3910c877f9deb6734cbdf1a4b1411d3 not found: ID does not exist" containerID="1103cd990c2e2768a86f803285a60f59e3910c877f9deb6734cbdf1a4b1411d3"
Sep 07 13:03:18.367416 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:18.367371    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1103cd990c2e2768a86f803285a60f59e3910c877f9deb6734cbdf1a4b1411d3"} err="failed to get container status \"1103cd990c2e2768a86f803285a60f59e3910c877f9deb6734cbdf1a4b1411d3\": rpc error: code = NotFound desc = could not find container \"1103cd990c2e2768a86f803285a60f59e3910c877f9deb6734cbdf1a4b1411d3\": container with ID starting with 1103cd990c2e2768a86f803285a60f59e3910c877f9deb6734cbdf1a4b1411d3 not found: ID does not exist"
Sep 07 13:03:18.380910 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:18.380880    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6f447977d6-dssfr"]
Sep 07 13:03:18.384971 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:18.384947    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6f447977d6-dssfr"]
Sep 07 13:03:19.364985 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:19.364952    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31b49ded-a917-4cf4-8a0c-1ecbf7576e4a" path="/var/lib/kubelet/pods/31b49ded-a917-4cf4-8a0c-1ecbf7576e4a/volumes"
Sep 07 13:03:47.916594 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:47.916554    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:03:47.997487 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:47.997451    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:03:51.159871 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:51.159833    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b4fff89bd-7mgl8"]
Sep 07 13:03:51.160266 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:51.160176    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31b49ded-a917-4cf4-8a0c-1ecbf7576e4a" containerName="console"
Sep 07 13:03:51.160266 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:51.160190    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="31b49ded-a917-4cf4-8a0c-1ecbf7576e4a" containerName="console"
Sep 07 13:03:51.160266 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:51.160253    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="31b49ded-a917-4cf4-8a0c-1ecbf7576e4a" containerName="console"
Sep 07 13:03:51.165064 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:51.165038    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b4fff89bd-7mgl8"
Sep 07 13:03:51.179538 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:51.179504    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b4fff89bd-7mgl8"]
Sep 07 13:03:51.227186 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:51.227150    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:03:51.273209 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:51.273179    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-oauth-serving-cert\") pod \"console-6b4fff89bd-7mgl8\" (UID: \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\") " pod="openshift-console/console-6b4fff89bd-7mgl8"
Sep 07 13:03:51.273396 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:51.273236    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj4kq\" (UniqueName: \"kubernetes.io/projected/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-kube-api-access-vj4kq\") pod \"console-6b4fff89bd-7mgl8\" (UID: \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\") " pod="openshift-console/console-6b4fff89bd-7mgl8"
Sep 07 13:03:51.273396 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:51.273319    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-console-oauth-config\") pod \"console-6b4fff89bd-7mgl8\" (UID: \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\") " pod="openshift-console/console-6b4fff89bd-7mgl8"
Sep 07 13:03:51.273396 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:51.273372    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-console-serving-cert\") pod \"console-6b4fff89bd-7mgl8\" (UID: \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\") " pod="openshift-console/console-6b4fff89bd-7mgl8"
Sep 07 13:03:51.273529 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:51.273404    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-console-config\") pod \"console-6b4fff89bd-7mgl8\" (UID: \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\") " pod="openshift-console/console-6b4fff89bd-7mgl8"
Sep 07 13:03:51.273529 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:51.273451    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-service-ca\") pod \"console-6b4fff89bd-7mgl8\" (UID: \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\") " pod="openshift-console/console-6b4fff89bd-7mgl8"
Sep 07 13:03:51.273529 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:51.273472    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-trusted-ca-bundle\") pod \"console-6b4fff89bd-7mgl8\" (UID: \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\") " pod="openshift-console/console-6b4fff89bd-7mgl8"
Sep 07 13:03:51.313958 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:51.313918    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:03:51.374387 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:51.374352    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-console-oauth-config\") pod \"console-6b4fff89bd-7mgl8\" (UID: \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\") " pod="openshift-console/console-6b4fff89bd-7mgl8"
Sep 07 13:03:51.374562 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:51.374406    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-console-serving-cert\") pod \"console-6b4fff89bd-7mgl8\" (UID: \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\") " pod="openshift-console/console-6b4fff89bd-7mgl8"
Sep 07 13:03:51.374562 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:51.374435    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-console-config\") pod \"console-6b4fff89bd-7mgl8\" (UID: \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\") " pod="openshift-console/console-6b4fff89bd-7mgl8"
Sep 07 13:03:51.374562 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:51.374456    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-service-ca\") pod \"console-6b4fff89bd-7mgl8\" (UID: \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\") " pod="openshift-console/console-6b4fff89bd-7mgl8"
Sep 07 13:03:51.374562 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:51.374475    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-trusted-ca-bundle\") pod \"console-6b4fff89bd-7mgl8\" (UID: \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\") " pod="openshift-console/console-6b4fff89bd-7mgl8"
Sep 07 13:03:51.374562 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:51.374500    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-oauth-serving-cert\") pod \"console-6b4fff89bd-7mgl8\" (UID: \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\") " pod="openshift-console/console-6b4fff89bd-7mgl8"
Sep 07 13:03:51.374562 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:51.374551    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj4kq\" (UniqueName: \"kubernetes.io/projected/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-kube-api-access-vj4kq\") pod \"console-6b4fff89bd-7mgl8\" (UID: \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\") " pod="openshift-console/console-6b4fff89bd-7mgl8"
Sep 07 13:03:51.375429 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:51.375393    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-oauth-serving-cert\") pod \"console-6b4fff89bd-7mgl8\" (UID: \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\") " pod="openshift-console/console-6b4fff89bd-7mgl8"
Sep 07 13:03:51.375537 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:51.375428    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-console-config\") pod \"console-6b4fff89bd-7mgl8\" (UID: \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\") " pod="openshift-console/console-6b4fff89bd-7mgl8"
Sep 07 13:03:51.375537 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:51.375437    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-service-ca\") pod \"console-6b4fff89bd-7mgl8\" (UID: \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\") " pod="openshift-console/console-6b4fff89bd-7mgl8"
Sep 07 13:03:51.375759 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:51.375733    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-trusted-ca-bundle\") pod \"console-6b4fff89bd-7mgl8\" (UID: \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\") " pod="openshift-console/console-6b4fff89bd-7mgl8"
Sep 07 13:03:51.377123 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:51.377100    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-console-oauth-config\") pod \"console-6b4fff89bd-7mgl8\" (UID: \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\") " pod="openshift-console/console-6b4fff89bd-7mgl8"
Sep 07 13:03:51.377337 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:51.377315    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-console-serving-cert\") pod \"console-6b4fff89bd-7mgl8\" (UID: \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\") " pod="openshift-console/console-6b4fff89bd-7mgl8"
Sep 07 13:03:51.384003 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:51.383984    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj4kq\" (UniqueName: \"kubernetes.io/projected/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-kube-api-access-vj4kq\") pod \"console-6b4fff89bd-7mgl8\" (UID: \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\") " pod="openshift-console/console-6b4fff89bd-7mgl8"
Sep 07 13:03:51.475103 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:51.475012    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b4fff89bd-7mgl8"
Sep 07 13:03:51.759163 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:51.759088    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b4fff89bd-7mgl8"]
Sep 07 13:03:51.762162 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:03:51.762138    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d2da85e_0fa6_4a11_af94_18b3d6b625bc.slice/crio-243709a5a26ed082330a456627cfafabd1c700fbbcb177c9c8983929fdee5388 WatchSource:0}: Error finding container 243709a5a26ed082330a456627cfafabd1c700fbbcb177c9c8983929fdee5388: Status 404 returned error can't find the container with id 243709a5a26ed082330a456627cfafabd1c700fbbcb177c9c8983929fdee5388
Sep 07 13:03:52.333146 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:52.333110    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:03:52.487416 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:52.487382    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b4fff89bd-7mgl8" event={"ID":"8d2da85e-0fa6-4a11-af94-18b3d6b625bc","Type":"ContainerStarted","Data":"5e16e4a4c8b20aa62759c56b0084d5ebc9d95ca78f15469e57c24ac8475efc72"}
Sep 07 13:03:52.487571 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:52.487430    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b4fff89bd-7mgl8" event={"ID":"8d2da85e-0fa6-4a11-af94-18b3d6b625bc","Type":"ContainerStarted","Data":"243709a5a26ed082330a456627cfafabd1c700fbbcb177c9c8983929fdee5388"}
Sep 07 13:03:52.508334 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:52.508286    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b4fff89bd-7mgl8" podStartSLOduration=1.508269635 podStartE2EDuration="1.508269635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:03:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:03:52.506806758 +0000 UTC m=+259.563688414" watchObservedRunningTime="2026-09-07 13:03:52.508269635 +0000 UTC m=+259.565151294"
Sep 07 13:03:59.925991 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:59.925895    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:03:59.999802 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:03:59.999750    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:04:01.475374 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:01.475338    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b4fff89bd-7mgl8"
Sep 07 13:04:01.475877 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:01.475410    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b4fff89bd-7mgl8"
Sep 07 13:04:01.480263 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:01.480243    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b4fff89bd-7mgl8"
Sep 07 13:04:01.525659 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:01.525637    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b4fff89bd-7mgl8"
Sep 07 13:04:01.598430 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:01.598400    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64f96767cc-t6xkv"]
Sep 07 13:04:01.802800 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:01.802707    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:04:01.901095 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:01.901050    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:04:09.578012 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:09.577970    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:04:09.682933 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:09.682901    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:04:11.900886 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:11.900849    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:04:26.620459 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:26.620400    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-64f96767cc-t6xkv" podUID="900698e5-dc6d-4e20-b213-351deffa4568" containerName="console" containerID="cri-o://8d3becf3a2ab44c9d6d07bf6c5743ade33877aecd6cc0786502075ba12880037" gracePeriod=15
Sep 07 13:04:26.860926 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:26.860903    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64f96767cc-t6xkv"
Sep 07 13:04:26.951354 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:26.951323    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/900698e5-dc6d-4e20-b213-351deffa4568-console-oauth-config\") pod \"900698e5-dc6d-4e20-b213-351deffa4568\" (UID: \"900698e5-dc6d-4e20-b213-351deffa4568\") "
Sep 07 13:04:26.951516 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:26.951359    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/900698e5-dc6d-4e20-b213-351deffa4568-console-serving-cert\") pod \"900698e5-dc6d-4e20-b213-351deffa4568\" (UID: \"900698e5-dc6d-4e20-b213-351deffa4568\") "
Sep 07 13:04:26.951516 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:26.951383    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/900698e5-dc6d-4e20-b213-351deffa4568-oauth-serving-cert\") pod \"900698e5-dc6d-4e20-b213-351deffa4568\" (UID: \"900698e5-dc6d-4e20-b213-351deffa4568\") "
Sep 07 13:04:26.951516 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:26.951418    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/900698e5-dc6d-4e20-b213-351deffa4568-trusted-ca-bundle\") pod \"900698e5-dc6d-4e20-b213-351deffa4568\" (UID: \"900698e5-dc6d-4e20-b213-351deffa4568\") "
Sep 07 13:04:26.951516 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:26.951442    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/900698e5-dc6d-4e20-b213-351deffa4568-console-config\") pod \"900698e5-dc6d-4e20-b213-351deffa4568\" (UID: \"900698e5-dc6d-4e20-b213-351deffa4568\") "
Sep 07 13:04:26.951516 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:26.951456    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/900698e5-dc6d-4e20-b213-351deffa4568-service-ca\") pod \"900698e5-dc6d-4e20-b213-351deffa4568\" (UID: \"900698e5-dc6d-4e20-b213-351deffa4568\") "
Sep 07 13:04:26.951516 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:26.951475    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hbwk\" (UniqueName: \"kubernetes.io/projected/900698e5-dc6d-4e20-b213-351deffa4568-kube-api-access-8hbwk\") pod \"900698e5-dc6d-4e20-b213-351deffa4568\" (UID: \"900698e5-dc6d-4e20-b213-351deffa4568\") "
Sep 07 13:04:26.951931 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:26.951889    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/900698e5-dc6d-4e20-b213-351deffa4568-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "900698e5-dc6d-4e20-b213-351deffa4568" (UID: "900698e5-dc6d-4e20-b213-351deffa4568"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:04:26.951931 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:26.951911    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/900698e5-dc6d-4e20-b213-351deffa4568-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "900698e5-dc6d-4e20-b213-351deffa4568" (UID: "900698e5-dc6d-4e20-b213-351deffa4568"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:04:26.952262 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:26.952027    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/900698e5-dc6d-4e20-b213-351deffa4568-console-config" (OuterVolumeSpecName: "console-config") pod "900698e5-dc6d-4e20-b213-351deffa4568" (UID: "900698e5-dc6d-4e20-b213-351deffa4568"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:04:26.952262 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:26.952032    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/900698e5-dc6d-4e20-b213-351deffa4568-service-ca" (OuterVolumeSpecName: "service-ca") pod "900698e5-dc6d-4e20-b213-351deffa4568" (UID: "900698e5-dc6d-4e20-b213-351deffa4568"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:04:26.953601 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:26.953577    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/900698e5-dc6d-4e20-b213-351deffa4568-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "900698e5-dc6d-4e20-b213-351deffa4568" (UID: "900698e5-dc6d-4e20-b213-351deffa4568"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:04:26.953744 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:26.953722    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/900698e5-dc6d-4e20-b213-351deffa4568-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "900698e5-dc6d-4e20-b213-351deffa4568" (UID: "900698e5-dc6d-4e20-b213-351deffa4568"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:04:26.953837 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:26.953741    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/900698e5-dc6d-4e20-b213-351deffa4568-kube-api-access-8hbwk" (OuterVolumeSpecName: "kube-api-access-8hbwk") pod "900698e5-dc6d-4e20-b213-351deffa4568" (UID: "900698e5-dc6d-4e20-b213-351deffa4568"). InnerVolumeSpecName "kube-api-access-8hbwk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:04:27.052842 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:27.052812    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/900698e5-dc6d-4e20-b213-351deffa4568-console-oauth-config\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:04:27.052842 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:27.052837    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/900698e5-dc6d-4e20-b213-351deffa4568-console-serving-cert\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:04:27.052842 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:27.052847    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/900698e5-dc6d-4e20-b213-351deffa4568-oauth-serving-cert\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:04:27.053038 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:27.052857    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/900698e5-dc6d-4e20-b213-351deffa4568-trusted-ca-bundle\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:04:27.053038 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:27.052868    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/900698e5-dc6d-4e20-b213-351deffa4568-console-config\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:04:27.053038 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:27.052877    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/900698e5-dc6d-4e20-b213-351deffa4568-service-ca\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:04:27.053038 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:27.052884    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hbwk\" (UniqueName: \"kubernetes.io/projected/900698e5-dc6d-4e20-b213-351deffa4568-kube-api-access-8hbwk\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:04:27.623530 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:27.623441    2576 generic.go:356] "Generic (PLEG): container finished" podID="900698e5-dc6d-4e20-b213-351deffa4568" containerID="8d3becf3a2ab44c9d6d07bf6c5743ade33877aecd6cc0786502075ba12880037" exitCode=0
Sep 07 13:04:27.623530 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:27.623478    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-64f96767cc-t6xkv"
Sep 07 13:04:27.623530 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:27.623503    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64f96767cc-t6xkv" event={"ID":"900698e5-dc6d-4e20-b213-351deffa4568","Type":"ContainerDied","Data":"8d3becf3a2ab44c9d6d07bf6c5743ade33877aecd6cc0786502075ba12880037"}
Sep 07 13:04:27.624004 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:27.623550    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-64f96767cc-t6xkv" event={"ID":"900698e5-dc6d-4e20-b213-351deffa4568","Type":"ContainerDied","Data":"bb4c7b5003b6f2f838cbe6108df9743010ab7cb53b9d29a5071d7030e01547dc"}
Sep 07 13:04:27.624004 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:27.623570    2576 scope.go:117] "RemoveContainer" containerID="8d3becf3a2ab44c9d6d07bf6c5743ade33877aecd6cc0786502075ba12880037"
Sep 07 13:04:27.631667 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:27.631636    2576 scope.go:117] "RemoveContainer" containerID="8d3becf3a2ab44c9d6d07bf6c5743ade33877aecd6cc0786502075ba12880037"
Sep 07 13:04:27.631972 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:04:27.631955    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d3becf3a2ab44c9d6d07bf6c5743ade33877aecd6cc0786502075ba12880037\": container with ID starting with 8d3becf3a2ab44c9d6d07bf6c5743ade33877aecd6cc0786502075ba12880037 not found: ID does not exist" containerID="8d3becf3a2ab44c9d6d07bf6c5743ade33877aecd6cc0786502075ba12880037"
Sep 07 13:04:27.632022 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:27.631982    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d3becf3a2ab44c9d6d07bf6c5743ade33877aecd6cc0786502075ba12880037"} err="failed to get container status \"8d3becf3a2ab44c9d6d07bf6c5743ade33877aecd6cc0786502075ba12880037\": rpc error: code = NotFound desc = could not find container \"8d3becf3a2ab44c9d6d07bf6c5743ade33877aecd6cc0786502075ba12880037\": container with ID starting with 8d3becf3a2ab44c9d6d07bf6c5743ade33877aecd6cc0786502075ba12880037 not found: ID does not exist"
Sep 07 13:04:27.639659 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:27.639638    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-64f96767cc-t6xkv"]
Sep 07 13:04:27.643470 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:27.643442    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-64f96767cc-t6xkv"]
Sep 07 13:04:28.241624 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:28.241575    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:04:28.341773 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:28.341746    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:04:29.364591 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:29.364552    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="900698e5-dc6d-4e20-b213-351deffa4568" path="/var/lib/kubelet/pods/900698e5-dc6d-4e20-b213-351deffa4568/volumes"
Sep 07 13:04:33.297815 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:33.297787    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-v9pd8_d2bb2527-1a29-4b7e-b6fb-9be32693a5cd/console-operator/1.log"
Sep 07 13:04:33.301630 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:33.301610    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-v9pd8_d2bb2527-1a29-4b7e-b6fb-9be32693a5cd/console-operator/1.log"
Sep 07 13:04:33.307808 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:04:33.307786    2576 kubelet.go:1648] "Image garbage collection succeeded"
Sep 07 13:05:07.939351 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:07.939309    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:05:09.654370 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:09.654336    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:05:35.234847 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:35.234745    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:05:35.593846 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:35.593738    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:05:39.050590 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:39.050551    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:05:39.151778 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:39.151729    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:05:40.982808 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:40.982757    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:05:41.151211 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:41.151172    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:05:41.311466 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:41.311392    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:05:41.641399 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:41.641361    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-48nf8"]
Sep 07 13:05:41.641798 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:41.641758    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="900698e5-dc6d-4e20-b213-351deffa4568" containerName="console"
Sep 07 13:05:41.641798 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:41.641794    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="900698e5-dc6d-4e20-b213-351deffa4568" containerName="console"
Sep 07 13:05:41.641948 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:41.641922    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="900698e5-dc6d-4e20-b213-351deffa4568" containerName="console"
Sep 07 13:05:41.644721 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:41.644702    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-48nf8"
Sep 07 13:05:41.648211 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:41.648194    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 07 13:05:41.650025 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:41.650011    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 07 13:05:41.653714 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:41.653698    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-xnmlt\""
Sep 07 13:05:41.658711 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:41.658692    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-48nf8"]
Sep 07 13:05:41.727631 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:41.727604    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd879\" (UniqueName: \"kubernetes.io/projected/97ac684d-c9ac-4e8c-bd28-4de5aea9ddd9-kube-api-access-pd879\") pod \"cert-manager-webhook-6486ffd997-48nf8\" (UID: \"97ac684d-c9ac-4e8c-bd28-4de5aea9ddd9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-48nf8"
Sep 07 13:05:41.727727 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:41.727661    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97ac684d-c9ac-4e8c-bd28-4de5aea9ddd9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-48nf8\" (UID: \"97ac684d-c9ac-4e8c-bd28-4de5aea9ddd9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-48nf8"
Sep 07 13:05:41.829102 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:41.829077    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97ac684d-c9ac-4e8c-bd28-4de5aea9ddd9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-48nf8\" (UID: \"97ac684d-c9ac-4e8c-bd28-4de5aea9ddd9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-48nf8"
Sep 07 13:05:41.829197 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:41.829126    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd879\" (UniqueName: \"kubernetes.io/projected/97ac684d-c9ac-4e8c-bd28-4de5aea9ddd9-kube-api-access-pd879\") pod \"cert-manager-webhook-6486ffd997-48nf8\" (UID: \"97ac684d-c9ac-4e8c-bd28-4de5aea9ddd9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-48nf8"
Sep 07 13:05:41.838616 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:41.838585    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97ac684d-c9ac-4e8c-bd28-4de5aea9ddd9-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-48nf8\" (UID: \"97ac684d-c9ac-4e8c-bd28-4de5aea9ddd9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-48nf8"
Sep 07 13:05:41.838694 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:41.838624    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd879\" (UniqueName: \"kubernetes.io/projected/97ac684d-c9ac-4e8c-bd28-4de5aea9ddd9-kube-api-access-pd879\") pod \"cert-manager-webhook-6486ffd997-48nf8\" (UID: \"97ac684d-c9ac-4e8c-bd28-4de5aea9ddd9\") " pod="cert-manager/cert-manager-webhook-6486ffd997-48nf8"
Sep 07 13:05:41.953295 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:41.953221    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-48nf8"
Sep 07 13:05:42.260734 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:42.260523    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-48nf8"]
Sep 07 13:05:42.263380 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:05:42.263353    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97ac684d_c9ac_4e8c_bd28_4de5aea9ddd9.slice/crio-22bdb117a33b0c9e690832f0f9802bf097131ab922ebca2c4952c8e91ec2b888 WatchSource:0}: Error finding container 22bdb117a33b0c9e690832f0f9802bf097131ab922ebca2c4952c8e91ec2b888: Status 404 returned error can't find the container with id 22bdb117a33b0c9e690832f0f9802bf097131ab922ebca2c4952c8e91ec2b888
Sep 07 13:05:42.265345 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:42.265324    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 13:05:42.901811 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:42.901732    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-48nf8" event={"ID":"97ac684d-c9ac-4e8c-bd28-4de5aea9ddd9","Type":"ContainerStarted","Data":"22bdb117a33b0c9e690832f0f9802bf097131ab922ebca2c4952c8e91ec2b888"}
Sep 07 13:05:43.516709 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:43.516671    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:05:43.729993 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:43.729958    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:05:43.820401 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:43.820331    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-l78jb"]
Sep 07 13:05:43.829132 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:43.829099    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-l78jb"
Sep 07 13:05:43.832826 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:43.832803    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-r4dxj\""
Sep 07 13:05:43.835969 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:43.835920    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-l78jb"]
Sep 07 13:05:43.949300 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:43.949265    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d32a2deb-3603-4094-a05a-ea66d3c7db7d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-l78jb\" (UID: \"d32a2deb-3603-4094-a05a-ea66d3c7db7d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-l78jb"
Sep 07 13:05:43.949478 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:43.949396    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k587\" (UniqueName: \"kubernetes.io/projected/d32a2deb-3603-4094-a05a-ea66d3c7db7d-kube-api-access-7k587\") pod \"cert-manager-cainjector-559cdd8c87-l78jb\" (UID: \"d32a2deb-3603-4094-a05a-ea66d3c7db7d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-l78jb"
Sep 07 13:05:44.050217 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:44.050178    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k587\" (UniqueName: \"kubernetes.io/projected/d32a2deb-3603-4094-a05a-ea66d3c7db7d-kube-api-access-7k587\") pod \"cert-manager-cainjector-559cdd8c87-l78jb\" (UID: \"d32a2deb-3603-4094-a05a-ea66d3c7db7d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-l78jb"
Sep 07 13:05:44.050410 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:44.050258    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d32a2deb-3603-4094-a05a-ea66d3c7db7d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-l78jb\" (UID: \"d32a2deb-3603-4094-a05a-ea66d3c7db7d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-l78jb"
Sep 07 13:05:44.065142 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:44.065088    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d32a2deb-3603-4094-a05a-ea66d3c7db7d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-l78jb\" (UID: \"d32a2deb-3603-4094-a05a-ea66d3c7db7d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-l78jb"
Sep 07 13:05:44.065469 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:44.065444    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k587\" (UniqueName: \"kubernetes.io/projected/d32a2deb-3603-4094-a05a-ea66d3c7db7d-kube-api-access-7k587\") pod \"cert-manager-cainjector-559cdd8c87-l78jb\" (UID: \"d32a2deb-3603-4094-a05a-ea66d3c7db7d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-l78jb"
Sep 07 13:05:44.142232 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:44.142200    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-l78jb"
Sep 07 13:05:45.330145 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:45.330121    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-l78jb"]
Sep 07 13:05:45.332191 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:05:45.332150    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd32a2deb_3603_4094_a05a_ea66d3c7db7d.slice/crio-bf42952914bb1631a2a750fa18ec96f016d3c94f36cb8d88e7721ec62de88449 WatchSource:0}: Error finding container bf42952914bb1631a2a750fa18ec96f016d3c94f36cb8d88e7721ec62de88449: Status 404 returned error can't find the container with id bf42952914bb1631a2a750fa18ec96f016d3c94f36cb8d88e7721ec62de88449
Sep 07 13:05:45.833975 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:45.833938    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:05:45.915986 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:45.915954    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-48nf8" event={"ID":"97ac684d-c9ac-4e8c-bd28-4de5aea9ddd9","Type":"ContainerStarted","Data":"1edfee6f0014c15a9e16bfec2d6b36c54827d0ec89d791b96f4e8f5dc2494971"}
Sep 07 13:05:45.916200 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:45.916055    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-48nf8"
Sep 07 13:05:45.917510 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:45.917478    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-l78jb" event={"ID":"d32a2deb-3603-4094-a05a-ea66d3c7db7d","Type":"ContainerStarted","Data":"14a45d5e52697cbd0a0e61cfb6bab43663ef1d0a414a6ad929954e9b552cb46a"}
Sep 07 13:05:45.917510 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:45.917509    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-l78jb" event={"ID":"d32a2deb-3603-4094-a05a-ea66d3c7db7d","Type":"ContainerStarted","Data":"bf42952914bb1631a2a750fa18ec96f016d3c94f36cb8d88e7721ec62de88449"}
Sep 07 13:05:45.934340 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:45.934295    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-48nf8" podStartSLOduration=2.060383115 podStartE2EDuration="4.934279363s" totalImagesPullingTime="2.873896248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:05:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:05:45.933192688 +0000 UTC m=+372.990074347" watchObservedRunningTime="2026-09-07 13:05:45.934279363 +0000 UTC m=+372.991161022"
Sep 07 13:05:45.934974 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:45.934952    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:05:50.254885 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:50.254841    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:05:50.350300 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:50.350261    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:05:51.093090 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:51.093054    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:05:51.924502 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:51.924469    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-48nf8"
Sep 07 13:05:51.941955 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:51.941903    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-l78jb" podStartSLOduration=8.941887836 podStartE2EDuration="8.941887836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:05:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:05:45.950427342 +0000 UTC m=+373.007309001" watchObservedRunningTime="2026-09-07 13:05:51.941887836 +0000 UTC m=+378.998769495"
Sep 07 13:05:57.283942 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:57.283888    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:05:57.384634 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:57.384588    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:05:57.437584 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:57.437555    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58494dbf74-x8qdg"]
Sep 07 13:05:57.441033 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:57.441010    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58494dbf74-x8qdg"
Sep 07 13:05:57.457383 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:57.457356    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58494dbf74-x8qdg"]
Sep 07 13:05:57.504531 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:57.504494    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:05:57.570687 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:57.570584    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxdbn\" (UniqueName: \"kubernetes.io/projected/abfb31fd-c21d-4560-bd91-a3f79785c2f8-kube-api-access-qxdbn\") pod \"console-58494dbf74-x8qdg\" (UID: \"abfb31fd-c21d-4560-bd91-a3f79785c2f8\") " pod="openshift-console/console-58494dbf74-x8qdg"
Sep 07 13:05:57.570687 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:57.570648    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/abfb31fd-c21d-4560-bd91-a3f79785c2f8-oauth-serving-cert\") pod \"console-58494dbf74-x8qdg\" (UID: \"abfb31fd-c21d-4560-bd91-a3f79785c2f8\") " pod="openshift-console/console-58494dbf74-x8qdg"
Sep 07 13:05:57.570942 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:57.570701    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/abfb31fd-c21d-4560-bd91-a3f79785c2f8-console-config\") pod \"console-58494dbf74-x8qdg\" (UID: \"abfb31fd-c21d-4560-bd91-a3f79785c2f8\") " pod="openshift-console/console-58494dbf74-x8qdg"
Sep 07 13:05:57.570942 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:57.570815    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/abfb31fd-c21d-4560-bd91-a3f79785c2f8-console-oauth-config\") pod \"console-58494dbf74-x8qdg\" (UID: \"abfb31fd-c21d-4560-bd91-a3f79785c2f8\") " pod="openshift-console/console-58494dbf74-x8qdg"
Sep 07 13:05:57.570942 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:57.570856    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/abfb31fd-c21d-4560-bd91-a3f79785c2f8-service-ca\") pod \"console-58494dbf74-x8qdg\" (UID: \"abfb31fd-c21d-4560-bd91-a3f79785c2f8\") " pod="openshift-console/console-58494dbf74-x8qdg"
Sep 07 13:05:57.570942 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:57.570886    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/abfb31fd-c21d-4560-bd91-a3f79785c2f8-console-serving-cert\") pod \"console-58494dbf74-x8qdg\" (UID: \"abfb31fd-c21d-4560-bd91-a3f79785c2f8\") " pod="openshift-console/console-58494dbf74-x8qdg"
Sep 07 13:05:57.570942 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:57.570902    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abfb31fd-c21d-4560-bd91-a3f79785c2f8-trusted-ca-bundle\") pod \"console-58494dbf74-x8qdg\" (UID: \"abfb31fd-c21d-4560-bd91-a3f79785c2f8\") " pod="openshift-console/console-58494dbf74-x8qdg"
Sep 07 13:05:57.605241 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:57.605194    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:05:57.672162 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:57.672127    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/abfb31fd-c21d-4560-bd91-a3f79785c2f8-oauth-serving-cert\") pod \"console-58494dbf74-x8qdg\" (UID: \"abfb31fd-c21d-4560-bd91-a3f79785c2f8\") " pod="openshift-console/console-58494dbf74-x8qdg"
Sep 07 13:05:57.672351 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:57.672184    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/abfb31fd-c21d-4560-bd91-a3f79785c2f8-console-config\") pod \"console-58494dbf74-x8qdg\" (UID: \"abfb31fd-c21d-4560-bd91-a3f79785c2f8\") " pod="openshift-console/console-58494dbf74-x8qdg"
Sep 07 13:05:57.672351 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:57.672236    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/abfb31fd-c21d-4560-bd91-a3f79785c2f8-console-oauth-config\") pod \"console-58494dbf74-x8qdg\" (UID: \"abfb31fd-c21d-4560-bd91-a3f79785c2f8\") " pod="openshift-console/console-58494dbf74-x8qdg"
Sep 07 13:05:57.672351 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:57.672273    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/abfb31fd-c21d-4560-bd91-a3f79785c2f8-service-ca\") pod \"console-58494dbf74-x8qdg\" (UID: \"abfb31fd-c21d-4560-bd91-a3f79785c2f8\") " pod="openshift-console/console-58494dbf74-x8qdg"
Sep 07 13:05:57.672351 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:57.672309    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/abfb31fd-c21d-4560-bd91-a3f79785c2f8-console-serving-cert\") pod \"console-58494dbf74-x8qdg\" (UID: \"abfb31fd-c21d-4560-bd91-a3f79785c2f8\") " pod="openshift-console/console-58494dbf74-x8qdg"
Sep 07 13:05:57.672351 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:57.672329    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abfb31fd-c21d-4560-bd91-a3f79785c2f8-trusted-ca-bundle\") pod \"console-58494dbf74-x8qdg\" (UID: \"abfb31fd-c21d-4560-bd91-a3f79785c2f8\") " pod="openshift-console/console-58494dbf74-x8qdg"
Sep 07 13:05:57.672351 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:57.672352    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxdbn\" (UniqueName: \"kubernetes.io/projected/abfb31fd-c21d-4560-bd91-a3f79785c2f8-kube-api-access-qxdbn\") pod \"console-58494dbf74-x8qdg\" (UID: \"abfb31fd-c21d-4560-bd91-a3f79785c2f8\") " pod="openshift-console/console-58494dbf74-x8qdg"
Sep 07 13:05:57.673017 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:57.672992    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/abfb31fd-c21d-4560-bd91-a3f79785c2f8-oauth-serving-cert\") pod \"console-58494dbf74-x8qdg\" (UID: \"abfb31fd-c21d-4560-bd91-a3f79785c2f8\") " pod="openshift-console/console-58494dbf74-x8qdg"
Sep 07 13:05:57.673219 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:57.673092    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/abfb31fd-c21d-4560-bd91-a3f79785c2f8-console-config\") pod \"console-58494dbf74-x8qdg\" (UID: \"abfb31fd-c21d-4560-bd91-a3f79785c2f8\") " pod="openshift-console/console-58494dbf74-x8qdg"
Sep 07 13:05:57.673291 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:57.673273    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/abfb31fd-c21d-4560-bd91-a3f79785c2f8-trusted-ca-bundle\") pod \"console-58494dbf74-x8qdg\" (UID: \"abfb31fd-c21d-4560-bd91-a3f79785c2f8\") " pod="openshift-console/console-58494dbf74-x8qdg"
Sep 07 13:05:57.673336 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:57.673194    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/abfb31fd-c21d-4560-bd91-a3f79785c2f8-service-ca\") pod \"console-58494dbf74-x8qdg\" (UID: \"abfb31fd-c21d-4560-bd91-a3f79785c2f8\") " pod="openshift-console/console-58494dbf74-x8qdg"
Sep 07 13:05:57.674964 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:57.674939    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/abfb31fd-c21d-4560-bd91-a3f79785c2f8-console-serving-cert\") pod \"console-58494dbf74-x8qdg\" (UID: \"abfb31fd-c21d-4560-bd91-a3f79785c2f8\") " pod="openshift-console/console-58494dbf74-x8qdg"
Sep 07 13:05:57.675059 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:57.674947    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/abfb31fd-c21d-4560-bd91-a3f79785c2f8-console-oauth-config\") pod \"console-58494dbf74-x8qdg\" (UID: \"abfb31fd-c21d-4560-bd91-a3f79785c2f8\") " pod="openshift-console/console-58494dbf74-x8qdg"
Sep 07 13:05:57.682945 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:57.682917    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxdbn\" (UniqueName: \"kubernetes.io/projected/abfb31fd-c21d-4560-bd91-a3f79785c2f8-kube-api-access-qxdbn\") pod \"console-58494dbf74-x8qdg\" (UID: \"abfb31fd-c21d-4560-bd91-a3f79785c2f8\") " pod="openshift-console/console-58494dbf74-x8qdg"
Sep 07 13:05:57.704985 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:57.704952    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:05:57.752499 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:57.752463    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58494dbf74-x8qdg"
Sep 07 13:05:58.032381 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:58.032345    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58494dbf74-x8qdg"]
Sep 07 13:05:58.035313 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:05:58.035286    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabfb31fd_c21d_4560_bd91_a3f79785c2f8.slice/crio-4b80629f64f0ef9af698a13c1d20f02e5850f5f77b80c03a71ca905d676b581b WatchSource:0}: Error finding container 4b80629f64f0ef9af698a13c1d20f02e5850f5f77b80c03a71ca905d676b581b: Status 404 returned error can't find the container with id 4b80629f64f0ef9af698a13c1d20f02e5850f5f77b80c03a71ca905d676b581b
Sep 07 13:05:58.304685 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:58.304593    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:05:58.644091 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:58.644056    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:05:58.794967 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:58.794927    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:05:58.886819 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:58.886786    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:05:58.968837 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:58.968735    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58494dbf74-x8qdg" event={"ID":"abfb31fd-c21d-4560-bd91-a3f79785c2f8","Type":"ContainerStarted","Data":"8d97871f5e6c1e38a1f94b7571c7f7b486c8aaeef584c929b5de5f1e40552990"}
Sep 07 13:05:58.968837 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:58.968817    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58494dbf74-x8qdg" event={"ID":"abfb31fd-c21d-4560-bd91-a3f79785c2f8","Type":"ContainerStarted","Data":"4b80629f64f0ef9af698a13c1d20f02e5850f5f77b80c03a71ca905d676b581b"}
Sep 07 13:05:58.990364 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:58.990318    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58494dbf74-x8qdg" podStartSLOduration=1.990303486 podStartE2EDuration="1.990303486s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:05:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:05:58.988518742 +0000 UTC m=+386.045400401" watchObservedRunningTime="2026-09-07 13:05:58.990303486 +0000 UTC m=+386.047185144"
Sep 07 13:05:59.334294 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:05:59.334207    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:07.753582 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:07.753551    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58494dbf74-x8qdg"
Sep 07 13:06:07.754025 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:07.753813    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58494dbf74-x8qdg"
Sep 07 13:06:07.758418 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:07.758398    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58494dbf74-x8qdg"
Sep 07 13:06:08.008322 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:08.008243    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58494dbf74-x8qdg"
Sep 07 13:06:08.063037 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:08.063004    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b4fff89bd-7mgl8"]
Sep 07 13:06:08.235461 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:08.235426    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:08.366501 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:08.366420    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:11.583032 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:11.582995    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:11.692585 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:11.692548    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:12.370522 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:12.370493    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:12.873651 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:12.873610    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:13.011368 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:13.011327    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:13.142506 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:13.142478    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5545ff49d6-4942p"]
Sep 07 13:06:13.149365 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:13.149339    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5545ff49d6-4942p"
Sep 07 13:06:13.152164 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:13.152141    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vvqfs\""
Sep 07 13:06:13.152668 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:13.152655    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 07 13:06:13.153326 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:13.153308    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 07 13:06:13.153376 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:13.153367    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 07 13:06:13.153950 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:13.153936    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 07 13:06:13.163758 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:13.163730    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5545ff49d6-4942p"]
Sep 07 13:06:13.198680 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:13.198644    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db99403c-d6cf-424f-beca-d5ad61cd13c9-tmp\") pod \"opendatahub-operator-controller-manager-5545ff49d6-4942p\" (UID: \"db99403c-d6cf-424f-beca-d5ad61cd13c9\") " pod="opendatahub/opendatahub-operator-controller-manager-5545ff49d6-4942p"
Sep 07 13:06:13.198890 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:13.198706    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/db99403c-d6cf-424f-beca-d5ad61cd13c9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5545ff49d6-4942p\" (UID: \"db99403c-d6cf-424f-beca-d5ad61cd13c9\") " pod="opendatahub/opendatahub-operator-controller-manager-5545ff49d6-4942p"
Sep 07 13:06:13.198890 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:13.198731    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/db99403c-d6cf-424f-beca-d5ad61cd13c9-manifests\") pod \"opendatahub-operator-controller-manager-5545ff49d6-4942p\" (UID: \"db99403c-d6cf-424f-beca-d5ad61cd13c9\") " pod="opendatahub/opendatahub-operator-controller-manager-5545ff49d6-4942p"
Sep 07 13:06:13.198890 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:13.198817    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clwkc\" (UniqueName: \"kubernetes.io/projected/db99403c-d6cf-424f-beca-d5ad61cd13c9-kube-api-access-clwkc\") pod \"opendatahub-operator-controller-manager-5545ff49d6-4942p\" (UID: \"db99403c-d6cf-424f-beca-d5ad61cd13c9\") " pod="opendatahub/opendatahub-operator-controller-manager-5545ff49d6-4942p"
Sep 07 13:06:13.198890 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:13.198838    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db99403c-d6cf-424f-beca-d5ad61cd13c9-webhook-cert\") pod \"opendatahub-operator-controller-manager-5545ff49d6-4942p\" (UID: \"db99403c-d6cf-424f-beca-d5ad61cd13c9\") " pod="opendatahub/opendatahub-operator-controller-manager-5545ff49d6-4942p"
Sep 07 13:06:13.299610 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:13.299563    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/db99403c-d6cf-424f-beca-d5ad61cd13c9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5545ff49d6-4942p\" (UID: \"db99403c-d6cf-424f-beca-d5ad61cd13c9\") " pod="opendatahub/opendatahub-operator-controller-manager-5545ff49d6-4942p"
Sep 07 13:06:13.299610 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:13.299612    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/db99403c-d6cf-424f-beca-d5ad61cd13c9-manifests\") pod \"opendatahub-operator-controller-manager-5545ff49d6-4942p\" (UID: \"db99403c-d6cf-424f-beca-d5ad61cd13c9\") " pod="opendatahub/opendatahub-operator-controller-manager-5545ff49d6-4942p"
Sep 07 13:06:13.299918 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:13.299760    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clwkc\" (UniqueName: \"kubernetes.io/projected/db99403c-d6cf-424f-beca-d5ad61cd13c9-kube-api-access-clwkc\") pod \"opendatahub-operator-controller-manager-5545ff49d6-4942p\" (UID: \"db99403c-d6cf-424f-beca-d5ad61cd13c9\") " pod="opendatahub/opendatahub-operator-controller-manager-5545ff49d6-4942p"
Sep 07 13:06:13.299918 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:13.299824    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db99403c-d6cf-424f-beca-d5ad61cd13c9-webhook-cert\") pod \"opendatahub-operator-controller-manager-5545ff49d6-4942p\" (UID: \"db99403c-d6cf-424f-beca-d5ad61cd13c9\") " pod="opendatahub/opendatahub-operator-controller-manager-5545ff49d6-4942p"
Sep 07 13:06:13.299918 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:13.299884    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db99403c-d6cf-424f-beca-d5ad61cd13c9-tmp\") pod \"opendatahub-operator-controller-manager-5545ff49d6-4942p\" (UID: \"db99403c-d6cf-424f-beca-d5ad61cd13c9\") " pod="opendatahub/opendatahub-operator-controller-manager-5545ff49d6-4942p"
Sep 07 13:06:13.300073 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:13.299995    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/db99403c-d6cf-424f-beca-d5ad61cd13c9-manifests\") pod \"opendatahub-operator-controller-manager-5545ff49d6-4942p\" (UID: \"db99403c-d6cf-424f-beca-d5ad61cd13c9\") " pod="opendatahub/opendatahub-operator-controller-manager-5545ff49d6-4942p"
Sep 07 13:06:13.302224 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:13.302191    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/db99403c-d6cf-424f-beca-d5ad61cd13c9-tmp\") pod \"opendatahub-operator-controller-manager-5545ff49d6-4942p\" (UID: \"db99403c-d6cf-424f-beca-d5ad61cd13c9\") " pod="opendatahub/opendatahub-operator-controller-manager-5545ff49d6-4942p"
Sep 07 13:06:13.302410 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:13.302384    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/db99403c-d6cf-424f-beca-d5ad61cd13c9-webhook-cert\") pod \"opendatahub-operator-controller-manager-5545ff49d6-4942p\" (UID: \"db99403c-d6cf-424f-beca-d5ad61cd13c9\") " pod="opendatahub/opendatahub-operator-controller-manager-5545ff49d6-4942p"
Sep 07 13:06:13.302453 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:13.302441    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/db99403c-d6cf-424f-beca-d5ad61cd13c9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5545ff49d6-4942p\" (UID: \"db99403c-d6cf-424f-beca-d5ad61cd13c9\") " pod="opendatahub/opendatahub-operator-controller-manager-5545ff49d6-4942p"
Sep 07 13:06:13.310660 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:13.310635    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clwkc\" (UniqueName: \"kubernetes.io/projected/db99403c-d6cf-424f-beca-d5ad61cd13c9-kube-api-access-clwkc\") pod \"opendatahub-operator-controller-manager-5545ff49d6-4942p\" (UID: \"db99403c-d6cf-424f-beca-d5ad61cd13c9\") " pod="opendatahub/opendatahub-operator-controller-manager-5545ff49d6-4942p"
Sep 07 13:06:13.402511 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:13.402433    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:13.459898 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:13.459858    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5545ff49d6-4942p"
Sep 07 13:06:13.591451 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:13.591414    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:13.745648 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:13.745551    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:13.789137 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:13.789095    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5545ff49d6-4942p"]
Sep 07 13:06:13.793201 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:06:13.793175    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb99403c_d6cf_424f_beca_d5ad61cd13c9.slice/crio-ad037664a1585883a58f2742e56657924e6fa812064224acfe9de104dcf34fc1 WatchSource:0}: Error finding container ad037664a1585883a58f2742e56657924e6fa812064224acfe9de104dcf34fc1: Status 404 returned error can't find the container with id ad037664a1585883a58f2742e56657924e6fa812064224acfe9de104dcf34fc1
Sep 07 13:06:13.916640 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:13.916602    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:14.030905 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:14.030817    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5545ff49d6-4942p" event={"ID":"db99403c-d6cf-424f-beca-d5ad61cd13c9","Type":"ContainerStarted","Data":"ad037664a1585883a58f2742e56657924e6fa812064224acfe9de104dcf34fc1"}
Sep 07 13:06:14.055052 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:14.055012    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:14.164515 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:14.164478    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:14.681041 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:14.681004    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:18.052381 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:18.052339    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5545ff49d6-4942p" event={"ID":"db99403c-d6cf-424f-beca-d5ad61cd13c9","Type":"ContainerStarted","Data":"d2a1b50d18fb234973835f510099d1c6e1c04b7e36db7d4aee18630086345c56"}
Sep 07 13:06:18.461180 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:18.461139    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:18.522343 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:18.522308    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:19.058162 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:19.058128    2576 generic.go:356] "Generic (PLEG): container finished" podID="db99403c-d6cf-424f-beca-d5ad61cd13c9" containerID="d2a1b50d18fb234973835f510099d1c6e1c04b7e36db7d4aee18630086345c56" exitCode=0
Sep 07 13:06:19.058533 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:19.058170    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5545ff49d6-4942p" event={"ID":"db99403c-d6cf-424f-beca-d5ad61cd13c9","Type":"ContainerDied","Data":"d2a1b50d18fb234973835f510099d1c6e1c04b7e36db7d4aee18630086345c56"}
Sep 07 13:06:19.628834 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:19.628795    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:19.766643 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:19.766553    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:20.065424 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:20.065332    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5545ff49d6-4942p" event={"ID":"db99403c-d6cf-424f-beca-d5ad61cd13c9","Type":"ContainerStarted","Data":"aa12cf84be4e3e45ad0030603d1ce909d1709baf75dc54cdaafc1b64afb48eae"}
Sep 07 13:06:20.065424 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:20.065420    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5545ff49d6-4942p"
Sep 07 13:06:20.094401 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:20.094343    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5545ff49d6-4942p" podStartSLOduration=2.547544321 podStartE2EDuration="7.094324604s" totalImagesPullingTime="3.533007413s" totalInitContainerRuntime="1.01377287s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:06:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:06:20.092644129 +0000 UTC m=+407.149525817" watchObservedRunningTime="2026-09-07 13:06:20.094324604 +0000 UTC m=+407.151206263"
Sep 07 13:06:20.279520 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:20.279484    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:23.336641 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:23.336602    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:23.445295 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:23.445255    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:31.072172 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:31.072143    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5545ff49d6-4942p"
Sep 07 13:06:32.335630 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:32.335595    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-58cbfb6566-pcgpw"]
Sep 07 13:06:32.339115 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:32.339098    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58cbfb6566-pcgpw"
Sep 07 13:06:32.344532 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:32.344508    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 07 13:06:32.344740 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:32.344598    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 07 13:06:32.346034 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:32.345871    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 07 13:06:32.346515 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:32.346500    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 07 13:06:32.348810 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:32.348793    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-z6v8j\""
Sep 07 13:06:32.357198 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:32.357171    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 07 13:06:32.380901 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:32.380868    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58cbfb6566-pcgpw"]
Sep 07 13:06:32.467724 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:32.467692    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q87zx\" (UniqueName: \"kubernetes.io/projected/6c977864-524e-4aaa-b2a0-8ccff913aa83-kube-api-access-q87zx\") pod \"lws-controller-manager-58cbfb6566-pcgpw\" (UID: \"6c977864-524e-4aaa-b2a0-8ccff913aa83\") " pod="openshift-lws-operator/lws-controller-manager-58cbfb6566-pcgpw"
Sep 07 13:06:32.467968 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:32.467741    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6c977864-524e-4aaa-b2a0-8ccff913aa83-metrics-cert\") pod \"lws-controller-manager-58cbfb6566-pcgpw\" (UID: \"6c977864-524e-4aaa-b2a0-8ccff913aa83\") " pod="openshift-lws-operator/lws-controller-manager-58cbfb6566-pcgpw"
Sep 07 13:06:32.467968 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:32.467801    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c977864-524e-4aaa-b2a0-8ccff913aa83-cert\") pod \"lws-controller-manager-58cbfb6566-pcgpw\" (UID: \"6c977864-524e-4aaa-b2a0-8ccff913aa83\") " pod="openshift-lws-operator/lws-controller-manager-58cbfb6566-pcgpw"
Sep 07 13:06:32.467968 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:32.467888    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6c977864-524e-4aaa-b2a0-8ccff913aa83-manager-config\") pod \"lws-controller-manager-58cbfb6566-pcgpw\" (UID: \"6c977864-524e-4aaa-b2a0-8ccff913aa83\") " pod="openshift-lws-operator/lws-controller-manager-58cbfb6566-pcgpw"
Sep 07 13:06:32.568859 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:32.568826    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q87zx\" (UniqueName: \"kubernetes.io/projected/6c977864-524e-4aaa-b2a0-8ccff913aa83-kube-api-access-q87zx\") pod \"lws-controller-manager-58cbfb6566-pcgpw\" (UID: \"6c977864-524e-4aaa-b2a0-8ccff913aa83\") " pod="openshift-lws-operator/lws-controller-manager-58cbfb6566-pcgpw"
Sep 07 13:06:32.569049 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:32.568866    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6c977864-524e-4aaa-b2a0-8ccff913aa83-metrics-cert\") pod \"lws-controller-manager-58cbfb6566-pcgpw\" (UID: \"6c977864-524e-4aaa-b2a0-8ccff913aa83\") " pod="openshift-lws-operator/lws-controller-manager-58cbfb6566-pcgpw"
Sep 07 13:06:32.569049 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:32.568894    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c977864-524e-4aaa-b2a0-8ccff913aa83-cert\") pod \"lws-controller-manager-58cbfb6566-pcgpw\" (UID: \"6c977864-524e-4aaa-b2a0-8ccff913aa83\") " pod="openshift-lws-operator/lws-controller-manager-58cbfb6566-pcgpw"
Sep 07 13:06:32.569049 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:32.568919    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6c977864-524e-4aaa-b2a0-8ccff913aa83-manager-config\") pod \"lws-controller-manager-58cbfb6566-pcgpw\" (UID: \"6c977864-524e-4aaa-b2a0-8ccff913aa83\") " pod="openshift-lws-operator/lws-controller-manager-58cbfb6566-pcgpw"
Sep 07 13:06:32.569503 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:32.569486    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6c977864-524e-4aaa-b2a0-8ccff913aa83-manager-config\") pod \"lws-controller-manager-58cbfb6566-pcgpw\" (UID: \"6c977864-524e-4aaa-b2a0-8ccff913aa83\") " pod="openshift-lws-operator/lws-controller-manager-58cbfb6566-pcgpw"
Sep 07 13:06:32.571482 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:32.571460    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c977864-524e-4aaa-b2a0-8ccff913aa83-cert\") pod \"lws-controller-manager-58cbfb6566-pcgpw\" (UID: \"6c977864-524e-4aaa-b2a0-8ccff913aa83\") " pod="openshift-lws-operator/lws-controller-manager-58cbfb6566-pcgpw"
Sep 07 13:06:32.571586 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:32.571541    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6c977864-524e-4aaa-b2a0-8ccff913aa83-metrics-cert\") pod \"lws-controller-manager-58cbfb6566-pcgpw\" (UID: \"6c977864-524e-4aaa-b2a0-8ccff913aa83\") " pod="openshift-lws-operator/lws-controller-manager-58cbfb6566-pcgpw"
Sep 07 13:06:32.597379 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:32.597313    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q87zx\" (UniqueName: \"kubernetes.io/projected/6c977864-524e-4aaa-b2a0-8ccff913aa83-kube-api-access-q87zx\") pod \"lws-controller-manager-58cbfb6566-pcgpw\" (UID: \"6c977864-524e-4aaa-b2a0-8ccff913aa83\") " pod="openshift-lws-operator/lws-controller-manager-58cbfb6566-pcgpw"
Sep 07 13:06:32.648460 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:32.648425    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58cbfb6566-pcgpw"
Sep 07 13:06:32.952522 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:32.952487    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58cbfb6566-pcgpw"]
Sep 07 13:06:32.956306 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:06:32.956276    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c977864_524e_4aaa_b2a0_8ccff913aa83.slice/crio-bdccd26098c345f02662c2dc1fadc036e0c43150d3f5f148a2519932200412c5 WatchSource:0}: Error finding container bdccd26098c345f02662c2dc1fadc036e0c43150d3f5f148a2519932200412c5: Status 404 returned error can't find the container with id bdccd26098c345f02662c2dc1fadc036e0c43150d3f5f148a2519932200412c5
Sep 07 13:06:33.019996 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:33.019963    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:33.085252 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:33.085198    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b4fff89bd-7mgl8" podUID="8d2da85e-0fa6-4a11-af94-18b3d6b625bc" containerName="console" containerID="cri-o://5e16e4a4c8b20aa62759c56b0084d5ebc9d95ca78f15469e57c24ac8475efc72" gracePeriod=15
Sep 07 13:06:33.121125 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:33.121087    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58cbfb6566-pcgpw" event={"ID":"6c977864-524e-4aaa-b2a0-8ccff913aa83","Type":"ContainerStarted","Data":"bdccd26098c345f02662c2dc1fadc036e0c43150d3f5f148a2519932200412c5"}
Sep 07 13:06:33.160983 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:33.160949    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:33.337346 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:33.337313    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b4fff89bd-7mgl8"
Sep 07 13:06:33.472161 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:33.472076    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:33.476910 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:33.476887    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-oauth-serving-cert\") pod \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\" (UID: \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\") "
Sep 07 13:06:33.477048 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:33.476978    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-service-ca\") pod \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\" (UID: \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\") "
Sep 07 13:06:33.477048 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:33.477006    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-console-config\") pod \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\" (UID: \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\") "
Sep 07 13:06:33.477133 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:33.477048    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vj4kq\" (UniqueName: \"kubernetes.io/projected/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-kube-api-access-vj4kq\") pod \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\" (UID: \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\") "
Sep 07 13:06:33.477133 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:33.477071    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-console-oauth-config\") pod \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\" (UID: \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\") "
Sep 07 13:06:33.477133 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:33.477104    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-trusted-ca-bundle\") pod \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\" (UID: \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\") "
Sep 07 13:06:33.477277 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:33.477134    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-console-serving-cert\") pod \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\" (UID: \"8d2da85e-0fa6-4a11-af94-18b3d6b625bc\") "
Sep 07 13:06:33.477490 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:33.477351    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8d2da85e-0fa6-4a11-af94-18b3d6b625bc" (UID: "8d2da85e-0fa6-4a11-af94-18b3d6b625bc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:06:33.477490 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:33.477465    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-service-ca" (OuterVolumeSpecName: "service-ca") pod "8d2da85e-0fa6-4a11-af94-18b3d6b625bc" (UID: "8d2da85e-0fa6-4a11-af94-18b3d6b625bc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:06:33.477490 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:33.477474    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-console-config" (OuterVolumeSpecName: "console-config") pod "8d2da85e-0fa6-4a11-af94-18b3d6b625bc" (UID: "8d2da85e-0fa6-4a11-af94-18b3d6b625bc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:06:33.477666 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:33.477593    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8d2da85e-0fa6-4a11-af94-18b3d6b625bc" (UID: "8d2da85e-0fa6-4a11-af94-18b3d6b625bc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:06:33.479361 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:33.479340    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8d2da85e-0fa6-4a11-af94-18b3d6b625bc" (UID: "8d2da85e-0fa6-4a11-af94-18b3d6b625bc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:06:33.479456 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:33.479376    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8d2da85e-0fa6-4a11-af94-18b3d6b625bc" (UID: "8d2da85e-0fa6-4a11-af94-18b3d6b625bc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:06:33.479456 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:33.479387    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-kube-api-access-vj4kq" (OuterVolumeSpecName: "kube-api-access-vj4kq") pod "8d2da85e-0fa6-4a11-af94-18b3d6b625bc" (UID: "8d2da85e-0fa6-4a11-af94-18b3d6b625bc"). InnerVolumeSpecName "kube-api-access-vj4kq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:06:33.578242 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:33.578211    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-oauth-serving-cert\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:06:33.578242 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:33.578239    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-service-ca\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:06:33.578242 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:33.578250    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-console-config\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:06:33.578458 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:33.578259    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vj4kq\" (UniqueName: \"kubernetes.io/projected/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-kube-api-access-vj4kq\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:06:33.578458 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:33.578272    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-console-oauth-config\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:06:33.578458 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:33.578281    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-trusted-ca-bundle\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:06:33.578458 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:33.578288    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8d2da85e-0fa6-4a11-af94-18b3d6b625bc-console-serving-cert\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:06:33.824678 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:33.824560    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:34.129695 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:34.129658    2576 generic.go:356] "Generic (PLEG): container finished" podID="8d2da85e-0fa6-4a11-af94-18b3d6b625bc" containerID="5e16e4a4c8b20aa62759c56b0084d5ebc9d95ca78f15469e57c24ac8475efc72" exitCode=0
Sep 07 13:06:34.130164 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:34.129704    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b4fff89bd-7mgl8"
Sep 07 13:06:34.130164 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:34.129715    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b4fff89bd-7mgl8" event={"ID":"8d2da85e-0fa6-4a11-af94-18b3d6b625bc","Type":"ContainerDied","Data":"5e16e4a4c8b20aa62759c56b0084d5ebc9d95ca78f15469e57c24ac8475efc72"}
Sep 07 13:06:34.130164 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:34.129789    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b4fff89bd-7mgl8" event={"ID":"8d2da85e-0fa6-4a11-af94-18b3d6b625bc","Type":"ContainerDied","Data":"243709a5a26ed082330a456627cfafabd1c700fbbcb177c9c8983929fdee5388"}
Sep 07 13:06:34.130164 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:34.129814    2576 scope.go:117] "RemoveContainer" containerID="5e16e4a4c8b20aa62759c56b0084d5ebc9d95ca78f15469e57c24ac8475efc72"
Sep 07 13:06:34.146860 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:34.146833    2576 scope.go:117] "RemoveContainer" containerID="5e16e4a4c8b20aa62759c56b0084d5ebc9d95ca78f15469e57c24ac8475efc72"
Sep 07 13:06:34.147372 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:06:34.147340    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e16e4a4c8b20aa62759c56b0084d5ebc9d95ca78f15469e57c24ac8475efc72\": container with ID starting with 5e16e4a4c8b20aa62759c56b0084d5ebc9d95ca78f15469e57c24ac8475efc72 not found: ID does not exist" containerID="5e16e4a4c8b20aa62759c56b0084d5ebc9d95ca78f15469e57c24ac8475efc72"
Sep 07 13:06:34.147478 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:34.147380    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e16e4a4c8b20aa62759c56b0084d5ebc9d95ca78f15469e57c24ac8475efc72"} err="failed to get container status \"5e16e4a4c8b20aa62759c56b0084d5ebc9d95ca78f15469e57c24ac8475efc72\": rpc error: code = NotFound desc = could not find container \"5e16e4a4c8b20aa62759c56b0084d5ebc9d95ca78f15469e57c24ac8475efc72\": container with ID starting with 5e16e4a4c8b20aa62759c56b0084d5ebc9d95ca78f15469e57c24ac8475efc72 not found: ID does not exist"
Sep 07 13:06:34.170302 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:34.170270    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b4fff89bd-7mgl8"]
Sep 07 13:06:34.181547 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:34.181515    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b4fff89bd-7mgl8"]
Sep 07 13:06:35.366948 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:35.366904    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d2da85e-0fa6-4a11-af94-18b3d6b625bc" path="/var/lib/kubelet/pods/8d2da85e-0fa6-4a11-af94-18b3d6b625bc/volumes"
Sep 07 13:06:35.674523 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:35.674489    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:35.761273 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:35.761227    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:36.141156 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:36.141123    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58cbfb6566-pcgpw" event={"ID":"6c977864-524e-4aaa-b2a0-8ccff913aa83","Type":"ContainerStarted","Data":"7812644b11a773e4b25fc20bfca55cbd9a7da07c62614101623295f866917257"}
Sep 07 13:06:36.141347 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:36.141272    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-58cbfb6566-pcgpw"
Sep 07 13:06:36.184741 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:36.184684    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-58cbfb6566-pcgpw" podStartSLOduration=1.57619029 podStartE2EDuration="4.184665718s" totalImagesPullingTime="2.608475428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:06:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:06:36.182867677 +0000 UTC m=+423.239749336" watchObservedRunningTime="2026-09-07 13:06:36.184665718 +0000 UTC m=+423.241547377"
Sep 07 13:06:37.180069 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:37.180030    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:40.650497 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:40.650448    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:40.751215 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:40.751178    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:40.922737 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:40.922647    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"]
Sep 07 13:06:40.923044 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:40.923031    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d2da85e-0fa6-4a11-af94-18b3d6b625bc" containerName="console"
Sep 07 13:06:40.923086 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:40.923046    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d2da85e-0fa6-4a11-af94-18b3d6b625bc" containerName="console"
Sep 07 13:06:40.923120 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:40.923103    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d2da85e-0fa6-4a11-af94-18b3d6b625bc" containerName="console"
Sep 07 13:06:40.926125 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:40.926109    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"
Sep 07 13:06:40.928833 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:40.928811    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-vc7fz\""
Sep 07 13:06:40.928833 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:40.928817    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 07 13:06:40.943270 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:40.943240    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"]
Sep 07 13:06:40.957906 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:40.957868    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:41.044288 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:41.044245    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62e5546f-33a9-413a-8af2-49b475643c90-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"
Sep 07 13:06:41.044504 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:41.044299    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62e5546f-33a9-413a-8af2-49b475643c90-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"
Sep 07 13:06:41.044504 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:41.044405    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62e5546f-33a9-413a-8af2-49b475643c90-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"
Sep 07 13:06:41.044504 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:41.044448    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95d4l\" (UniqueName: \"kubernetes.io/projected/62e5546f-33a9-413a-8af2-49b475643c90-kube-api-access-95d4l\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"
Sep 07 13:06:41.044504 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:41.044483    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62e5546f-33a9-413a-8af2-49b475643c90-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"
Sep 07 13:06:41.044704 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:41.044513    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62e5546f-33a9-413a-8af2-49b475643c90-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"
Sep 07 13:06:41.044704 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:41.044647    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62e5546f-33a9-413a-8af2-49b475643c90-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"
Sep 07 13:06:41.044704 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:41.044686    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62e5546f-33a9-413a-8af2-49b475643c90-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"
Sep 07 13:06:41.044854 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:41.044761    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62e5546f-33a9-413a-8af2-49b475643c90-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"
Sep 07 13:06:41.092397 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:41.092357    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:41.145950 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:41.145911    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62e5546f-33a9-413a-8af2-49b475643c90-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"
Sep 07 13:06:41.145950 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:41.145952    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95d4l\" (UniqueName: \"kubernetes.io/projected/62e5546f-33a9-413a-8af2-49b475643c90-kube-api-access-95d4l\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"
Sep 07 13:06:41.146197 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:41.145988    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62e5546f-33a9-413a-8af2-49b475643c90-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"
Sep 07 13:06:41.146197 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:41.146015    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62e5546f-33a9-413a-8af2-49b475643c90-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"
Sep 07 13:06:41.146197 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:41.146056    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62e5546f-33a9-413a-8af2-49b475643c90-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"
Sep 07 13:06:41.146355 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:41.146224    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62e5546f-33a9-413a-8af2-49b475643c90-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"
Sep 07 13:06:41.146355 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:41.146337    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62e5546f-33a9-413a-8af2-49b475643c90-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"
Sep 07 13:06:41.146458 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:41.146352    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62e5546f-33a9-413a-8af2-49b475643c90-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"
Sep 07 13:06:41.146458 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:41.146377    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62e5546f-33a9-413a-8af2-49b475643c90-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"
Sep 07 13:06:41.146458 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:41.146413    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62e5546f-33a9-413a-8af2-49b475643c90-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"
Sep 07 13:06:41.146458 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:41.146419    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62e5546f-33a9-413a-8af2-49b475643c90-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"
Sep 07 13:06:41.146633 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:41.146613    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62e5546f-33a9-413a-8af2-49b475643c90-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"
Sep 07 13:06:41.146730 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:41.146709    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62e5546f-33a9-413a-8af2-49b475643c90-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"
Sep 07 13:06:41.147046 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:41.147024    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62e5546f-33a9-413a-8af2-49b475643c90-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"
Sep 07 13:06:41.148398 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:41.148376    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62e5546f-33a9-413a-8af2-49b475643c90-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"
Sep 07 13:06:41.148927 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:41.148907    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62e5546f-33a9-413a-8af2-49b475643c90-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"
Sep 07 13:06:41.154811 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:41.154787    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95d4l\" (UniqueName: \"kubernetes.io/projected/62e5546f-33a9-413a-8af2-49b475643c90-kube-api-access-95d4l\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"
Sep 07 13:06:41.155297 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:41.155271    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62e5546f-33a9-413a-8af2-49b475643c90-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"
Sep 07 13:06:41.236427 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:41.236327    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"
Sep 07 13:06:41.458221 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:41.458183    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:41.516288 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:41.516263    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"]
Sep 07 13:06:41.518981 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:06:41.518954    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62e5546f_33a9_413a_8af2_49b475643c90.slice/crio-457eb546a515b9336b59f57c82edf40156e15aa22751a968f1515c620d4c60ee WatchSource:0}: Error finding container 457eb546a515b9336b59f57c82edf40156e15aa22751a968f1515c620d4c60ee: Status 404 returned error can't find the container with id 457eb546a515b9336b59f57c82edf40156e15aa22751a968f1515c620d4c60ee
Sep 07 13:06:42.167323 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:42.167290    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc" event={"ID":"62e5546f-33a9-413a-8af2-49b475643c90","Type":"ContainerStarted","Data":"457eb546a515b9336b59f57c82edf40156e15aa22751a968f1515c620d4c60ee"}
Sep 07 13:06:43.859891 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:43.859857    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jx59c"]
Sep 07 13:06:43.866930 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:43.866908    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-jx59c"
Sep 07 13:06:43.869177 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:43.869152    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 07 13:06:43.869311 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:43.869153    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-hzlht\""
Sep 07 13:06:43.874188 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:43.874163    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jx59c"]
Sep 07 13:06:43.891323 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:43.891289    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:43.962467 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:43.962432    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:43.974490 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:43.974438    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h67v\" (UniqueName: \"kubernetes.io/projected/219099a8-0a0b-4510-87ec-cff07e64b9b3-kube-api-access-7h67v\") pod \"odh-model-controller-7998c67dc4-jx59c\" (UID: \"219099a8-0a0b-4510-87ec-cff07e64b9b3\") " pod="opendatahub/odh-model-controller-7998c67dc4-jx59c"
Sep 07 13:06:43.974672 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:43.974534    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/219099a8-0a0b-4510-87ec-cff07e64b9b3-cert\") pod \"odh-model-controller-7998c67dc4-jx59c\" (UID: \"219099a8-0a0b-4510-87ec-cff07e64b9b3\") " pod="opendatahub/odh-model-controller-7998c67dc4-jx59c"
Sep 07 13:06:44.063524 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:44.063487    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:44.075886 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:44.075854    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/219099a8-0a0b-4510-87ec-cff07e64b9b3-cert\") pod \"odh-model-controller-7998c67dc4-jx59c\" (UID: \"219099a8-0a0b-4510-87ec-cff07e64b9b3\") " pod="opendatahub/odh-model-controller-7998c67dc4-jx59c"
Sep 07 13:06:44.076078 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:44.075951    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h67v\" (UniqueName: \"kubernetes.io/projected/219099a8-0a0b-4510-87ec-cff07e64b9b3-kube-api-access-7h67v\") pod \"odh-model-controller-7998c67dc4-jx59c\" (UID: \"219099a8-0a0b-4510-87ec-cff07e64b9b3\") " pod="opendatahub/odh-model-controller-7998c67dc4-jx59c"
Sep 07 13:06:44.076078 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:06:44.076028    2576 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 07 13:06:44.076192 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:06:44.076106    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/219099a8-0a0b-4510-87ec-cff07e64b9b3-cert podName:219099a8-0a0b-4510-87ec-cff07e64b9b3 nodeName:}" failed. No retries permitted until 2026-09-07 13:06:44.576085075 +0000 UTC m=+431.632966736 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/219099a8-0a0b-4510-87ec-cff07e64b9b3-cert") pod "odh-model-controller-7998c67dc4-jx59c" (UID: "219099a8-0a0b-4510-87ec-cff07e64b9b3") : secret "odh-model-controller-webhook-cert" not found
Sep 07 13:06:44.088120 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:44.088088    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h67v\" (UniqueName: \"kubernetes.io/projected/219099a8-0a0b-4510-87ec-cff07e64b9b3-kube-api-access-7h67v\") pod \"odh-model-controller-7998c67dc4-jx59c\" (UID: \"219099a8-0a0b-4510-87ec-cff07e64b9b3\") " pod="opendatahub/odh-model-controller-7998c67dc4-jx59c"
Sep 07 13:06:44.171162 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:44.171122    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:44.275068 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:44.275025    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:44.483443 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:44.483406    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:06:44.483586 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:44.483476    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:06:44.483586 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:44.483503    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:06:44.557721 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:44.551822    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fw2fb"]
Sep 07 13:06:44.558878 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:44.558855    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-fw2fb"
Sep 07 13:06:44.560958 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:44.560938    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 07 13:06:44.566637 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:44.566506    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fw2fb"]
Sep 07 13:06:44.571536 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:44.571510    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:44.579575 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:44.579547    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/219099a8-0a0b-4510-87ec-cff07e64b9b3-cert\") pod \"odh-model-controller-7998c67dc4-jx59c\" (UID: \"219099a8-0a0b-4510-87ec-cff07e64b9b3\") " pod="opendatahub/odh-model-controller-7998c67dc4-jx59c"
Sep 07 13:06:44.582068 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:44.582039    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/219099a8-0a0b-4510-87ec-cff07e64b9b3-cert\") pod \"odh-model-controller-7998c67dc4-jx59c\" (UID: \"219099a8-0a0b-4510-87ec-cff07e64b9b3\") " pod="opendatahub/odh-model-controller-7998c67dc4-jx59c"
Sep 07 13:06:44.680494 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:44.680465    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a69dd3a5-db4c-403a-8961-6e7aed5e70e0-tls-certs\") pod \"model-serving-api-54d89bd5fc-fw2fb\" (UID: \"a69dd3a5-db4c-403a-8961-6e7aed5e70e0\") " pod="opendatahub/model-serving-api-54d89bd5fc-fw2fb"
Sep 07 13:06:44.680653 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:44.680535    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzwd4\" (UniqueName: \"kubernetes.io/projected/a69dd3a5-db4c-403a-8961-6e7aed5e70e0-kube-api-access-rzwd4\") pod \"model-serving-api-54d89bd5fc-fw2fb\" (UID: \"a69dd3a5-db4c-403a-8961-6e7aed5e70e0\") " pod="opendatahub/model-serving-api-54d89bd5fc-fw2fb"
Sep 07 13:06:44.682516 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:44.682484    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:44.780402 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:44.780315    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-jx59c"
Sep 07 13:06:44.781634 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:44.781609    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzwd4\" (UniqueName: \"kubernetes.io/projected/a69dd3a5-db4c-403a-8961-6e7aed5e70e0-kube-api-access-rzwd4\") pod \"model-serving-api-54d89bd5fc-fw2fb\" (UID: \"a69dd3a5-db4c-403a-8961-6e7aed5e70e0\") " pod="opendatahub/model-serving-api-54d89bd5fc-fw2fb"
Sep 07 13:06:44.781710 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:44.781684    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a69dd3a5-db4c-403a-8961-6e7aed5e70e0-tls-certs\") pod \"model-serving-api-54d89bd5fc-fw2fb\" (UID: \"a69dd3a5-db4c-403a-8961-6e7aed5e70e0\") " pod="opendatahub/model-serving-api-54d89bd5fc-fw2fb"
Sep 07 13:06:44.784308 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:44.784286    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a69dd3a5-db4c-403a-8961-6e7aed5e70e0-tls-certs\") pod \"model-serving-api-54d89bd5fc-fw2fb\" (UID: \"a69dd3a5-db4c-403a-8961-6e7aed5e70e0\") " pod="opendatahub/model-serving-api-54d89bd5fc-fw2fb"
Sep 07 13:06:44.791194 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:44.791173    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzwd4\" (UniqueName: \"kubernetes.io/projected/a69dd3a5-db4c-403a-8961-6e7aed5e70e0-kube-api-access-rzwd4\") pod \"model-serving-api-54d89bd5fc-fw2fb\" (UID: \"a69dd3a5-db4c-403a-8961-6e7aed5e70e0\") " pod="opendatahub/model-serving-api-54d89bd5fc-fw2fb"
Sep 07 13:06:44.870184 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:44.870135    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-fw2fb"
Sep 07 13:06:45.057527 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:45.057502    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-jx59c"]
Sep 07 13:06:45.060018 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:06:45.059989    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod219099a8_0a0b_4510_87ec_cff07e64b9b3.slice/crio-0bbb9174edb9ca358d80f3b0a4cd6fc75544cdd389b57cf2cabac2833de4a1f9 WatchSource:0}: Error finding container 0bbb9174edb9ca358d80f3b0a4cd6fc75544cdd389b57cf2cabac2833de4a1f9: Status 404 returned error can't find the container with id 0bbb9174edb9ca358d80f3b0a4cd6fc75544cdd389b57cf2cabac2833de4a1f9
Sep 07 13:06:45.150896 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:45.150789    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fw2fb"]
Sep 07 13:06:45.153482 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:06:45.153455    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda69dd3a5_db4c_403a_8961_6e7aed5e70e0.slice/crio-65c5dbfd0e8b955ddd2fd84ab3d7e0af7075de271ca31c87969a6774be5c26db WatchSource:0}: Error finding container 65c5dbfd0e8b955ddd2fd84ab3d7e0af7075de271ca31c87969a6774be5c26db: Status 404 returned error can't find the container with id 65c5dbfd0e8b955ddd2fd84ab3d7e0af7075de271ca31c87969a6774be5c26db
Sep 07 13:06:45.182982 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:45.182945    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-fw2fb" event={"ID":"a69dd3a5-db4c-403a-8961-6e7aed5e70e0","Type":"ContainerStarted","Data":"65c5dbfd0e8b955ddd2fd84ab3d7e0af7075de271ca31c87969a6774be5c26db"}
Sep 07 13:06:45.184103 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:45.184068    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-jx59c" event={"ID":"219099a8-0a0b-4510-87ec-cff07e64b9b3","Type":"ContainerStarted","Data":"0bbb9174edb9ca358d80f3b0a4cd6fc75544cdd389b57cf2cabac2833de4a1f9"}
Sep 07 13:06:45.185609 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:45.185587    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc" event={"ID":"62e5546f-33a9-413a-8af2-49b475643c90","Type":"ContainerStarted","Data":"ebb1b0dc7363ddc509e92bc47303646f44455de534d78b3dcffe535c69061c6d"}
Sep 07 13:06:45.209139 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:45.209088    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc" podStartSLOduration=2.246994805 podStartE2EDuration="5.209071086s" totalImagesPullingTime="2.962076281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:06:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:06:45.207312896 +0000 UTC m=+432.264194597" watchObservedRunningTime="2026-09-07 13:06:45.209071086 +0000 UTC m=+432.265952746"
Sep 07 13:06:45.236674 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:45.236635    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"
Sep 07 13:06:45.238003 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:45.237974    2576 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Sep 07 13:06:45.238118 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:45.238029    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc" podUID="62e5546f-33a9-413a-8af2-49b475643c90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Sep 07 13:06:45.936891 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:45.936858    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"]
Sep 07 13:06:46.236944 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:46.236862    2576 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Sep 07 13:06:46.236944 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:46.236928    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc" podUID="62e5546f-33a9-413a-8af2-49b475643c90" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Sep 07 13:06:47.148736 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:47.148700    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-58cbfb6566-pcgpw"
Sep 07 13:06:47.197539 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:47.197495    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc" podUID="62e5546f-33a9-413a-8af2-49b475643c90" containerName="istio-proxy" containerID="cri-o://ebb1b0dc7363ddc509e92bc47303646f44455de534d78b3dcffe535c69061c6d" gracePeriod=30
Sep 07 13:06:50.213274 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:50.213222    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-fw2fb" event={"ID":"a69dd3a5-db4c-403a-8961-6e7aed5e70e0","Type":"ContainerStarted","Data":"516a8e1d074732ac7fee5d89234cf513b1b235a735bd2676b49f618f8360609a"}
Sep 07 13:06:50.213855 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:50.213392    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-fw2fb"
Sep 07 13:06:50.215705 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:50.215656    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-jx59c" event={"ID":"219099a8-0a0b-4510-87ec-cff07e64b9b3","Type":"ContainerStarted","Data":"549f7e00a90d911c883a6f385a1155ea44cf7c9dcccbfa39ab504953bca7a40d"}
Sep 07 13:06:50.216416 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:50.216394    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-jx59c"
Sep 07 13:06:50.236865 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:50.236819    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-fw2fb" podStartSLOduration=2.174125569 podStartE2EDuration="6.236803558s" totalImagesPullingTime="4.062677989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:06:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:06:50.235573221 +0000 UTC m=+437.292454883" watchObservedRunningTime="2026-09-07 13:06:50.236803558 +0000 UTC m=+437.293685235"
Sep 07 13:06:50.253990 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:50.253946    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-jx59c" podStartSLOduration=3.093732274 podStartE2EDuration="7.253933452s" totalImagesPullingTime="4.160201178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:06:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:06:50.252491294 +0000 UTC m=+437.309372950" watchObservedRunningTime="2026-09-07 13:06:50.253933452 +0000 UTC m=+437.310815123"
Sep 07 13:06:52.453989 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:52.453953    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"
Sep 07 13:06:52.550275 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:52.550188    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62e5546f-33a9-413a-8af2-49b475643c90-istio-token\") pod \"62e5546f-33a9-413a-8af2-49b475643c90\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") "
Sep 07 13:06:52.550275 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:52.550242    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62e5546f-33a9-413a-8af2-49b475643c90-istio-data\") pod \"62e5546f-33a9-413a-8af2-49b475643c90\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") "
Sep 07 13:06:52.550275 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:52.550265    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62e5546f-33a9-413a-8af2-49b475643c90-istiod-ca-cert\") pod \"62e5546f-33a9-413a-8af2-49b475643c90\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") "
Sep 07 13:06:52.550529 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:52.550329    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62e5546f-33a9-413a-8af2-49b475643c90-credential-socket\") pod \"62e5546f-33a9-413a-8af2-49b475643c90\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") "
Sep 07 13:06:52.550529 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:52.550376    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62e5546f-33a9-413a-8af2-49b475643c90-workload-certs\") pod \"62e5546f-33a9-413a-8af2-49b475643c90\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") "
Sep 07 13:06:52.550529 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:52.550400    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62e5546f-33a9-413a-8af2-49b475643c90-workload-socket\") pod \"62e5546f-33a9-413a-8af2-49b475643c90\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") "
Sep 07 13:06:52.550529 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:52.550427    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95d4l\" (UniqueName: \"kubernetes.io/projected/62e5546f-33a9-413a-8af2-49b475643c90-kube-api-access-95d4l\") pod \"62e5546f-33a9-413a-8af2-49b475643c90\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") "
Sep 07 13:06:52.550529 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:52.550471    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62e5546f-33a9-413a-8af2-49b475643c90-istio-podinfo\") pod \"62e5546f-33a9-413a-8af2-49b475643c90\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") "
Sep 07 13:06:52.550529 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:52.550493    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62e5546f-33a9-413a-8af2-49b475643c90-istio-envoy\") pod \"62e5546f-33a9-413a-8af2-49b475643c90\" (UID: \"62e5546f-33a9-413a-8af2-49b475643c90\") "
Sep 07 13:06:52.550857 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:52.550543    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62e5546f-33a9-413a-8af2-49b475643c90-istio-data" (OuterVolumeSpecName: "istio-data") pod "62e5546f-33a9-413a-8af2-49b475643c90" (UID: "62e5546f-33a9-413a-8af2-49b475643c90"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:06:52.550857 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:52.550636    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62e5546f-33a9-413a-8af2-49b475643c90-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "62e5546f-33a9-413a-8af2-49b475643c90" (UID: "62e5546f-33a9-413a-8af2-49b475643c90"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:06:52.550857 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:52.550655    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62e5546f-33a9-413a-8af2-49b475643c90-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "62e5546f-33a9-413a-8af2-49b475643c90" (UID: "62e5546f-33a9-413a-8af2-49b475643c90"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:06:52.550857 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:52.550760    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/62e5546f-33a9-413a-8af2-49b475643c90-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "62e5546f-33a9-413a-8af2-49b475643c90" (UID: "62e5546f-33a9-413a-8af2-49b475643c90"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:06:52.551052 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:52.550866    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/62e5546f-33a9-413a-8af2-49b475643c90-workload-certs\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:06:52.551052 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:52.550886    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/62e5546f-33a9-413a-8af2-49b475643c90-istio-data\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:06:52.551052 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:52.550899    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/62e5546f-33a9-413a-8af2-49b475643c90-credential-socket\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:06:52.551235 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:52.551053    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62e5546f-33a9-413a-8af2-49b475643c90-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "62e5546f-33a9-413a-8af2-49b475643c90" (UID: "62e5546f-33a9-413a-8af2-49b475643c90"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:06:52.553371 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:52.553345    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62e5546f-33a9-413a-8af2-49b475643c90-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "62e5546f-33a9-413a-8af2-49b475643c90" (UID: "62e5546f-33a9-413a-8af2-49b475643c90"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:06:52.553482 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:52.553459    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62e5546f-33a9-413a-8af2-49b475643c90-istio-token" (OuterVolumeSpecName: "istio-token") pod "62e5546f-33a9-413a-8af2-49b475643c90" (UID: "62e5546f-33a9-413a-8af2-49b475643c90"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:06:52.553540 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:52.553492    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62e5546f-33a9-413a-8af2-49b475643c90-kube-api-access-95d4l" (OuterVolumeSpecName: "kube-api-access-95d4l") pod "62e5546f-33a9-413a-8af2-49b475643c90" (UID: "62e5546f-33a9-413a-8af2-49b475643c90"). InnerVolumeSpecName "kube-api-access-95d4l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:06:52.553540 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:52.553507    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/62e5546f-33a9-413a-8af2-49b475643c90-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "62e5546f-33a9-413a-8af2-49b475643c90" (UID: "62e5546f-33a9-413a-8af2-49b475643c90"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 13:06:52.651524 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:52.651495    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/62e5546f-33a9-413a-8af2-49b475643c90-workload-socket\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:06:52.651524 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:52.651520    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95d4l\" (UniqueName: \"kubernetes.io/projected/62e5546f-33a9-413a-8af2-49b475643c90-kube-api-access-95d4l\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:06:52.651699 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:52.651533    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/62e5546f-33a9-413a-8af2-49b475643c90-istio-podinfo\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:06:52.651699 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:52.651541    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/62e5546f-33a9-413a-8af2-49b475643c90-istio-envoy\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:06:52.651699 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:52.651549    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/62e5546f-33a9-413a-8af2-49b475643c90-istio-token\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:06:52.651699 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:52.651556    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/62e5546f-33a9-413a-8af2-49b475643c90-istiod-ca-cert\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:06:53.231596 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:53.231564    2576 generic.go:356] "Generic (PLEG): container finished" podID="62e5546f-33a9-413a-8af2-49b475643c90" containerID="ebb1b0dc7363ddc509e92bc47303646f44455de534d78b3dcffe535c69061c6d" exitCode=0
Sep 07 13:06:53.231801 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:53.231622    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"
Sep 07 13:06:53.231801 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:53.231629    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc" event={"ID":"62e5546f-33a9-413a-8af2-49b475643c90","Type":"ContainerDied","Data":"ebb1b0dc7363ddc509e92bc47303646f44455de534d78b3dcffe535c69061c6d"}
Sep 07 13:06:53.231801 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:53.231672    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc" event={"ID":"62e5546f-33a9-413a-8af2-49b475643c90","Type":"ContainerDied","Data":"457eb546a515b9336b59f57c82edf40156e15aa22751a968f1515c620d4c60ee"}
Sep 07 13:06:53.231801 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:53.231695    2576 scope.go:117] "RemoveContainer" containerID="ebb1b0dc7363ddc509e92bc47303646f44455de534d78b3dcffe535c69061c6d"
Sep 07 13:06:53.240926 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:53.240906    2576 scope.go:117] "RemoveContainer" containerID="ebb1b0dc7363ddc509e92bc47303646f44455de534d78b3dcffe535c69061c6d"
Sep 07 13:06:53.241184 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:06:53.241164    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebb1b0dc7363ddc509e92bc47303646f44455de534d78b3dcffe535c69061c6d\": container with ID starting with ebb1b0dc7363ddc509e92bc47303646f44455de534d78b3dcffe535c69061c6d not found: ID does not exist" containerID="ebb1b0dc7363ddc509e92bc47303646f44455de534d78b3dcffe535c69061c6d"
Sep 07 13:06:53.241227 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:53.241194    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebb1b0dc7363ddc509e92bc47303646f44455de534d78b3dcffe535c69061c6d"} err="failed to get container status \"ebb1b0dc7363ddc509e92bc47303646f44455de534d78b3dcffe535c69061c6d\": rpc error: code = NotFound desc = could not find container \"ebb1b0dc7363ddc509e92bc47303646f44455de534d78b3dcffe535c69061c6d\": container with ID starting with ebb1b0dc7363ddc509e92bc47303646f44455de534d78b3dcffe535c69061c6d not found: ID does not exist"
Sep 07 13:06:53.255187 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:53.255165    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"]
Sep 07 13:06:53.262943 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:53.262921    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6745bb66bcxgbsc"]
Sep 07 13:06:53.366849 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:53.366814    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="62e5546f-33a9-413a-8af2-49b475643c90" path="/var/lib/kubelet/pods/62e5546f-33a9-413a-8af2-49b475643c90/volumes"
Sep 07 13:06:55.308641 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:55.308551    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:55.449352 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:55.449310    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:55.502441 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:55.502411    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-g99rz"]
Sep 07 13:06:55.502735 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:55.502723    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62e5546f-33a9-413a-8af2-49b475643c90" containerName="istio-proxy"
Sep 07 13:06:55.502811 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:55.502737    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="62e5546f-33a9-413a-8af2-49b475643c90" containerName="istio-proxy"
Sep 07 13:06:55.502851 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:55.502837    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="62e5546f-33a9-413a-8af2-49b475643c90" containerName="istio-proxy"
Sep 07 13:06:55.506132 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:55.506116    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g99rz"
Sep 07 13:06:55.511358 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:55.511334    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 07 13:06:55.511463 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:55.511355    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-dvvn7\""
Sep 07 13:06:55.554456 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:55.554427    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-m7j69"]
Sep 07 13:06:55.557564 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:55.557546    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m7j69"
Sep 07 13:06:55.559729 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:55.559687    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 07 13:06:55.560186 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:55.560172    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-jqb55\""
Sep 07 13:06:55.574823 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:55.574797    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-g99rz"]
Sep 07 13:06:55.576432 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:55.576397    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06b0d273-1cab-48c1-b496-5326a1520599-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-m7j69\" (UID: \"06b0d273-1cab-48c1-b496-5326a1520599\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m7j69"
Sep 07 13:06:55.576529 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:55.576516    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmfcr\" (UniqueName: \"kubernetes.io/projected/06b0d273-1cab-48c1-b496-5326a1520599-kube-api-access-zmfcr\") pod \"llmisvc-controller-manager-777c6bd7d5-m7j69\" (UID: \"06b0d273-1cab-48c1-b496-5326a1520599\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m7j69"
Sep 07 13:06:55.612895 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:55.612870    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:55.622608 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:55.622582    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-m7j69"]
Sep 07 13:06:55.677236 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:55.677200    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmfcr\" (UniqueName: \"kubernetes.io/projected/06b0d273-1cab-48c1-b496-5326a1520599-kube-api-access-zmfcr\") pod \"llmisvc-controller-manager-777c6bd7d5-m7j69\" (UID: \"06b0d273-1cab-48c1-b496-5326a1520599\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m7j69"
Sep 07 13:06:55.677420 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:55.677256    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06b0d273-1cab-48c1-b496-5326a1520599-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-m7j69\" (UID: \"06b0d273-1cab-48c1-b496-5326a1520599\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m7j69"
Sep 07 13:06:55.677420 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:55.677297    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f9f98c9-fd40-4637-b936-eb0bb0de7d03-cert\") pod \"kserve-controller-manager-d6f4b65b8-g99rz\" (UID: \"4f9f98c9-fd40-4637-b936-eb0bb0de7d03\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g99rz"
Sep 07 13:06:55.677420 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:55.677323    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqtqk\" (UniqueName: \"kubernetes.io/projected/4f9f98c9-fd40-4637-b936-eb0bb0de7d03-kube-api-access-xqtqk\") pod \"kserve-controller-manager-d6f4b65b8-g99rz\" (UID: \"4f9f98c9-fd40-4637-b936-eb0bb0de7d03\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g99rz"
Sep 07 13:06:55.677535 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:06:55.677419    2576 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 07 13:06:55.677535 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:06:55.677485    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06b0d273-1cab-48c1-b496-5326a1520599-cert podName:06b0d273-1cab-48c1-b496-5326a1520599 nodeName:}" failed. No retries permitted until 2026-09-07 13:06:56.177471378 +0000 UTC m=+443.234353018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/06b0d273-1cab-48c1-b496-5326a1520599-cert") pod "llmisvc-controller-manager-777c6bd7d5-m7j69" (UID: "06b0d273-1cab-48c1-b496-5326a1520599") : secret "llmisvc-webhook-server-cert" not found
Sep 07 13:06:55.688253 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:55.688229    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmfcr\" (UniqueName: \"kubernetes.io/projected/06b0d273-1cab-48c1-b496-5326a1520599-kube-api-access-zmfcr\") pod \"llmisvc-controller-manager-777c6bd7d5-m7j69\" (UID: \"06b0d273-1cab-48c1-b496-5326a1520599\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m7j69"
Sep 07 13:06:55.757611 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:55.757571    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:55.778542 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:55.778508    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f9f98c9-fd40-4637-b936-eb0bb0de7d03-cert\") pod \"kserve-controller-manager-d6f4b65b8-g99rz\" (UID: \"4f9f98c9-fd40-4637-b936-eb0bb0de7d03\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g99rz"
Sep 07 13:06:55.778678 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:55.778549    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqtqk\" (UniqueName: \"kubernetes.io/projected/4f9f98c9-fd40-4637-b936-eb0bb0de7d03-kube-api-access-xqtqk\") pod \"kserve-controller-manager-d6f4b65b8-g99rz\" (UID: \"4f9f98c9-fd40-4637-b936-eb0bb0de7d03\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g99rz"
Sep 07 13:06:55.781098 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:55.781081    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4f9f98c9-fd40-4637-b936-eb0bb0de7d03-cert\") pod \"kserve-controller-manager-d6f4b65b8-g99rz\" (UID: \"4f9f98c9-fd40-4637-b936-eb0bb0de7d03\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g99rz"
Sep 07 13:06:55.802030 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:55.802002    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqtqk\" (UniqueName: \"kubernetes.io/projected/4f9f98c9-fd40-4637-b936-eb0bb0de7d03-kube-api-access-xqtqk\") pod \"kserve-controller-manager-d6f4b65b8-g99rz\" (UID: \"4f9f98c9-fd40-4637-b936-eb0bb0de7d03\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-g99rz"
Sep 07 13:06:55.816897 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:55.816834    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g99rz"
Sep 07 13:06:55.972561 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:55.972531    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:56.103696 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:56.103670    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-g99rz"]
Sep 07 13:06:56.104894 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:06:56.104871    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f9f98c9_fd40_4637_b936_eb0bb0de7d03.slice/crio-7b56ffb02a82cabd5ccd7d0b1d3cfab01f7e58d10d4d44d47143bdc2043dd4f3 WatchSource:0}: Error finding container 7b56ffb02a82cabd5ccd7d0b1d3cfab01f7e58d10d4d44d47143bdc2043dd4f3: Status 404 returned error can't find the container with id 7b56ffb02a82cabd5ccd7d0b1d3cfab01f7e58d10d4d44d47143bdc2043dd4f3
Sep 07 13:06:56.181366 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:56.181333    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06b0d273-1cab-48c1-b496-5326a1520599-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-m7j69\" (UID: \"06b0d273-1cab-48c1-b496-5326a1520599\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m7j69"
Sep 07 13:06:56.183698 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:56.183682    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/06b0d273-1cab-48c1-b496-5326a1520599-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-m7j69\" (UID: \"06b0d273-1cab-48c1-b496-5326a1520599\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m7j69"
Sep 07 13:06:56.246272 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:56.246248    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g99rz" event={"ID":"4f9f98c9-fd40-4637-b936-eb0bb0de7d03","Type":"ContainerStarted","Data":"7b56ffb02a82cabd5ccd7d0b1d3cfab01f7e58d10d4d44d47143bdc2043dd4f3"}
Sep 07 13:06:56.466754 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:56.466718    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m7j69"
Sep 07 13:06:56.765536 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:56.765457    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-m7j69"]
Sep 07 13:06:56.768787 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:06:56.768737    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod06b0d273_1cab_48c1_b496_5326a1520599.slice/crio-4c544c3faa9f0681c165fe93652bfa3bfd74808110a338be6d057297b88f7630 WatchSource:0}: Error finding container 4c544c3faa9f0681c165fe93652bfa3bfd74808110a338be6d057297b88f7630: Status 404 returned error can't find the container with id 4c544c3faa9f0681c165fe93652bfa3bfd74808110a338be6d057297b88f7630
Sep 07 13:06:56.821624 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:56.821583    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:56.998713 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:56.998662    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:57.165478 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:57.165439    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:06:57.251845 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:57.251810    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m7j69" event={"ID":"06b0d273-1cab-48c1-b496-5326a1520599","Type":"ContainerStarted","Data":"4c544c3faa9f0681c165fe93652bfa3bfd74808110a338be6d057297b88f7630"}
Sep 07 13:06:59.265308 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:59.265269    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g99rz" event={"ID":"4f9f98c9-fd40-4637-b936-eb0bb0de7d03","Type":"ContainerStarted","Data":"82373fbe52e931107cb8a2f02e27fb6aa30642b8bd6895f27fb57f7599e8816f"}
Sep 07 13:06:59.265792 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:59.265434    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g99rz"
Sep 07 13:06:59.291272 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:06:59.291213    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g99rz" podStartSLOduration=1.930652093 podStartE2EDuration="4.29119356s" totalImagesPullingTime="2.360541467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:06:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:06:59.290778723 +0000 UTC m=+446.347660374" watchObservedRunningTime="2026-09-07 13:06:59.29119356 +0000 UTC m=+446.348075219"
Sep 07 13:07:01.225440 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:07:01.225414    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-fw2fb"
Sep 07 13:07:01.277669 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:07:01.277622    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m7j69" event={"ID":"06b0d273-1cab-48c1-b496-5326a1520599","Type":"ContainerStarted","Data":"0ff07a6f7071668171680497892e77ce468ef10abdfd0316c0cc414933970f9c"}
Sep 07 13:07:01.277864 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:07:01.277748    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m7j69"
Sep 07 13:07:01.301025 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:07:01.300959    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m7j69" podStartSLOduration=2.726615712 podStartE2EDuration="6.300937683s" totalImagesPullingTime="3.574321971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:06:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:07:01.298901215 +0000 UTC m=+448.355782874" watchObservedRunningTime="2026-09-07 13:07:01.300937683 +0000 UTC m=+448.357819356"
Sep 07 13:07:02.228597 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:07:02.228567    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-jx59c"
Sep 07 13:07:30.275990 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:07:30.275961    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-g99rz"
Sep 07 13:07:32.286428 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:07:32.286396    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-m7j69"
Sep 07 13:07:44.994632 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:07:44.994589    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:07:45.096302 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:07:45.096271    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:08:25.419146 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:25.419066    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:08:25.512022 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:25.511981    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:08:26.450485 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:26.450422    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:08:29.237522 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:29.237487    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:08:29.644674 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:29.644639    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:08:30.108741 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:30.108656    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:08:30.639526 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:30.639481    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:08:32.554510 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:32.554476    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:08:32.742540 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:32.742504    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:08:33.488343 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:33.488310    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:08:33.802110 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:33.802016    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:08:33.914891 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:33.914849    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:08:34.212529 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:34.212492    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:08:36.286908 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:36.286873    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-zcnpb"]
Sep 07 13:08:36.290111 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:36.290095    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-zcnpb"
Sep 07 13:08:36.293237 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:36.293218    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-4zxmt\""
Sep 07 13:08:36.302297 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:36.302279    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 07 13:08:36.302381 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:36.302282    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 07 13:08:36.314776 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:36.314736    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8btn4\" (UniqueName: \"kubernetes.io/projected/e8cc3baf-7dc7-4703-b7cc-890301e2a493-kube-api-access-8btn4\") pod \"authorino-operator-68d88948d8-zcnpb\" (UID: \"e8cc3baf-7dc7-4703-b7cc-890301e2a493\") " pod="kuadrant-system/authorino-operator-68d88948d8-zcnpb"
Sep 07 13:08:36.350838 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:36.350804    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-zcnpb"]
Sep 07 13:08:36.415440 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:36.415411    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8btn4\" (UniqueName: \"kubernetes.io/projected/e8cc3baf-7dc7-4703-b7cc-890301e2a493-kube-api-access-8btn4\") pod \"authorino-operator-68d88948d8-zcnpb\" (UID: \"e8cc3baf-7dc7-4703-b7cc-890301e2a493\") " pod="kuadrant-system/authorino-operator-68d88948d8-zcnpb"
Sep 07 13:08:36.428340 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:36.428306    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8btn4\" (UniqueName: \"kubernetes.io/projected/e8cc3baf-7dc7-4703-b7cc-890301e2a493-kube-api-access-8btn4\") pod \"authorino-operator-68d88948d8-zcnpb\" (UID: \"e8cc3baf-7dc7-4703-b7cc-890301e2a493\") " pod="kuadrant-system/authorino-operator-68d88948d8-zcnpb"
Sep 07 13:08:36.599106 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:36.599025    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-zcnpb"
Sep 07 13:08:36.686908 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:36.686875    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:08:36.889429 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:36.889398    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-zcnpb"]
Sep 07 13:08:36.892791 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:08:36.892745    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8cc3baf_7dc7_4703_b7cc_890301e2a493.slice/crio-aa3c542b6e9582af3cdc05227290bce2e173c87ddb8ac4d2e692a5a4627f9404 WatchSource:0}: Error finding container aa3c542b6e9582af3cdc05227290bce2e173c87ddb8ac4d2e692a5a4627f9404: Status 404 returned error can't find the container with id aa3c542b6e9582af3cdc05227290bce2e173c87ddb8ac4d2e692a5a4627f9404
Sep 07 13:08:37.702918 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:37.702886    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-zcnpb" event={"ID":"e8cc3baf-7dc7-4703-b7cc-890301e2a493","Type":"ContainerStarted","Data":"aa3c542b6e9582af3cdc05227290bce2e173c87ddb8ac4d2e692a5a4627f9404"}
Sep 07 13:08:37.732709 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:37.732673    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:08:40.690871 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:40.690833    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:08:40.804609 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:40.804576    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:08:40.956237 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:40.956161    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-kc5qj"]
Sep 07 13:08:40.959489 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:40.959467    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-kc5qj"
Sep 07 13:08:40.963617 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:40.963595    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hwcc4\""
Sep 07 13:08:40.963733 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:40.963596    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 07 13:08:40.963733 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:40.963596    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 07 13:08:40.974808 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:40.974783    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-kc5qj"]
Sep 07 13:08:40.991543 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:40.991518    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:08:41.049997 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:41.049973    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b89q4\" (UniqueName: \"kubernetes.io/projected/5509d6ee-76cf-4a10-a45c-50b60681fe98-kube-api-access-b89q4\") pod \"kuadrant-console-plugin-598f86468b-kc5qj\" (UID: \"5509d6ee-76cf-4a10-a45c-50b60681fe98\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-kc5qj"
Sep 07 13:08:41.050110 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:41.050005    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5509d6ee-76cf-4a10-a45c-50b60681fe98-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-kc5qj\" (UID: \"5509d6ee-76cf-4a10-a45c-50b60681fe98\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-kc5qj"
Sep 07 13:08:41.050110 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:41.050029    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5509d6ee-76cf-4a10-a45c-50b60681fe98-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-kc5qj\" (UID: \"5509d6ee-76cf-4a10-a45c-50b60681fe98\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-kc5qj"
Sep 07 13:08:41.100501 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:41.100466    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:08:41.150919 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:41.150888    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b89q4\" (UniqueName: \"kubernetes.io/projected/5509d6ee-76cf-4a10-a45c-50b60681fe98-kube-api-access-b89q4\") pod \"kuadrant-console-plugin-598f86468b-kc5qj\" (UID: \"5509d6ee-76cf-4a10-a45c-50b60681fe98\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-kc5qj"
Sep 07 13:08:41.151055 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:41.150929    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5509d6ee-76cf-4a10-a45c-50b60681fe98-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-kc5qj\" (UID: \"5509d6ee-76cf-4a10-a45c-50b60681fe98\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-kc5qj"
Sep 07 13:08:41.151055 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:41.150956    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5509d6ee-76cf-4a10-a45c-50b60681fe98-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-kc5qj\" (UID: \"5509d6ee-76cf-4a10-a45c-50b60681fe98\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-kc5qj"
Sep 07 13:08:41.151648 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:41.151570    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5509d6ee-76cf-4a10-a45c-50b60681fe98-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-kc5qj\" (UID: \"5509d6ee-76cf-4a10-a45c-50b60681fe98\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-kc5qj"
Sep 07 13:08:41.153354 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:41.153333    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5509d6ee-76cf-4a10-a45c-50b60681fe98-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-kc5qj\" (UID: \"5509d6ee-76cf-4a10-a45c-50b60681fe98\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-kc5qj"
Sep 07 13:08:41.162280 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:41.162261    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b89q4\" (UniqueName: \"kubernetes.io/projected/5509d6ee-76cf-4a10-a45c-50b60681fe98-kube-api-access-b89q4\") pod \"kuadrant-console-plugin-598f86468b-kc5qj\" (UID: \"5509d6ee-76cf-4a10-a45c-50b60681fe98\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-kc5qj"
Sep 07 13:08:41.269155 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:41.269068    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-kc5qj"
Sep 07 13:08:41.540563 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:41.540499    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-kc5qj"]
Sep 07 13:08:41.542686 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:08:41.542660    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5509d6ee_76cf_4a10_a45c_50b60681fe98.slice/crio-aedc9a494c766cac4cf36ee5047705f73364c4b69572249a2d7bffc64f04284d WatchSource:0}: Error finding container aedc9a494c766cac4cf36ee5047705f73364c4b69572249a2d7bffc64f04284d: Status 404 returned error can't find the container with id aedc9a494c766cac4cf36ee5047705f73364c4b69572249a2d7bffc64f04284d
Sep 07 13:08:41.724425 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:41.724391    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-kc5qj" event={"ID":"5509d6ee-76cf-4a10-a45c-50b60681fe98","Type":"ContainerStarted","Data":"aedc9a494c766cac4cf36ee5047705f73364c4b69572249a2d7bffc64f04284d"}
Sep 07 13:08:41.725970 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:41.725949    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-zcnpb" event={"ID":"e8cc3baf-7dc7-4703-b7cc-890301e2a493","Type":"ContainerStarted","Data":"50b5365c3194f091014d30c7592d939878cb17da47607d12bd869914f3bd275a"}
Sep 07 13:08:41.726095 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:41.726084    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-zcnpb"
Sep 07 13:08:45.875667 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:45.875624    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:08:45.993500 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:45.993465    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:08:46.469082 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:46.468994    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:08:46.591833 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:46.591780    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:08:46.756056 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:46.755960    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-kc5qj" event={"ID":"5509d6ee-76cf-4a10-a45c-50b60681fe98","Type":"ContainerStarted","Data":"107101d16eb05b5c8ac9ddc44fa826739ec0e7aea5396118cfdb0a9018ef939d"}
Sep 07 13:08:46.775058 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:46.775009    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-kc5qj" podStartSLOduration=2.142339679 podStartE2EDuration="6.77499209s" totalImagesPullingTime="4.632652411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:08:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:08:46.774040198 +0000 UTC m=+553.830921857" watchObservedRunningTime="2026-09-07 13:08:46.77499209 +0000 UTC m=+553.831873747"
Sep 07 13:08:46.775503 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:46.775481    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-zcnpb" podStartSLOduration=6.689731242 podStartE2EDuration="10.775474483s" totalImagesPullingTime="4.085743241s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:08:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:08:41.748810451 +0000 UTC m=+548.805692109" watchObservedRunningTime="2026-09-07 13:08:46.775474483 +0000 UTC m=+553.832356137"
Sep 07 13:08:47.108254 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:47.108165    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:08:47.232576 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:47.232539    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:08:48.253027 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:48.252992    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:08:52.735840 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:52.735812    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-zcnpb"
Sep 07 13:08:55.941704 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:55.941658    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:08:56.038390 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:56.038359    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:08:56.481009 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:56.480976    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:08:56.578428 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:56.578390    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:08:59.659311 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:59.659265    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:08:59.756047 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:08:59.755997    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:09:02.281815 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:02.281759    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:09:03.449682 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:03.449654    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:09:03.554016 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:03.553981    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:09:09.057515 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:09.057476    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:09:09.150453 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:09.150415    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:09:09.661793 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:09.661740    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:09:09.755590 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:09.755554    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:09:10.087404 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:10.087314    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:09:10.327713 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:10.327678    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:09:18.422396 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:18.422354    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:09:18.705188 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:18.705106    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:09:18.825375 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:18.825334    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:09:21.263027 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:21.262992    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:09:21.376032 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:21.376001    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:09:23.267377 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:23.267337    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:09:23.945482 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:23.945443    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:09:26.109045 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:26.108994    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:09:26.366854 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:26.366749    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:09:26.784621 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:26.784585    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:09:26.787877 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:26.787861    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"
Sep 07 13:09:26.790443 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:26.790418    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 07 13:09:26.812596 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:26.812564    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:09:26.865048 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:26.865012    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:09:26.938126 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:26.938094    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bf705471-c582-48a1-994f-dc50157bfa19-config-file\") pod \"limitador-limitador-85d9db4d5d-c9tx5\" (UID: \"bf705471-c582-48a1-994f-dc50157bfa19\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"
Sep 07 13:09:26.938299 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:26.938138    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjql5\" (UniqueName: \"kubernetes.io/projected/bf705471-c582-48a1-994f-dc50157bfa19-kube-api-access-hjql5\") pod \"limitador-limitador-85d9db4d5d-c9tx5\" (UID: \"bf705471-c582-48a1-994f-dc50157bfa19\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"
Sep 07 13:09:27.039516 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:27.039414    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bf705471-c582-48a1-994f-dc50157bfa19-config-file\") pod \"limitador-limitador-85d9db4d5d-c9tx5\" (UID: \"bf705471-c582-48a1-994f-dc50157bfa19\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"
Sep 07 13:09:27.039516 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:27.039473    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjql5\" (UniqueName: \"kubernetes.io/projected/bf705471-c582-48a1-994f-dc50157bfa19-kube-api-access-hjql5\") pod \"limitador-limitador-85d9db4d5d-c9tx5\" (UID: \"bf705471-c582-48a1-994f-dc50157bfa19\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"
Sep 07 13:09:27.040096 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:27.040077    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bf705471-c582-48a1-994f-dc50157bfa19-config-file\") pod \"limitador-limitador-85d9db4d5d-c9tx5\" (UID: \"bf705471-c582-48a1-994f-dc50157bfa19\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"
Sep 07 13:09:27.050051 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:27.050026    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjql5\" (UniqueName: \"kubernetes.io/projected/bf705471-c582-48a1-994f-dc50157bfa19-kube-api-access-hjql5\") pod \"limitador-limitador-85d9db4d5d-c9tx5\" (UID: \"bf705471-c582-48a1-994f-dc50157bfa19\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"
Sep 07 13:09:27.098475 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:27.098441    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"
Sep 07 13:09:27.370019 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:27.369942    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:09:27.392297 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:27.392269    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:09:27.395197 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:09:27.395171    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf705471_c582_48a1_994f_dc50157bfa19.slice/crio-311b5afa72ac012478a093989cefd316d594dea5bbcc03313a31922c24f154e5 WatchSource:0}: Error finding container 311b5afa72ac012478a093989cefd316d594dea5bbcc03313a31922c24f154e5: Status 404 returned error can't find the container with id 311b5afa72ac012478a093989cefd316d594dea5bbcc03313a31922c24f154e5
Sep 07 13:09:27.596594 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:27.596537    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:09:27.942098 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:27.942063    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5" event={"ID":"bf705471-c582-48a1-994f-dc50157bfa19","Type":"ContainerStarted","Data":"311b5afa72ac012478a093989cefd316d594dea5bbcc03313a31922c24f154e5"}
Sep 07 13:09:28.948180 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:28.948145    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5" event={"ID":"bf705471-c582-48a1-994f-dc50157bfa19","Type":"ContainerStarted","Data":"8355682641fffbbe254b8602dfd9b01ae98d548af80b8ca2245a4e1adf735633"}
Sep 07 13:09:28.948557 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:28.948320    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"
Sep 07 13:09:28.974919 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:28.974872    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5" podStartSLOduration=1.616114093 podStartE2EDuration="2.974856055s" totalImagesPullingTime="1.358741962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:09:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:09:28.974243152 +0000 UTC m=+596.031124822" watchObservedRunningTime="2026-09-07 13:09:28.974856055 +0000 UTC m=+596.031737711"
Sep 07 13:09:33.328481 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:33.328451    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-v9pd8_d2bb2527-1a29-4b7e-b6fb-9be32693a5cd/console-operator/1.log"
Sep 07 13:09:33.329451 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:33.329428    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-v9pd8_d2bb2527-1a29-4b7e-b6fb-9be32693a5cd/console-operator/1.log"
Sep 07 13:09:37.934703 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:37.934659    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:09:39.953869 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:39.953840    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"
Sep 07 13:09:40.320491 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:40.320404    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:09:42.144269 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:42.144228    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:09:42.303898 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:42.303866    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:09:42.783604 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:42.783568    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:09:43.413175 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:43.413142    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:09:55.276215 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:55.276138    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:09:55.547583 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:09:55.547494    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:10:03.409662 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:10:03.409627    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:10:03.549266 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:10:03.549225    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:10:03.781120 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:10:03.781041    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:10:06.895997 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:10:06.895966    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:10:07.046924 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:10:07.046891    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:10:39.797017 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:10:39.796984    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:10:42.987271 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:10:42.987231    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:10:44.605269 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:10:44.605230    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:10:52.213700 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:10:52.213662    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:10:52.300230 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:10:52.300195    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:11:01.535088 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:01.535060    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:11:02.049306 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:02.049277    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:11:18.286691 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:18.286656    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vnnrp"]
Sep 07 13:11:18.290232 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:18.290211    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vnnrp"
Sep 07 13:11:18.296185 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:18.296157    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 07 13:11:18.297022 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:18.297000    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 07 13:11:18.297266 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:18.297249    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-45cgz\""
Sep 07 13:11:18.297350 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:18.297288    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 07 13:11:18.340363 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:18.340329    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vnnrp"]
Sep 07 13:11:18.430350 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:18.430316    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ecadf0a0-420c-475d-af92-c344ac37f9d1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vnnrp\" (UID: \"ecadf0a0-420c-475d-af92-c344ac37f9d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vnnrp"
Sep 07 13:11:18.430350 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:18.430350    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ecadf0a0-420c-475d-af92-c344ac37f9d1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vnnrp\" (UID: \"ecadf0a0-420c-475d-af92-c344ac37f9d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vnnrp"
Sep 07 13:11:18.430603 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:18.430380    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ecadf0a0-420c-475d-af92-c344ac37f9d1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vnnrp\" (UID: \"ecadf0a0-420c-475d-af92-c344ac37f9d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vnnrp"
Sep 07 13:11:18.430603 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:18.430438    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq5d5\" (UniqueName: \"kubernetes.io/projected/ecadf0a0-420c-475d-af92-c344ac37f9d1-kube-api-access-fq5d5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vnnrp\" (UID: \"ecadf0a0-420c-475d-af92-c344ac37f9d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vnnrp"
Sep 07 13:11:18.430603 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:18.430511    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecadf0a0-420c-475d-af92-c344ac37f9d1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vnnrp\" (UID: \"ecadf0a0-420c-475d-af92-c344ac37f9d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vnnrp"
Sep 07 13:11:18.430603 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:18.430535    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecadf0a0-420c-475d-af92-c344ac37f9d1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vnnrp\" (UID: \"ecadf0a0-420c-475d-af92-c344ac37f9d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vnnrp"
Sep 07 13:11:18.449845 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:18.449814    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:11:18.531812 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:18.531757    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ecadf0a0-420c-475d-af92-c344ac37f9d1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vnnrp\" (UID: \"ecadf0a0-420c-475d-af92-c344ac37f9d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vnnrp"
Sep 07 13:11:18.532008 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:18.531853    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq5d5\" (UniqueName: \"kubernetes.io/projected/ecadf0a0-420c-475d-af92-c344ac37f9d1-kube-api-access-fq5d5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vnnrp\" (UID: \"ecadf0a0-420c-475d-af92-c344ac37f9d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vnnrp"
Sep 07 13:11:18.532008 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:18.531941    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecadf0a0-420c-475d-af92-c344ac37f9d1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vnnrp\" (UID: \"ecadf0a0-420c-475d-af92-c344ac37f9d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vnnrp"
Sep 07 13:11:18.532008 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:18.531967    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecadf0a0-420c-475d-af92-c344ac37f9d1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vnnrp\" (UID: \"ecadf0a0-420c-475d-af92-c344ac37f9d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vnnrp"
Sep 07 13:11:18.532164 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:18.532006    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ecadf0a0-420c-475d-af92-c344ac37f9d1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vnnrp\" (UID: \"ecadf0a0-420c-475d-af92-c344ac37f9d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vnnrp"
Sep 07 13:11:18.532164 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:18.532031    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ecadf0a0-420c-475d-af92-c344ac37f9d1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vnnrp\" (UID: \"ecadf0a0-420c-475d-af92-c344ac37f9d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vnnrp"
Sep 07 13:11:18.532267 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:18.532235    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ecadf0a0-420c-475d-af92-c344ac37f9d1-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vnnrp\" (UID: \"ecadf0a0-420c-475d-af92-c344ac37f9d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vnnrp"
Sep 07 13:11:18.532349 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:18.532330    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ecadf0a0-420c-475d-af92-c344ac37f9d1-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vnnrp\" (UID: \"ecadf0a0-420c-475d-af92-c344ac37f9d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vnnrp"
Sep 07 13:11:18.532412 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:18.532399    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ecadf0a0-420c-475d-af92-c344ac37f9d1-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vnnrp\" (UID: \"ecadf0a0-420c-475d-af92-c344ac37f9d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vnnrp"
Sep 07 13:11:18.534355 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:18.534333    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ecadf0a0-420c-475d-af92-c344ac37f9d1-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vnnrp\" (UID: \"ecadf0a0-420c-475d-af92-c344ac37f9d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vnnrp"
Sep 07 13:11:18.534521 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:18.534504    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ecadf0a0-420c-475d-af92-c344ac37f9d1-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vnnrp\" (UID: \"ecadf0a0-420c-475d-af92-c344ac37f9d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vnnrp"
Sep 07 13:11:18.545007 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:18.544955    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq5d5\" (UniqueName: \"kubernetes.io/projected/ecadf0a0-420c-475d-af92-c344ac37f9d1-kube-api-access-fq5d5\") pod \"e2e-distinct-simulated-kserve-59975d69f9-vnnrp\" (UID: \"ecadf0a0-420c-475d-af92-c344ac37f9d1\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vnnrp"
Sep 07 13:11:18.602411 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:18.602375    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vnnrp"
Sep 07 13:11:18.903711 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:18.903682    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-vnnrp"]
Sep 07 13:11:18.904089 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:11:18.904069    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecadf0a0_420c_475d_af92_c344ac37f9d1.slice/crio-c30ce3fa6861a00ee5c0ce51275bcf0287b58641a2af7f78c3d8a3cac4707d5d WatchSource:0}: Error finding container c30ce3fa6861a00ee5c0ce51275bcf0287b58641a2af7f78c3d8a3cac4707d5d: Status 404 returned error can't find the container with id c30ce3fa6861a00ee5c0ce51275bcf0287b58641a2af7f78c3d8a3cac4707d5d
Sep 07 13:11:18.905342 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:18.905321    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 13:11:19.321616 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:19.321523    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:11:19.437710 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:19.437676    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vnnrp" event={"ID":"ecadf0a0-420c-475d-af92-c344ac37f9d1","Type":"ContainerStarted","Data":"c30ce3fa6861a00ee5c0ce51275bcf0287b58641a2af7f78c3d8a3cac4707d5d"}
Sep 07 13:11:20.444024 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:20.443995    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vnnrp" event={"ID":"ecadf0a0-420c-475d-af92-c344ac37f9d1","Type":"ContainerStarted","Data":"d3b250c1646223d01fb2ab2b424614ba7a9564320a3baf52a8f02f2ebd74c3aa"}
Sep 07 13:11:20.483381 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:20.483335    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vnnrp" podStartSLOduration=1.501753291 podStartE2EDuration="2.483319928s" totalImagesPullingTime="981.566637ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:11:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:11:20.477136357 +0000 UTC m=+707.534018028" watchObservedRunningTime="2026-09-07 13:11:20.483319928 +0000 UTC m=+707.540201629"
Sep 07 13:11:23.657665 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:23.657636    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:11:24.744794 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:24.744704    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:11:27.288479 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:27.288439    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:11:28.525187 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:28.525152    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:11:28.602762 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:28.602730    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vnnrp"
Sep 07 13:11:28.602939 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:28.602808    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vnnrp"
Sep 07 13:11:28.615071 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:28.615049    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vnnrp"
Sep 07 13:11:29.495092 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:29.495063    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-vnnrp"
Sep 07 13:11:36.734213 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:36.734176    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:11:38.311778 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:38.311744    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:11:40.718114 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:40.718079    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-nv7nq"]
Sep 07 13:11:40.722350 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:40.722314    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nv7nq"
Sep 07 13:11:40.725397 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:40.725378    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 07 13:11:40.749738 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:40.749715    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-nv7nq"]
Sep 07 13:11:40.830777 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:40.830744    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/218996b8-4158-4188-a9b7-40f5655b0859-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nv7nq\" (UID: \"218996b8-4158-4188-a9b7-40f5655b0859\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nv7nq"
Sep 07 13:11:40.830929 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:40.830810    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/218996b8-4158-4188-a9b7-40f5655b0859-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nv7nq\" (UID: \"218996b8-4158-4188-a9b7-40f5655b0859\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nv7nq"
Sep 07 13:11:40.830929 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:40.830869    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/218996b8-4158-4188-a9b7-40f5655b0859-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nv7nq\" (UID: \"218996b8-4158-4188-a9b7-40f5655b0859\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nv7nq"
Sep 07 13:11:40.830929 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:40.830912    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgzbw\" (UniqueName: \"kubernetes.io/projected/218996b8-4158-4188-a9b7-40f5655b0859-kube-api-access-fgzbw\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nv7nq\" (UID: \"218996b8-4158-4188-a9b7-40f5655b0859\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nv7nq"
Sep 07 13:11:40.831080 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:40.830936    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/218996b8-4158-4188-a9b7-40f5655b0859-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nv7nq\" (UID: \"218996b8-4158-4188-a9b7-40f5655b0859\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nv7nq"
Sep 07 13:11:40.831080 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:40.830951    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/218996b8-4158-4188-a9b7-40f5655b0859-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nv7nq\" (UID: \"218996b8-4158-4188-a9b7-40f5655b0859\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nv7nq"
Sep 07 13:11:40.925417 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:40.925380    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:11:40.931429 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:40.931404    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/218996b8-4158-4188-a9b7-40f5655b0859-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nv7nq\" (UID: \"218996b8-4158-4188-a9b7-40f5655b0859\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nv7nq"
Sep 07 13:11:40.931550 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:40.931437    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/218996b8-4158-4188-a9b7-40f5655b0859-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nv7nq\" (UID: \"218996b8-4158-4188-a9b7-40f5655b0859\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nv7nq"
Sep 07 13:11:40.931550 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:40.931462    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/218996b8-4158-4188-a9b7-40f5655b0859-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nv7nq\" (UID: \"218996b8-4158-4188-a9b7-40f5655b0859\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nv7nq"
Sep 07 13:11:40.931550 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:40.931484    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgzbw\" (UniqueName: \"kubernetes.io/projected/218996b8-4158-4188-a9b7-40f5655b0859-kube-api-access-fgzbw\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nv7nq\" (UID: \"218996b8-4158-4188-a9b7-40f5655b0859\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nv7nq"
Sep 07 13:11:40.931550 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:40.931513    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/218996b8-4158-4188-a9b7-40f5655b0859-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nv7nq\" (UID: \"218996b8-4158-4188-a9b7-40f5655b0859\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nv7nq"
Sep 07 13:11:40.931550 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:40.931529    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/218996b8-4158-4188-a9b7-40f5655b0859-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nv7nq\" (UID: \"218996b8-4158-4188-a9b7-40f5655b0859\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nv7nq"
Sep 07 13:11:40.931878 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:40.931851    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/218996b8-4158-4188-a9b7-40f5655b0859-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nv7nq\" (UID: \"218996b8-4158-4188-a9b7-40f5655b0859\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nv7nq"
Sep 07 13:11:40.932036 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:40.932010    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/218996b8-4158-4188-a9b7-40f5655b0859-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nv7nq\" (UID: \"218996b8-4158-4188-a9b7-40f5655b0859\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nv7nq"
Sep 07 13:11:40.932118 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:40.931911    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/218996b8-4158-4188-a9b7-40f5655b0859-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nv7nq\" (UID: \"218996b8-4158-4188-a9b7-40f5655b0859\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nv7nq"
Sep 07 13:11:40.933974 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:40.933953    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/218996b8-4158-4188-a9b7-40f5655b0859-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nv7nq\" (UID: \"218996b8-4158-4188-a9b7-40f5655b0859\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nv7nq"
Sep 07 13:11:40.934110 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:40.934092    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/218996b8-4158-4188-a9b7-40f5655b0859-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nv7nq\" (UID: \"218996b8-4158-4188-a9b7-40f5655b0859\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nv7nq"
Sep 07 13:11:40.965310 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:40.965281    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgzbw\" (UniqueName: \"kubernetes.io/projected/218996b8-4158-4188-a9b7-40f5655b0859-kube-api-access-fgzbw\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-nv7nq\" (UID: \"218996b8-4158-4188-a9b7-40f5655b0859\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nv7nq"
Sep 07 13:11:41.033639 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:41.033569    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nv7nq"
Sep 07 13:11:41.334272 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:41.334120    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-nv7nq"]
Sep 07 13:11:41.337089 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:11:41.337063    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod218996b8_4158_4188_a9b7_40f5655b0859.slice/crio-ba5edb573dfb980a147b462e7fa4c9e15b86cce58d10c4efe2a97932e57db9cc WatchSource:0}: Error finding container ba5edb573dfb980a147b462e7fa4c9e15b86cce58d10c4efe2a97932e57db9cc: Status 404 returned error can't find the container with id ba5edb573dfb980a147b462e7fa4c9e15b86cce58d10c4efe2a97932e57db9cc
Sep 07 13:11:41.541983 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:41.541957    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nv7nq" event={"ID":"218996b8-4158-4188-a9b7-40f5655b0859","Type":"ContainerStarted","Data":"ba5edb573dfb980a147b462e7fa4c9e15b86cce58d10c4efe2a97932e57db9cc"}
Sep 07 13:11:42.548469 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:42.548428    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nv7nq" event={"ID":"218996b8-4158-4188-a9b7-40f5655b0859","Type":"ContainerStarted","Data":"d5fd43248230fc04bacd0e2748622f492724d20cb6c9167cd9553571365a6b66"}
Sep 07 13:11:42.576306 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:42.576259    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nv7nq" podStartSLOduration=2.39484866 podStartE2EDuration="2.576242985s" totalImagesPullingTime="181.394325ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:11:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:11:42.576041864 +0000 UTC m=+729.632923540" watchObservedRunningTime="2026-09-07 13:11:42.576242985 +0000 UTC m=+729.633124643"
Sep 07 13:11:43.739063 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:43.739033    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:11:51.034038 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:51.033996    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nv7nq"
Sep 07 13:11:51.034627 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:51.034073    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nv7nq"
Sep 07 13:11:51.046447 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:51.046418    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nv7nq"
Sep 07 13:11:51.603441 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:51.603407    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-nv7nq"
Sep 07 13:11:53.245537 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:53.245500    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:11:59.685107 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:11:59.685074    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:12:01.919741 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:12:01.919706    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:12:27.140732 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:12:27.140678    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:12:27.240395 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:12:27.240364    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:13:37.245460 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:13:37.245425    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:13:37.343738 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:13:37.343708    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:13:38.521827 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:13:38.521790    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:13:38.691891 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:13:38.691856    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:13:55.617022 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:13:55.616978    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:13:55.826202 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:13:55.826168    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:13:56.095481 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:13:56.095447    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:13:56.502868 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:13:56.502835    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:13:57.159733 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:13:57.159696    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:13:57.285424 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:13:57.285395    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:13:57.716438 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:13:57.716406    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7265-140064855036976"]
Sep 07 13:13:57.719704 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:13:57.719690    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7265-140064855036976"
Sep 07 13:13:57.722495 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:13:57.722474    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:13:57.722609 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:13:57.722493    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-wb64r\""
Sep 07 13:13:57.729542 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:13:57.729517    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7265-140064855036976"]
Sep 07 13:13:57.845307 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:13:57.845267    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdq65\" (UniqueName: \"kubernetes.io/projected/7e24ca12-8e02-4e64-8791-87db8933c9da-kube-api-access-xdq65\") pod \"test-curl-7265-140064855036976\" (UID: \"7e24ca12-8e02-4e64-8791-87db8933c9da\") " pod="opendatahub/test-curl-7265-140064855036976"
Sep 07 13:13:57.946529 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:13:57.946484    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdq65\" (UniqueName: \"kubernetes.io/projected/7e24ca12-8e02-4e64-8791-87db8933c9da-kube-api-access-xdq65\") pod \"test-curl-7265-140064855036976\" (UID: \"7e24ca12-8e02-4e64-8791-87db8933c9da\") " pod="opendatahub/test-curl-7265-140064855036976"
Sep 07 13:13:57.954906 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:13:57.954886    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdq65\" (UniqueName: \"kubernetes.io/projected/7e24ca12-8e02-4e64-8791-87db8933c9da-kube-api-access-xdq65\") pod \"test-curl-7265-140064855036976\" (UID: \"7e24ca12-8e02-4e64-8791-87db8933c9da\") " pod="opendatahub/test-curl-7265-140064855036976"
Sep 07 13:13:58.029722 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:13:58.029643    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7265-140064855036976"
Sep 07 13:13:58.301640 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:13:58.301534    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7265-140064855036976"]
Sep 07 13:13:58.304326 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:13:58.304302    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7e24ca12_8e02_4e64_8791_87db8933c9da.slice/crio-e061cee53d8a3373ef90fdfc61693b2a1bc9b49eae86f55db96e5959289303f4 WatchSource:0}: Error finding container e061cee53d8a3373ef90fdfc61693b2a1bc9b49eae86f55db96e5959289303f4: Status 404 returned error can't find the container with id e061cee53d8a3373ef90fdfc61693b2a1bc9b49eae86f55db96e5959289303f4
Sep 07 13:13:59.191331 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:13:59.191297    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7265-140064855036976" event={"ID":"7e24ca12-8e02-4e64-8791-87db8933c9da","Type":"ContainerStarted","Data":"e061cee53d8a3373ef90fdfc61693b2a1bc9b49eae86f55db96e5959289303f4"}
Sep 07 13:13:59.237119 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:13:59.237079    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:13:59.335311 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:13:59.335252    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:13:59.651815 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:13:59.651760    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:14:00.459384 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:00.459354    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:00.569507 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:00.569424    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:01.105553 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:01.105523    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:01.202646 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:01.202612    2576 generic.go:356] "Generic (PLEG): container finished" podID="7e24ca12-8e02-4e64-8791-87db8933c9da" containerID="4f3033e9f32d08a38857914512899b6bc7a7aaed083a88f147693c85bf14ac3c" exitCode=0
Sep 07 13:14:01.202831 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:01.202655    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7265-140064855036976" event={"ID":"7e24ca12-8e02-4e64-8791-87db8933c9da","Type":"ContainerDied","Data":"4f3033e9f32d08a38857914512899b6bc7a7aaed083a88f147693c85bf14ac3c"}
Sep 07 13:14:01.210693 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:01.210671    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:02.342169 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:02.342143    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7265-140064855036976"
Sep 07 13:14:02.365787 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:02.365746    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7265-140064855036976_7e24ca12-8e02-4e64-8791-87db8933c9da/test-curl-7265-140064855036976/0.log"
Sep 07 13:14:02.387918 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:02.387894    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdq65\" (UniqueName: \"kubernetes.io/projected/7e24ca12-8e02-4e64-8791-87db8933c9da-kube-api-access-xdq65\") pod \"7e24ca12-8e02-4e64-8791-87db8933c9da\" (UID: \"7e24ca12-8e02-4e64-8791-87db8933c9da\") "
Sep 07 13:14:02.389868 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:02.389840    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7265-140064855036976"]
Sep 07 13:14:02.390244 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:02.390218    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e24ca12-8e02-4e64-8791-87db8933c9da-kube-api-access-xdq65" (OuterVolumeSpecName: "kube-api-access-xdq65") pod "7e24ca12-8e02-4e64-8791-87db8933c9da" (UID: "7e24ca12-8e02-4e64-8791-87db8933c9da"). InnerVolumeSpecName "kube-api-access-xdq65". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:14:02.397272 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:02.397248    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7265-140064855036976"]
Sep 07 13:14:02.489607 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:02.489549    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xdq65\" (UniqueName: \"kubernetes.io/projected/7e24ca12-8e02-4e64-8791-87db8933c9da-kube-api-access-xdq65\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:14:02.549625 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:02.549598    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7265-140064855036976"]
Sep 07 13:14:02.549996 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:02.549983    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e24ca12-8e02-4e64-8791-87db8933c9da" containerName="test-curl-7265-140064855036976"
Sep 07 13:14:02.550045 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:02.549997    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e24ca12-8e02-4e64-8791-87db8933c9da" containerName="test-curl-7265-140064855036976"
Sep 07 13:14:02.550081 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:02.550066    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e24ca12-8e02-4e64-8791-87db8933c9da" containerName="test-curl-7265-140064855036976"
Sep 07 13:14:02.552976 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:02.552963    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7265-140064855036976"
Sep 07 13:14:02.567374 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:02.567350    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7265-140064855036976"]
Sep 07 13:14:02.690838 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:02.690817    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgq44\" (UniqueName: \"kubernetes.io/projected/9ec01a88-fdd6-4dfd-a8c6-5626f106caf7-kube-api-access-sgq44\") pod \"test-curl-7265-140064855036976\" (UID: \"9ec01a88-fdd6-4dfd-a8c6-5626f106caf7\") " pod="opendatahub/test-curl-7265-140064855036976"
Sep 07 13:14:02.791979 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:02.791918    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgq44\" (UniqueName: \"kubernetes.io/projected/9ec01a88-fdd6-4dfd-a8c6-5626f106caf7-kube-api-access-sgq44\") pod \"test-curl-7265-140064855036976\" (UID: \"9ec01a88-fdd6-4dfd-a8c6-5626f106caf7\") " pod="opendatahub/test-curl-7265-140064855036976"
Sep 07 13:14:02.800490 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:02.800471    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgq44\" (UniqueName: \"kubernetes.io/projected/9ec01a88-fdd6-4dfd-a8c6-5626f106caf7-kube-api-access-sgq44\") pod \"test-curl-7265-140064855036976\" (UID: \"9ec01a88-fdd6-4dfd-a8c6-5626f106caf7\") " pod="opendatahub/test-curl-7265-140064855036976"
Sep 07 13:14:02.860916 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:02.860899    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7265-140064855036976"
Sep 07 13:14:03.134703 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:03.134678    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7265-140064855036976"]
Sep 07 13:14:03.136956 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:14:03.136931    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ec01a88_fdd6_4dfd_a8c6_5626f106caf7.slice/crio-7eb64c32c035bae1fa9c49b2d11dfa36eee785ccf82e54d8c326a0c723090d41 WatchSource:0}: Error finding container 7eb64c32c035bae1fa9c49b2d11dfa36eee785ccf82e54d8c326a0c723090d41: Status 404 returned error can't find the container with id 7eb64c32c035bae1fa9c49b2d11dfa36eee785ccf82e54d8c326a0c723090d41
Sep 07 13:14:03.213126 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:03.213106    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7265-140064855036976"
Sep 07 13:14:03.213230 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:03.213178    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e061cee53d8a3373ef90fdfc61693b2a1bc9b49eae86f55db96e5959289303f4"
Sep 07 13:14:03.214279 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:03.214251    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7265-140064855036976" event={"ID":"9ec01a88-fdd6-4dfd-a8c6-5626f106caf7","Type":"ContainerStarted","Data":"7eb64c32c035bae1fa9c49b2d11dfa36eee785ccf82e54d8c326a0c723090d41"}
Sep 07 13:14:03.223999 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:03.223971    2576 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7265-140064855036976" oldPodUID="7e24ca12-8e02-4e64-8791-87db8933c9da" podUID="9ec01a88-fdd6-4dfd-a8c6-5626f106caf7"
Sep 07 13:14:03.366419 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:03.366394    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e24ca12-8e02-4e64-8791-87db8933c9da" path="/var/lib/kubelet/pods/7e24ca12-8e02-4e64-8791-87db8933c9da/volumes"
Sep 07 13:14:04.211842 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:04.211758    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:04.219713 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:04.219691    2576 generic.go:356] "Generic (PLEG): container finished" podID="9ec01a88-fdd6-4dfd-a8c6-5626f106caf7" containerID="918a5a921b18f942c05f17bc03d2183f7c1a68017f0d2ebc9a571a2e784719e9" exitCode=0
Sep 07 13:14:04.219832 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:04.219780    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7265-140064855036976" event={"ID":"9ec01a88-fdd6-4dfd-a8c6-5626f106caf7","Type":"ContainerDied","Data":"918a5a921b18f942c05f17bc03d2183f7c1a68017f0d2ebc9a571a2e784719e9"}
Sep 07 13:14:04.312560 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:04.312531    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:04.471491 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:04.471422    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:04.784585 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:04.784521    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"]
Sep 07 13:14:04.787590 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:04.787572    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:04.792455 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:04.792432    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 07 13:14:04.793069 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:04.793050    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e07a5db5-openshift-default-dockercfg-mp8nq\""
Sep 07 13:14:04.814558 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:04.814538    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"]
Sep 07 13:14:04.834171 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:04.834146    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:04.908214 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:04.908196    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56a41ca8-45a8-4362-9146-4266fa73c49b-istio-envoy\") pod \"e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") " pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:04.908310 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:04.908228    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56a41ca8-45a8-4362-9146-4266fa73c49b-workload-certs\") pod \"e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") " pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:04.908310 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:04.908246    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56a41ca8-45a8-4362-9146-4266fa73c49b-istio-podinfo\") pod \"e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") " pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:04.908380 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:04.908330    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a41ca8-45a8-4362-9146-4266fa73c49b-workload-socket\") pod \"e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") " pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:04.908414 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:04.908392    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56a41ca8-45a8-4362-9146-4266fa73c49b-istio-token\") pod \"e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") " pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:04.908449 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:04.908440    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56a41ca8-45a8-4362-9146-4266fa73c49b-istiod-ca-cert\") pod \"e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") " pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:04.908481 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:04.908468    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56a41ca8-45a8-4362-9146-4266fa73c49b-istio-data\") pod \"e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") " pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:04.908514 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:04.908505    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a41ca8-45a8-4362-9146-4266fa73c49b-credential-socket\") pod \"e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") " pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:04.908546 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:04.908522    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn9q5\" (UniqueName: \"kubernetes.io/projected/56a41ca8-45a8-4362-9146-4266fa73c49b-kube-api-access-dn9q5\") pod \"e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") " pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:05.009167 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:05.009142    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56a41ca8-45a8-4362-9146-4266fa73c49b-istio-data\") pod \"e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") " pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:05.009271 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:05.009175    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a41ca8-45a8-4362-9146-4266fa73c49b-credential-socket\") pod \"e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") " pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:05.009271 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:05.009192    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn9q5\" (UniqueName: \"kubernetes.io/projected/56a41ca8-45a8-4362-9146-4266fa73c49b-kube-api-access-dn9q5\") pod \"e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") " pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:05.009271 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:05.009220    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56a41ca8-45a8-4362-9146-4266fa73c49b-istio-envoy\") pod \"e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") " pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:05.009271 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:05.009251    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56a41ca8-45a8-4362-9146-4266fa73c49b-workload-certs\") pod \"e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") " pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:05.009271 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:05.009266    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56a41ca8-45a8-4362-9146-4266fa73c49b-istio-podinfo\") pod \"e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") " pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:05.009504 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:05.009289    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a41ca8-45a8-4362-9146-4266fa73c49b-workload-socket\") pod \"e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") " pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:05.009504 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:05.009321    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56a41ca8-45a8-4362-9146-4266fa73c49b-istio-token\") pod \"e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") " pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:05.009504 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:05.009381    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56a41ca8-45a8-4362-9146-4266fa73c49b-istiod-ca-cert\") pod \"e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") " pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:05.009504 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:05.009490    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a41ca8-45a8-4362-9146-4266fa73c49b-credential-socket\") pod \"e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") " pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:05.009702 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:05.009649    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56a41ca8-45a8-4362-9146-4266fa73c49b-workload-certs\") pod \"e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") " pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:05.009898 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:05.009872    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56a41ca8-45a8-4362-9146-4266fa73c49b-istio-data\") pod \"e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") " pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:05.009898 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:05.009881    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a41ca8-45a8-4362-9146-4266fa73c49b-workload-socket\") pod \"e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") " pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:05.010028 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:05.009984    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56a41ca8-45a8-4362-9146-4266fa73c49b-istiod-ca-cert\") pod \"e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") " pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:05.011689 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:05.011664    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56a41ca8-45a8-4362-9146-4266fa73c49b-istio-envoy\") pod \"e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") " pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:05.011952 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:05.011931    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56a41ca8-45a8-4362-9146-4266fa73c49b-istio-podinfo\") pod \"e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") " pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:05.017128 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:05.017108    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56a41ca8-45a8-4362-9146-4266fa73c49b-istio-token\") pod \"e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") " pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:05.017194 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:05.017147    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn9q5\" (UniqueName: \"kubernetes.io/projected/56a41ca8-45a8-4362-9146-4266fa73c49b-kube-api-access-dn9q5\") pod \"e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") " pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:05.097813 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:05.097749    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:05.346718 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:05.346697    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7265-140064855036976"
Sep 07 13:14:05.376925 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:05.376892    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7265-140064855036976_9ec01a88-fdd6-4dfd-a8c6-5626f106caf7/test-curl-7265-140064855036976/0.log"
Sep 07 13:14:05.380315 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:14:05.380291    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56a41ca8_45a8_4362_9146_4266fa73c49b.slice/crio-abe73594db650d2877f6abe43a1aac9219ed55e5ca5e534c1a2f94168e0239b4 WatchSource:0}: Error finding container abe73594db650d2877f6abe43a1aac9219ed55e5ca5e534c1a2f94168e0239b4: Status 404 returned error can't find the container with id abe73594db650d2877f6abe43a1aac9219ed55e5ca5e534c1a2f94168e0239b4
Sep 07 13:14:05.380604 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:05.380586    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"]
Sep 07 13:14:05.382472 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:05.382439    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:14:05.382548 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:05.382516    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:14:05.382582 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:05.382546    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:14:05.405194 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:05.405171    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7265-140064855036976"]
Sep 07 13:14:05.411453 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:05.411430    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7265-140064855036976"]
Sep 07 13:14:05.411644 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:05.411630    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sgq44\" (UniqueName: \"kubernetes.io/projected/9ec01a88-fdd6-4dfd-a8c6-5626f106caf7-kube-api-access-sgq44\") pod \"9ec01a88-fdd6-4dfd-a8c6-5626f106caf7\" (UID: \"9ec01a88-fdd6-4dfd-a8c6-5626f106caf7\") "
Sep 07 13:14:05.413572 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:05.413553    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ec01a88-fdd6-4dfd-a8c6-5626f106caf7-kube-api-access-sgq44" (OuterVolumeSpecName: "kube-api-access-sgq44") pod "9ec01a88-fdd6-4dfd-a8c6-5626f106caf7" (UID: "9ec01a88-fdd6-4dfd-a8c6-5626f106caf7"). InnerVolumeSpecName "kube-api-access-sgq44". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:14:05.457816 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:05.457794    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:05.512331 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:05.512298    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sgq44\" (UniqueName: \"kubernetes.io/projected/9ec01a88-fdd6-4dfd-a8c6-5626f106caf7-kube-api-access-sgq44\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:14:05.981249 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:05.981206    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:06.230668 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.230633    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc" event={"ID":"56a41ca8-45a8-4362-9146-4266fa73c49b","Type":"ContainerStarted","Data":"356db4d44a28f90e68262b861d8a8abd9ace534ff01707884b3136256831a9bc"}
Sep 07 13:14:06.230917 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.230697    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc" event={"ID":"56a41ca8-45a8-4362-9146-4266fa73c49b","Type":"ContainerStarted","Data":"abe73594db650d2877f6abe43a1aac9219ed55e5ca5e534c1a2f94168e0239b4"}
Sep 07 13:14:06.231862 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.231810    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7eb64c32c035bae1fa9c49b2d11dfa36eee785ccf82e54d8c326a0c723090d41"
Sep 07 13:14:06.231862 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.231828    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7265-140064855036976"
Sep 07 13:14:06.282379 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:14:06.282339    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7265-140064855036976\" is forbidden: User \"system:node:ip-10-0-142-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-74.ec2.internal' and this object" podUID="9ec01a88-fdd6-4dfd-a8c6-5626f106caf7" pod="opendatahub/test-curl-7265-140064855036976"
Sep 07 13:14:06.282812 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.282750    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc" podStartSLOduration=2.282731949 podStartE2EDuration="2.282731949s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:14:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:14:06.279962386 +0000 UTC m=+873.336844043" watchObservedRunningTime="2026-09-07 13:14:06.282731949 +0000 UTC m=+873.339613610"
Sep 07 13:14:06.447895 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.447863    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"]
Sep 07 13:14:06.448423 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.448399    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ec01a88-fdd6-4dfd-a8c6-5626f106caf7" containerName="test-curl-7265-140064855036976"
Sep 07 13:14:06.448423 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.448420    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ec01a88-fdd6-4dfd-a8c6-5626f106caf7" containerName="test-curl-7265-140064855036976"
Sep 07 13:14:06.448553 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.448499    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ec01a88-fdd6-4dfd-a8c6-5626f106caf7" containerName="test-curl-7265-140064855036976"
Sep 07 13:14:06.451712 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.451698    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:06.457232 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.457209    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-adacb1-openshift-default-dockercfg-pnjfk\""
Sep 07 13:14:06.467660 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.467627    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"]
Sep 07 13:14:06.493447 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:14:06.493346    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7265-140064855036976\" is forbidden: User \"system:node:ip-10-0-142-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-74.ec2.internal' and this object" podUID="9ec01a88-fdd6-4dfd-a8c6-5626f106caf7" pod="opendatahub/test-curl-7265-140064855036976"
Sep 07 13:14:06.499319 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.499279    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:06.522393 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.522363    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f54036df-524e-4e36-9717-626767a5e1d0-istio-data\") pod \"e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") " pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:06.522393 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.522394    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f54036df-524e-4e36-9717-626767a5e1d0-credential-socket\") pod \"e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") " pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:06.522757 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.522424    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f54036df-524e-4e36-9717-626767a5e1d0-istio-envoy\") pod \"e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") " pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:06.522757 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.522441    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f54036df-524e-4e36-9717-626767a5e1d0-workload-socket\") pod \"e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") " pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:06.522757 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.522509    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f54036df-524e-4e36-9717-626767a5e1d0-istio-podinfo\") pod \"e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") " pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:06.522757 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.522552    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f54036df-524e-4e36-9717-626767a5e1d0-istio-token\") pod \"e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") " pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:06.522757 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.522625    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f54036df-524e-4e36-9717-626767a5e1d0-workload-certs\") pod \"e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") " pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:06.522757 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.522669    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f54036df-524e-4e36-9717-626767a5e1d0-istiod-ca-cert\") pod \"e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") " pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:06.522757 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.522722    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9rm6\" (UniqueName: \"kubernetes.io/projected/f54036df-524e-4e36-9717-626767a5e1d0-kube-api-access-f9rm6\") pod \"e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") " pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:06.624069 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.624038    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f54036df-524e-4e36-9717-626767a5e1d0-workload-certs\") pod \"e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") " pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:06.624069 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.624073    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f54036df-524e-4e36-9717-626767a5e1d0-istiod-ca-cert\") pod \"e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") " pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:06.624329 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.624107    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9rm6\" (UniqueName: \"kubernetes.io/projected/f54036df-524e-4e36-9717-626767a5e1d0-kube-api-access-f9rm6\") pod \"e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") " pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:06.624329 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.624134    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f54036df-524e-4e36-9717-626767a5e1d0-istio-data\") pod \"e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") " pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:06.624329 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.624150    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f54036df-524e-4e36-9717-626767a5e1d0-credential-socket\") pod \"e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") " pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:06.624329 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.624168    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f54036df-524e-4e36-9717-626767a5e1d0-istio-envoy\") pod \"e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") " pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:06.624329 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.624183    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f54036df-524e-4e36-9717-626767a5e1d0-workload-socket\") pod \"e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") " pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:06.624329 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.624309    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f54036df-524e-4e36-9717-626767a5e1d0-istio-podinfo\") pod \"e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") " pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:06.624619 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.624374    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f54036df-524e-4e36-9717-626767a5e1d0-istio-token\") pod \"e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") " pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:06.624619 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.624509    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f54036df-524e-4e36-9717-626767a5e1d0-workload-certs\") pod \"e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") " pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:06.624619 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.624568    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f54036df-524e-4e36-9717-626767a5e1d0-credential-socket\") pod \"e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") " pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:06.624727 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.624615    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f54036df-524e-4e36-9717-626767a5e1d0-istio-data\") pod \"e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") " pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:06.624809 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.624785    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f54036df-524e-4e36-9717-626767a5e1d0-workload-socket\") pod \"e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") " pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:06.624934 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.624914    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f54036df-524e-4e36-9717-626767a5e1d0-istiod-ca-cert\") pod \"e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") " pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:06.626550 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.626534    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f54036df-524e-4e36-9717-626767a5e1d0-istio-envoy\") pod \"e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") " pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:06.626854 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.626837    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f54036df-524e-4e36-9717-626767a5e1d0-istio-podinfo\") pod \"e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") " pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:06.631789 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.631754    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f54036df-524e-4e36-9717-626767a5e1d0-istio-token\") pod \"e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") " pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:06.632147 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.632129    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9rm6\" (UniqueName: \"kubernetes.io/projected/f54036df-524e-4e36-9717-626767a5e1d0-kube-api-access-f9rm6\") pod \"e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") " pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:06.761505 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:06.761445    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:07.037021 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:07.036994    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"]
Sep 07 13:14:07.039248 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:14:07.039220    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf54036df_524e_4e36_9717_626767a5e1d0.slice/crio-1afd2c16ab282693a5a7e697bf7312b9c659ee31788693e85fe178df7bc586fb WatchSource:0}: Error finding container 1afd2c16ab282693a5a7e697bf7312b9c659ee31788693e85fe178df7bc586fb: Status 404 returned error can't find the container with id 1afd2c16ab282693a5a7e697bf7312b9c659ee31788693e85fe178df7bc586fb
Sep 07 13:14:07.041908 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:07.041875    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:14:07.041977 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:07.041942    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:14:07.041977 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:07.041971    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:14:07.098109 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:07.098086    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:07.103185 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:07.103166    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:07.125534 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:14:07.125503    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7265-140064855036976\" is forbidden: User \"system:node:ip-10-0-142-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-74.ec2.internal' and this object" podUID="9ec01a88-fdd6-4dfd-a8c6-5626f106caf7" pod="opendatahub/test-curl-7265-140064855036976"
Sep 07 13:14:07.141133 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:07.141090    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:07.239128 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:07.239086    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb" event={"ID":"f54036df-524e-4e36-9717-626767a5e1d0","Type":"ContainerStarted","Data":"ac01de891cf92a866ecf366b7e9d6e1aa26cd38bc53ba73cc3b0233055261779"}
Sep 07 13:14:07.239308 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:07.239156    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb" event={"ID":"f54036df-524e-4e36-9717-626767a5e1d0","Type":"ContainerStarted","Data":"1afd2c16ab282693a5a7e697bf7312b9c659ee31788693e85fe178df7bc586fb"}
Sep 07 13:14:07.239308 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:07.239247    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:07.240032 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:07.240013    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:07.267089 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:14:07.267060    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7265-140064855036976\" is forbidden: User \"system:node:ip-10-0-142-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-74.ec2.internal' and this object" podUID="9ec01a88-fdd6-4dfd-a8c6-5626f106caf7" pod="opendatahub/test-curl-7265-140064855036976"
Sep 07 13:14:07.268666 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:07.268620    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb" podStartSLOduration=1.268602188 podStartE2EDuration="1.268602188s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:14:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:14:07.265324979 +0000 UTC m=+874.322206638" watchObservedRunningTime="2026-09-07 13:14:07.268602188 +0000 UTC m=+874.325483847"
Sep 07 13:14:07.292578 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:14:07.292507    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7265-140064855036976\" is forbidden: User \"system:node:ip-10-0-142-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-74.ec2.internal' and this object" podUID="9ec01a88-fdd6-4dfd-a8c6-5626f106caf7" pod="opendatahub/test-curl-7265-140064855036976"
Sep 07 13:14:07.368827 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:07.368743    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ec01a88-fdd6-4dfd-a8c6-5626f106caf7" path="/var/lib/kubelet/pods/9ec01a88-fdd6-4dfd-a8c6-5626f106caf7/volumes"
Sep 07 13:14:07.761737 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:07.761709    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:07.914626 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:07.914589    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:08.009913 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:08.009874    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:08.767424 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:08.767397    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:09.185049 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:09.185002    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:09.248616 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:09.248558    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:09.249461 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:09.249443    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:09.275384 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:09.275351    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:09.435789 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:09.435657    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:09.544916 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:09.544884    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:09.707045 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:09.706960    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:10.092101 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:10.092006    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:10.480717 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:10.480681    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:10.830738 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:10.830653    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:10.931462 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:10.931422    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:11.043123 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:11.043085    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:11.452131 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:11.452098    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:11.564577 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:11.564526    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:11.993620 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:11.993587    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:12.843981 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:12.843930    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:12.924673 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:12.924642    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq"]
Sep 07 13:14:12.929298 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:12.929278    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq"
Sep 07 13:14:12.932195 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:12.932174    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-a-4aad6a88-kserve-self-signed-certs\""
Sep 07 13:14:12.939846 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:12.939824    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq"]
Sep 07 13:14:13.088426 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:13.088390    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-tmp-dir\") pod \"e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq\" (UID: \"30cb6da2-5c24-4ce0-9046-c8c3f38cd27c\") " pod="llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq"
Sep 07 13:14:13.088603 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:13.088448    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-tls-certs\") pod \"e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq\" (UID: \"30cb6da2-5c24-4ce0-9046-c8c3f38cd27c\") " pod="llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq"
Sep 07 13:14:13.088603 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:13.088552    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-home\") pod \"e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq\" (UID: \"30cb6da2-5c24-4ce0-9046-c8c3f38cd27c\") " pod="llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq"
Sep 07 13:14:13.088726 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:13.088611    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlmlg\" (UniqueName: \"kubernetes.io/projected/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-kube-api-access-xlmlg\") pod \"e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq\" (UID: \"30cb6da2-5c24-4ce0-9046-c8c3f38cd27c\") " pod="llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq"
Sep 07 13:14:13.088726 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:13.088641    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-dshm\") pod \"e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq\" (UID: \"30cb6da2-5c24-4ce0-9046-c8c3f38cd27c\") " pod="llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq"
Sep 07 13:14:13.088726 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:13.088706    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-model-cache\") pod \"e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq\" (UID: \"30cb6da2-5c24-4ce0-9046-c8c3f38cd27c\") " pod="llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq"
Sep 07 13:14:13.126727 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:13.126690    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:13.191167 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:13.190311    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-model-cache\") pod \"e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq\" (UID: \"30cb6da2-5c24-4ce0-9046-c8c3f38cd27c\") " pod="llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq"
Sep 07 13:14:13.191167 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:13.190395    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-tmp-dir\") pod \"e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq\" (UID: \"30cb6da2-5c24-4ce0-9046-c8c3f38cd27c\") " pod="llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq"
Sep 07 13:14:13.191167 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:13.190453    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-tls-certs\") pod \"e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq\" (UID: \"30cb6da2-5c24-4ce0-9046-c8c3f38cd27c\") " pod="llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq"
Sep 07 13:14:13.191167 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:13.190539    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-home\") pod \"e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq\" (UID: \"30cb6da2-5c24-4ce0-9046-c8c3f38cd27c\") " pod="llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq"
Sep 07 13:14:13.191167 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:13.190606    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlmlg\" (UniqueName: \"kubernetes.io/projected/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-kube-api-access-xlmlg\") pod \"e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq\" (UID: \"30cb6da2-5c24-4ce0-9046-c8c3f38cd27c\") " pod="llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq"
Sep 07 13:14:13.191167 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:13.190642    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-dshm\") pod \"e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq\" (UID: \"30cb6da2-5c24-4ce0-9046-c8c3f38cd27c\") " pod="llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq"
Sep 07 13:14:13.192618 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:13.192049    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-model-cache\") pod \"e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq\" (UID: \"30cb6da2-5c24-4ce0-9046-c8c3f38cd27c\") " pod="llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq"
Sep 07 13:14:13.192618 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:13.192291    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-tmp-dir\") pod \"e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq\" (UID: \"30cb6da2-5c24-4ce0-9046-c8c3f38cd27c\") " pod="llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq"
Sep 07 13:14:13.197886 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:13.197848    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-dshm\") pod \"e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq\" (UID: \"30cb6da2-5c24-4ce0-9046-c8c3f38cd27c\") " pod="llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq"
Sep 07 13:14:13.198118 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:13.198095    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-tls-certs\") pod \"e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq\" (UID: \"30cb6da2-5c24-4ce0-9046-c8c3f38cd27c\") " pod="llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq"
Sep 07 13:14:13.198275 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:13.198242    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-home\") pod \"e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq\" (UID: \"30cb6da2-5c24-4ce0-9046-c8c3f38cd27c\") " pod="llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq"
Sep 07 13:14:13.207019 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:13.206987    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlmlg\" (UniqueName: \"kubernetes.io/projected/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-kube-api-access-xlmlg\") pod \"e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq\" (UID: \"30cb6da2-5c24-4ce0-9046-c8c3f38cd27c\") " pod="llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq"
Sep 07 13:14:13.240151 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:13.240125    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq"
Sep 07 13:14:13.254743 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:13.254721    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:14:13.512254 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:13.512229    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq"]
Sep 07 13:14:13.514510 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:14:13.514488    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30cb6da2_5c24_4ce0_9046_c8c3f38cd27c.slice/crio-c48b356c4eb42b5c893de3057c4ae565a30dda5496e09b3d9e855e5790775dbf WatchSource:0}: Error finding container c48b356c4eb42b5c893de3057c4ae565a30dda5496e09b3d9e855e5790775dbf: Status 404 returned error can't find the container with id c48b356c4eb42b5c893de3057c4ae565a30dda5496e09b3d9e855e5790775dbf
Sep 07 13:14:14.275813 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:14.275761    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq" event={"ID":"30cb6da2-5c24-4ce0-9046-c8c3f38cd27c","Type":"ContainerStarted","Data":"ca7c94c61b7526a3e003ef8cf2d1cd99c44eb58dd3094d7e32e455c938f9d2ad"}
Sep 07 13:14:14.276230 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:14.275820    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq" event={"ID":"30cb6da2-5c24-4ce0-9046-c8c3f38cd27c","Type":"ContainerStarted","Data":"c48b356c4eb42b5c893de3057c4ae565a30dda5496e09b3d9e855e5790775dbf"}
Sep 07 13:14:14.293928 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:14.293879    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq" podStartSLOduration=2.293864565 podStartE2EDuration="2.293864565s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:14:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:14:14.292107803 +0000 UTC m=+881.348989495" watchObservedRunningTime="2026-09-07 13:14:14.293864565 +0000 UTC m=+881.350746217"
Sep 07 13:14:14.572699 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:14.572611    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:14.745188 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:14.745156    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:14.837960 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:14.837798    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:14.942455 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:14.942418    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:17.621347 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:17.621319    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:18.871465 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:18.871423    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:18.971653 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:18.971610    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:19.106486 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:19.106453    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:19.298083 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:19.298049    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:23.231315 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:23.230532    2576 patch_prober.go:28] interesting pod/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": read tcp 10.133.0.2:47276->10.133.0.42:15021: read: connection reset by peer" start-of-body=
Sep 07 13:14:23.231315 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:23.230611    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc" podUID="56a41ca8-45a8-4362-9146-4266fa73c49b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": read tcp 10.133.0.2:47276->10.133.0.42:15021: read: connection reset by peer"
Sep 07 13:14:23.240646 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:23.240623    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq"
Sep 07 13:14:23.240756 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:23.240690    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq"
Sep 07 13:14:23.253807 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:23.253783    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq"
Sep 07 13:14:23.286563 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:23.286530    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:23.330481 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:23.330444    2576 generic.go:356] "Generic (PLEG): container finished" podID="56a41ca8-45a8-4362-9146-4266fa73c49b" containerID="356db4d44a28f90e68262b861d8a8abd9ace534ff01707884b3136256831a9bc" exitCode=0
Sep 07 13:14:23.330685 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:23.330534    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc" event={"ID":"56a41ca8-45a8-4362-9146-4266fa73c49b","Type":"ContainerDied","Data":"356db4d44a28f90e68262b861d8a8abd9ace534ff01707884b3136256831a9bc"}
Sep 07 13:14:23.331132 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:23.331111    2576 scope.go:117] "RemoveContainer" containerID="356db4d44a28f90e68262b861d8a8abd9ace534ff01707884b3136256831a9bc"
Sep 07 13:14:23.332285 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:23.332242    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:14:23.332362 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:23.332346    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:14:23.332429 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:23.332416    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:14:23.342944 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:23.342917    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq"
Sep 07 13:14:24.337515 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:24.337478    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc" event={"ID":"56a41ca8-45a8-4362-9146-4266fa73c49b","Type":"ContainerStarted","Data":"85edc09c42ebd45cc4a67f2b9ce522674387434f78454c869c1827b5a7e3e79a"}
Sep 07 13:14:25.097143 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:25.097096    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:25.098705 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:25.098675    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:25.099004 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:25.098812    2576 patch_prober.go:28] interesting pod/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 07 13:14:25.099004 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:25.098865    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc" podUID="56a41ca8-45a8-4362-9146-4266fa73c49b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 07 13:14:25.210760 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:25.210730    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:25.301333 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:25.301293    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:25.450812 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:25.450757    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:26.098476 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:26.098436    2576 patch_prober.go:28] interesting pod/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 07 13:14:26.098824 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:26.098791    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc" podUID="56a41ca8-45a8-4362-9146-4266fa73c49b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 07 13:14:27.099319 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:27.099275    2576 patch_prober.go:28] interesting pod/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 07 13:14:27.099858 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:27.099344    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc" podUID="56a41ca8-45a8-4362-9146-4266fa73c49b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 07 13:14:28.098592 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:28.098550    2576 patch_prober.go:28] interesting pod/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 07 13:14:28.098919 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:28.098885    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc" podUID="56a41ca8-45a8-4362-9146-4266fa73c49b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 07 13:14:29.098937 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:29.098889    2576 patch_prober.go:28] interesting pod/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body=
Sep 07 13:14:29.099440 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:29.099006    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc" podUID="56a41ca8-45a8-4362-9146-4266fa73c49b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused"
Sep 07 13:14:29.299383 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:29.299291    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:29.635491 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:29.635452    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:29.925115 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:29.925040    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"]
Sep 07 13:14:29.930747 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:29.930725    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:29.933476 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:29.933453    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-824a79-openshift-default-dockercfg-8z2vm\""
Sep 07 13:14:29.940928 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:29.940907    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"]
Sep 07 13:14:29.946452 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:29.946428    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:29.958801 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:29.958757    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-istio-podinfo\") pod \"e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") " pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:29.958885 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:29.958812    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-istio-data\") pod \"e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") " pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:29.958885 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:29.958851    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-istiod-ca-cert\") pod \"e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") " pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:29.958885 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:29.958878    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-istio-envoy\") pod \"e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") " pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:29.959053 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:29.958961    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-istio-token\") pod \"e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") " pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:29.959053 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:29.958998    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-workload-certs\") pod \"e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") " pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:29.959156 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:29.959091    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-credential-socket\") pod \"e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") " pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:29.959156 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:29.959131    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-workload-socket\") pod \"e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") " pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:29.959261 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:29.959156    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gbpb\" (UniqueName: \"kubernetes.io/projected/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-kube-api-access-2gbpb\") pod \"e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") " pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:30.059790 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:30.059739    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-credential-socket\") pod \"e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") " pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:30.059955 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:30.059819    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-workload-socket\") pod \"e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") " pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:30.059955 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:30.059845    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gbpb\" (UniqueName: \"kubernetes.io/projected/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-kube-api-access-2gbpb\") pod \"e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") " pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:30.059955 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:30.059900    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-istio-podinfo\") pod \"e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") " pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:30.059955 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:30.059927    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-istio-data\") pod \"e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") " pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:30.060197 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:30.059986    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-istiod-ca-cert\") pod \"e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") " pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:30.060197 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:30.060041    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-istio-envoy\") pod \"e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") " pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:30.060197 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:30.060090    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-istio-token\") pod \"e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") " pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:30.060197 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:30.060120    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-workload-certs\") pod \"e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") " pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:30.060197 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:30.060164    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-credential-socket\") pod \"e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") " pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:30.060452 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:30.060205    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-workload-socket\") pod \"e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") " pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:30.060452 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:30.060251    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-istio-data\") pod \"e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") " pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:30.060551 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:30.060495    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-workload-certs\") pod \"e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") " pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:30.060832 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:30.060811    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-istiod-ca-cert\") pod \"e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") " pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:30.062372 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:30.062349    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-istio-envoy\") pod \"e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") " pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:30.062476 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:30.062446    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-istio-podinfo\") pod \"e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") " pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:30.069694 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:30.069668    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-istio-token\") pod \"e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") " pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:30.070242 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:30.070195    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gbpb\" (UniqueName: \"kubernetes.io/projected/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-kube-api-access-2gbpb\") pod \"e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") " pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:30.102207 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:30.102188    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:30.102654 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:30.102633    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:30.103340 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:30.103326    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:30.241402 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:30.241331    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:30.364270 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:30.364240    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:30.534261 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:30.534237    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"]
Sep 07 13:14:30.535633 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:14:30.535605    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a226d06_4b26_4b1b_bc02_2acbb56ab37a.slice/crio-ee677406e4d8871247676c194c4d4e6e0b9121c369c26948f1bb8c0e6532902a WatchSource:0}: Error finding container ee677406e4d8871247676c194c4d4e6e0b9121c369c26948f1bb8c0e6532902a: Status 404 returned error can't find the container with id ee677406e4d8871247676c194c4d4e6e0b9121c369c26948f1bb8c0e6532902a
Sep 07 13:14:30.537932 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:30.537891    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:14:30.538018 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:30.537978    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:14:30.538063 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:30.538020    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:14:30.803437 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:30.803352    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:31.383723 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:31.383682    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7" event={"ID":"5a226d06-4b26-4b1b-bc02-2acbb56ab37a","Type":"ContainerStarted","Data":"a6b2c9c725e27b0c6ad6b92ac32e24c1985423114424555903937d8942176808"}
Sep 07 13:14:31.384176 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:31.383756    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7" event={"ID":"5a226d06-4b26-4b1b-bc02-2acbb56ab37a","Type":"ContainerStarted","Data":"ee677406e4d8871247676c194c4d4e6e0b9121c369c26948f1bb8c0e6532902a"}
Sep 07 13:14:31.475450 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:31.475402    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7" podStartSLOduration=2.475387961 podStartE2EDuration="2.475387961s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:14:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:14:31.472702543 +0000 UTC m=+898.529584201" watchObservedRunningTime="2026-09-07 13:14:31.475387961 +0000 UTC m=+898.532269618"
Sep 07 13:14:31.707676 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:31.707596    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:31.807129 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:31.807101    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:31.950948 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:31.950919    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:14:32.242591 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:32.242561    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:32.247877 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:32.247852    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:32.388279 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:32.388249    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:32.389381 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:32.389362    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:32.441184 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:32.441139    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:33.359995 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:33.359969    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-v9pd8_d2bb2527-1a29-4b7e-b6fb-9be32693a5cd/console-operator/1.log"
Sep 07 13:14:33.361245 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:33.361218    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-v9pd8_d2bb2527-1a29-4b7e-b6fb-9be32693a5cd/console-operator/1.log"
Sep 07 13:14:33.394064 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:33.394037    2576 generic.go:356] "Generic (PLEG): container finished" podID="f54036df-524e-4e36-9717-626767a5e1d0" containerID="ac01de891cf92a866ecf366b7e9d6e1aa26cd38bc53ba73cc3b0233055261779" exitCode=0
Sep 07 13:14:33.394362 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:33.394143    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb" event={"ID":"f54036df-524e-4e36-9717-626767a5e1d0","Type":"ContainerDied","Data":"ac01de891cf92a866ecf366b7e9d6e1aa26cd38bc53ba73cc3b0233055261779"}
Sep 07 13:14:33.394638 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:33.394620    2576 scope.go:117] "RemoveContainer" containerID="ac01de891cf92a866ecf366b7e9d6e1aa26cd38bc53ba73cc3b0233055261779"
Sep 07 13:14:33.395590 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:33.395560    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:14:33.395660 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:33.395644    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:14:33.395701 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:33.395685    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:14:33.723900 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:33.723820    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:33.849991 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:33.849952    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:34.332134 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:34.332101    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:34.400820 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:34.400791    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb" event={"ID":"f54036df-524e-4e36-9717-626767a5e1d0","Type":"ContainerStarted","Data":"a64502b03c86825602cff76ec6c614ca18c7d9b8726f5f84a303d3833a17bd43"}
Sep 07 13:14:34.688693 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:34.688609    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:34.762274 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:34.762247    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:34.763020 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:34.762992    2576 patch_prober.go:28] interesting pod/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 07 13:14:34.763156 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:34.763057    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb" podUID="f54036df-524e-4e36-9717-626767a5e1d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 07 13:14:35.534333 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:35.534279    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:35.762202 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:35.762171    2576 patch_prober.go:28] interesting pod/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 07 13:14:35.762358 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:35.762221    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb" podUID="f54036df-524e-4e36-9717-626767a5e1d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 07 13:14:36.421042 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:36.421011    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:36.521169 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:36.521128    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:36.762820 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:36.762725    2576 patch_prober.go:28] interesting pod/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 07 13:14:36.762820 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:36.762804    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb" podUID="f54036df-524e-4e36-9717-626767a5e1d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 07 13:14:36.784006 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:36.783973    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:36.932373 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:36.932341    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:37.033100 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:37.032999    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:37.762215 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:37.762184    2576 patch_prober.go:28] interesting pod/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 07 13:14:37.762402 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:37.762229    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb" podUID="f54036df-524e-4e36-9717-626767a5e1d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 07 13:14:38.762058 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:38.762025    2576 patch_prober.go:28] interesting pod/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 07 13:14:38.762394 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:38.762079    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb" podUID="f54036df-524e-4e36-9717-626767a5e1d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 07 13:14:39.249161 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:39.249132    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:39.766505 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:39.766472    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:39.767673 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:39.767655    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:14:43.568750 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:43.568717    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:43.686939 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:43.686903    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:48.533087 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:48.532976    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:48.633469 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:48.633432    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:49.353485 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:49.353446    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:50.045398 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:50.045363    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:50.146870 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:50.146829    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:50.246042 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:50.245995    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:50.346499 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:50.346400    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:50.419610 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:50.419578    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"]
Sep 07 13:14:50.419918 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:50.419881    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc" podUID="56a41ca8-45a8-4362-9146-4266fa73c49b" containerName="istio-proxy" containerID="cri-o://85edc09c42ebd45cc4a67f2b9ce522674387434f78454c869c1827b5a7e3e79a" gracePeriod=30
Sep 07 13:14:50.448666 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:50.448637    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:50.907297 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:50.907260    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:50.999493 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:50.999463    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:51.167809 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.167715    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:51.486145 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.486060    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"]
Sep 07 13:14:51.489288 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.489265    2576 generic.go:356] "Generic (PLEG): container finished" podID="5a226d06-4b26-4b1b-bc02-2acbb56ab37a" containerID="a6b2c9c725e27b0c6ad6b92ac32e24c1985423114424555903937d8942176808" exitCode=0
Sep 07 13:14:51.489556 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.489536    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7" event={"ID":"5a226d06-4b26-4b1b-bc02-2acbb56ab37a","Type":"ContainerDied","Data":"a6b2c9c725e27b0c6ad6b92ac32e24c1985423114424555903937d8942176808"}
Sep 07 13:14:51.489654 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.489643    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:14:51.489956 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.489930    2576 scope.go:117] "RemoveContainer" containerID="a6b2c9c725e27b0c6ad6b92ac32e24c1985423114424555903937d8942176808"
Sep 07 13:14:51.491142 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.491116    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:14:51.491217 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.491181    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:14:51.491252 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.491216    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:14:51.492022 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.492005    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-50f0dc8e-gw-openshift-default-dockercfg-dqfq4\""
Sep 07 13:14:51.510525 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.510502    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"]
Sep 07 13:14:51.524135 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.524089    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:51.559120 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.559079    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05e85627-e37d-4009-a153-7453c35cbc6f-credential-socket\") pod \"e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") " pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:14:51.560406 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.559122    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05e85627-e37d-4009-a153-7453c35cbc6f-istio-podinfo\") pod \"e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") " pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:14:51.560406 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.559156    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05e85627-e37d-4009-a153-7453c35cbc6f-workload-socket\") pod \"e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") " pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:14:51.560406 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.559228    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05e85627-e37d-4009-a153-7453c35cbc6f-istio-data\") pod \"e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") " pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:14:51.560406 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.559274    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-458zc\" (UniqueName: \"kubernetes.io/projected/05e85627-e37d-4009-a153-7453c35cbc6f-kube-api-access-458zc\") pod \"e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") " pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:14:51.560406 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.559375    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05e85627-e37d-4009-a153-7453c35cbc6f-workload-certs\") pod \"e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") " pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:14:51.560406 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.559537    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05e85627-e37d-4009-a153-7453c35cbc6f-istio-token\") pod \"e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") " pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:14:51.560406 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.559618    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05e85627-e37d-4009-a153-7453c35cbc6f-istiod-ca-cert\") pod \"e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") " pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:14:51.560406 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.559679    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05e85627-e37d-4009-a153-7453c35cbc6f-istio-envoy\") pod \"e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") " pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:14:51.661681 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.661645    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05e85627-e37d-4009-a153-7453c35cbc6f-istio-token\") pod \"e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") " pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:14:51.661905 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.661714    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05e85627-e37d-4009-a153-7453c35cbc6f-istiod-ca-cert\") pod \"e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") " pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:14:51.661905 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.661757    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05e85627-e37d-4009-a153-7453c35cbc6f-istio-envoy\") pod \"e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") " pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:14:51.661905 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.661866    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05e85627-e37d-4009-a153-7453c35cbc6f-credential-socket\") pod \"e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") " pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:14:51.661905 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.661895    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05e85627-e37d-4009-a153-7453c35cbc6f-istio-podinfo\") pod \"e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") " pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:14:51.662167 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.661928    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05e85627-e37d-4009-a153-7453c35cbc6f-workload-socket\") pod \"e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") " pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:14:51.662167 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.661959    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05e85627-e37d-4009-a153-7453c35cbc6f-istio-data\") pod \"e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") " pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:14:51.662167 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.661992    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-458zc\" (UniqueName: \"kubernetes.io/projected/05e85627-e37d-4009-a153-7453c35cbc6f-kube-api-access-458zc\") pod \"e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") " pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:14:51.662167 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.662024    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05e85627-e37d-4009-a153-7453c35cbc6f-workload-certs\") pod \"e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") " pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:14:51.662734 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.662459    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05e85627-e37d-4009-a153-7453c35cbc6f-istiod-ca-cert\") pod \"e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") " pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:14:51.662734 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.662490    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05e85627-e37d-4009-a153-7453c35cbc6f-workload-socket\") pod \"e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") " pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:14:51.662734 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.662523    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05e85627-e37d-4009-a153-7453c35cbc6f-istio-data\") pod \"e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") " pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:14:51.663123 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.662740    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05e85627-e37d-4009-a153-7453c35cbc6f-credential-socket\") pod \"e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") " pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:14:51.663123 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.662802    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05e85627-e37d-4009-a153-7453c35cbc6f-workload-certs\") pod \"e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") " pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:14:51.665517 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.665482    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05e85627-e37d-4009-a153-7453c35cbc6f-istio-podinfo\") pod \"e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") " pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:14:51.665636 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.665609    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05e85627-e37d-4009-a153-7453c35cbc6f-istio-envoy\") pod \"e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") " pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:14:51.669981 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.669960    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05e85627-e37d-4009-a153-7453c35cbc6f-istio-token\") pod \"e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") " pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:14:51.670858 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.670838    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-458zc\" (UniqueName: \"kubernetes.io/projected/05e85627-e37d-4009-a153-7453c35cbc6f-kube-api-access-458zc\") pod \"e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") " pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:14:51.800949 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.800874    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:14:51.933573 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:51.933496    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:52.096665 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:14:52.096635    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05e85627_e37d_4009_a153_7453c35cbc6f.slice/crio-165bc8797eb8fbceefba93e1a583ae0f085da388a746a07dbd84962e7133049f WatchSource:0}: Error finding container 165bc8797eb8fbceefba93e1a583ae0f085da388a746a07dbd84962e7133049f: Status 404 returned error can't find the container with id 165bc8797eb8fbceefba93e1a583ae0f085da388a746a07dbd84962e7133049f
Sep 07 13:14:52.096665 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:52.096645    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"]
Sep 07 13:14:52.099027 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:52.098993    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:14:52.099125 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:52.099057    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:14:52.099125 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:52.099090    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:14:52.199288 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:52.199249    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:14:52.499842 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:52.499802    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7" event={"ID":"5a226d06-4b26-4b1b-bc02-2acbb56ab37a","Type":"ContainerStarted","Data":"2240f02a8387535f26cced055ad1442639a07189184ef8f7e6b45279311605d2"}
Sep 07 13:14:52.501714 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:52.501687    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk" event={"ID":"05e85627-e37d-4009-a153-7453c35cbc6f","Type":"ContainerStarted","Data":"30e237cb4e16a0813cfe29ac3f56ed052919cefd58169d1c42007d9aba2c3274"}
Sep 07 13:14:52.501852 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:52.501731    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk" event={"ID":"05e85627-e37d-4009-a153-7453c35cbc6f","Type":"ContainerStarted","Data":"165bc8797eb8fbceefba93e1a583ae0f085da388a746a07dbd84962e7133049f"}
Sep 07 13:14:52.544710 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:52.544658    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk" podStartSLOduration=1.544640088 podStartE2EDuration="1.544640088s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:14:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:14:52.542050858 +0000 UTC m=+919.598932517" watchObservedRunningTime="2026-09-07 13:14:52.544640088 +0000 UTC m=+919.601521749"
Sep 07 13:14:52.801046 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:52.800950    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:14:53.242236 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:53.242202    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:53.242622 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:53.242432    2576 patch_prober.go:28] interesting pod/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 07 13:14:53.242622 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:53.242485    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7" podUID="5a226d06-4b26-4b1b-bc02-2acbb56ab37a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 07 13:14:53.806722 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:53.806691    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:14:54.071888 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:54.071800    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:54.188736 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:54.188694    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:54.241834 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:54.241803    2576 patch_prober.go:28] interesting pod/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 07 13:14:54.242017 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:54.241856    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7" podUID="5a226d06-4b26-4b1b-bc02-2acbb56ab37a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 07 13:14:54.296346 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:54.296320    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:54.415543 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:54.415512    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:54.511324 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:54.511294    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:14:54.512213 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:54.512197    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:14:54.520112 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:54.520086    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:54.892474 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:54.892428    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:55.025920 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:55.025879    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:55.242583 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:55.242511    2576 patch_prober.go:28] interesting pod/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 07 13:14:55.242583 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:55.242561    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7" podUID="5a226d06-4b26-4b1b-bc02-2acbb56ab37a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 07 13:14:55.700877 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:55.700846    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:55.817483 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:55.817396    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56a41ca8-45a8-4362-9146-4266fa73c49b-workload-certs\") pod \"56a41ca8-45a8-4362-9146-4266fa73c49b\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") "
Sep 07 13:14:55.817483 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:55.817434    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56a41ca8-45a8-4362-9146-4266fa73c49b-istio-data\") pod \"56a41ca8-45a8-4362-9146-4266fa73c49b\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") "
Sep 07 13:14:55.817483 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:55.817482    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56a41ca8-45a8-4362-9146-4266fa73c49b-istio-podinfo\") pod \"56a41ca8-45a8-4362-9146-4266fa73c49b\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") "
Sep 07 13:14:55.817759 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:55.817512    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dn9q5\" (UniqueName: \"kubernetes.io/projected/56a41ca8-45a8-4362-9146-4266fa73c49b-kube-api-access-dn9q5\") pod \"56a41ca8-45a8-4362-9146-4266fa73c49b\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") "
Sep 07 13:14:55.817759 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:55.817540    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56a41ca8-45a8-4362-9146-4266fa73c49b-istio-envoy\") pod \"56a41ca8-45a8-4362-9146-4266fa73c49b\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") "
Sep 07 13:14:55.817759 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:55.817564    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56a41ca8-45a8-4362-9146-4266fa73c49b-istiod-ca-cert\") pod \"56a41ca8-45a8-4362-9146-4266fa73c49b\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") "
Sep 07 13:14:55.817759 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:55.817652    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56a41ca8-45a8-4362-9146-4266fa73c49b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "56a41ca8-45a8-4362-9146-4266fa73c49b" (UID: "56a41ca8-45a8-4362-9146-4266fa73c49b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:14:55.818107 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:55.818083    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56a41ca8-45a8-4362-9146-4266fa73c49b-istio-data" (OuterVolumeSpecName: "istio-data") pod "56a41ca8-45a8-4362-9146-4266fa73c49b" (UID: "56a41ca8-45a8-4362-9146-4266fa73c49b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:14:55.818166 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:55.818108    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a41ca8-45a8-4362-9146-4266fa73c49b-credential-socket\") pod \"56a41ca8-45a8-4362-9146-4266fa73c49b\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") "
Sep 07 13:14:55.818258 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:55.818239    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56a41ca8-45a8-4362-9146-4266fa73c49b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "56a41ca8-45a8-4362-9146-4266fa73c49b" (UID: "56a41ca8-45a8-4362-9146-4266fa73c49b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:14:55.818313 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:55.818263    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56a41ca8-45a8-4362-9146-4266fa73c49b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "56a41ca8-45a8-4362-9146-4266fa73c49b" (UID: "56a41ca8-45a8-4362-9146-4266fa73c49b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:14:55.818313 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:55.818266    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a41ca8-45a8-4362-9146-4266fa73c49b-workload-socket\") pod \"56a41ca8-45a8-4362-9146-4266fa73c49b\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") "
Sep 07 13:14:55.818418 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:55.818316    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56a41ca8-45a8-4362-9146-4266fa73c49b-istio-token\") pod \"56a41ca8-45a8-4362-9146-4266fa73c49b\" (UID: \"56a41ca8-45a8-4362-9146-4266fa73c49b\") "
Sep 07 13:14:55.818696 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:55.818627    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/56a41ca8-45a8-4362-9146-4266fa73c49b-workload-certs\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:14:55.818696 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:55.818647    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/56a41ca8-45a8-4362-9146-4266fa73c49b-istio-data\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:14:55.818696 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:55.818656    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/56a41ca8-45a8-4362-9146-4266fa73c49b-istiod-ca-cert\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:14:55.818696 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:55.818664    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a41ca8-45a8-4362-9146-4266fa73c49b-credential-socket\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:14:55.818982 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:55.818807    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56a41ca8-45a8-4362-9146-4266fa73c49b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "56a41ca8-45a8-4362-9146-4266fa73c49b" (UID: "56a41ca8-45a8-4362-9146-4266fa73c49b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:14:55.820922 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:55.820817    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/56a41ca8-45a8-4362-9146-4266fa73c49b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "56a41ca8-45a8-4362-9146-4266fa73c49b" (UID: "56a41ca8-45a8-4362-9146-4266fa73c49b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 13:14:55.820922 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:55.820889    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56a41ca8-45a8-4362-9146-4266fa73c49b-kube-api-access-dn9q5" (OuterVolumeSpecName: "kube-api-access-dn9q5") pod "56a41ca8-45a8-4362-9146-4266fa73c49b" (UID: "56a41ca8-45a8-4362-9146-4266fa73c49b"). InnerVolumeSpecName "kube-api-access-dn9q5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:14:55.821199 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:55.821179    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56a41ca8-45a8-4362-9146-4266fa73c49b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "56a41ca8-45a8-4362-9146-4266fa73c49b" (UID: "56a41ca8-45a8-4362-9146-4266fa73c49b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:14:55.822101 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:55.822082    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56a41ca8-45a8-4362-9146-4266fa73c49b-istio-token" (OuterVolumeSpecName: "istio-token") pod "56a41ca8-45a8-4362-9146-4266fa73c49b" (UID: "56a41ca8-45a8-4362-9146-4266fa73c49b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:14:55.919957 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:55.919923    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/56a41ca8-45a8-4362-9146-4266fa73c49b-workload-socket\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:14:55.919957 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:55.919950    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/56a41ca8-45a8-4362-9146-4266fa73c49b-istio-token\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:14:55.919957 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:55.919961    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/56a41ca8-45a8-4362-9146-4266fa73c49b-istio-podinfo\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:14:55.920177 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:55.919969    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dn9q5\" (UniqueName: \"kubernetes.io/projected/56a41ca8-45a8-4362-9146-4266fa73c49b-kube-api-access-dn9q5\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:14:55.920177 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:55.919978    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/56a41ca8-45a8-4362-9146-4266fa73c49b-istio-envoy\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:14:56.242586 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:56.242551    2576 patch_prober.go:28] interesting pod/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 07 13:14:56.242749 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:56.242603    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7" podUID="5a226d06-4b26-4b1b-bc02-2acbb56ab37a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 07 13:14:56.522649 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:56.522558    2576 generic.go:356] "Generic (PLEG): container finished" podID="56a41ca8-45a8-4362-9146-4266fa73c49b" containerID="85edc09c42ebd45cc4a67f2b9ce522674387434f78454c869c1827b5a7e3e79a" exitCode=0
Sep 07 13:14:56.522649 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:56.522612    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"
Sep 07 13:14:56.522649 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:56.522619    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc" event={"ID":"56a41ca8-45a8-4362-9146-4266fa73c49b","Type":"ContainerDied","Data":"85edc09c42ebd45cc4a67f2b9ce522674387434f78454c869c1827b5a7e3e79a"}
Sep 07 13:14:56.522910 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:56.522670    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc" event={"ID":"56a41ca8-45a8-4362-9146-4266fa73c49b","Type":"ContainerDied","Data":"abe73594db650d2877f6abe43a1aac9219ed55e5ca5e534c1a2f94168e0239b4"}
Sep 07 13:14:56.522910 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:56.522695    2576 scope.go:117] "RemoveContainer" containerID="85edc09c42ebd45cc4a67f2b9ce522674387434f78454c869c1827b5a7e3e79a"
Sep 07 13:14:56.532926 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:56.532751    2576 scope.go:117] "RemoveContainer" containerID="356db4d44a28f90e68262b861d8a8abd9ace534ff01707884b3136256831a9bc"
Sep 07 13:14:56.543233 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:56.543212    2576 scope.go:117] "RemoveContainer" containerID="85edc09c42ebd45cc4a67f2b9ce522674387434f78454c869c1827b5a7e3e79a"
Sep 07 13:14:56.543437 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:56.543402    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"]
Sep 07 13:14:56.543539 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:14:56.543515    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85edc09c42ebd45cc4a67f2b9ce522674387434f78454c869c1827b5a7e3e79a\": container with ID starting with 85edc09c42ebd45cc4a67f2b9ce522674387434f78454c869c1827b5a7e3e79a not found: ID does not exist" containerID="85edc09c42ebd45cc4a67f2b9ce522674387434f78454c869c1827b5a7e3e79a"
Sep 07 13:14:56.543603 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:56.543545    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85edc09c42ebd45cc4a67f2b9ce522674387434f78454c869c1827b5a7e3e79a"} err="failed to get container status \"85edc09c42ebd45cc4a67f2b9ce522674387434f78454c869c1827b5a7e3e79a\": rpc error: code = NotFound desc = could not find container \"85edc09c42ebd45cc4a67f2b9ce522674387434f78454c869c1827b5a7e3e79a\": container with ID starting with 85edc09c42ebd45cc4a67f2b9ce522674387434f78454c869c1827b5a7e3e79a not found: ID does not exist"
Sep 07 13:14:56.543603 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:56.543569    2576 scope.go:117] "RemoveContainer" containerID="356db4d44a28f90e68262b861d8a8abd9ace534ff01707884b3136256831a9bc"
Sep 07 13:14:56.543872 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:14:56.543855    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"356db4d44a28f90e68262b861d8a8abd9ace534ff01707884b3136256831a9bc\": container with ID starting with 356db4d44a28f90e68262b861d8a8abd9ace534ff01707884b3136256831a9bc not found: ID does not exist" containerID="356db4d44a28f90e68262b861d8a8abd9ace534ff01707884b3136256831a9bc"
Sep 07 13:14:56.543936 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:56.543880    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"356db4d44a28f90e68262b861d8a8abd9ace534ff01707884b3136256831a9bc"} err="failed to get container status \"356db4d44a28f90e68262b861d8a8abd9ace534ff01707884b3136256831a9bc\": rpc error: code = NotFound desc = could not find container \"356db4d44a28f90e68262b861d8a8abd9ace534ff01707884b3136256831a9bc\": container with ID starting with 356db4d44a28f90e68262b861d8a8abd9ace534ff01707884b3136256831a9bc not found: ID does not exist"
Sep 07 13:14:56.548462 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:56.548445    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e07a5db5-openshift-default-54f989cb7d-7gwtc"]
Sep 07 13:14:57.242616 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:57.242575    2576 patch_prober.go:28] interesting pod/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 07 13:14:57.243051 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:57.242648    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7" podUID="5a226d06-4b26-4b1b-bc02-2acbb56ab37a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 07 13:14:57.367544 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:57.367501    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56a41ca8-45a8-4362-9146-4266fa73c49b" path="/var/lib/kubelet/pods/56a41ca8-45a8-4362-9146-4266fa73c49b/volumes"
Sep 07 13:14:57.507013 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:57.506909    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:14:58.246671 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:58.246645    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:58.247058 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:58.246997    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:14:58.247531 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:14:58.247516    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:15:00.144242 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:00.144207    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29813115-6rvvt"]
Sep 07 13:15:00.144604 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:00.144586    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56a41ca8-45a8-4362-9146-4266fa73c49b" containerName="istio-proxy"
Sep 07 13:15:00.144604 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:00.144598    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="56a41ca8-45a8-4362-9146-4266fa73c49b" containerName="istio-proxy"
Sep 07 13:15:00.144671 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:00.144608    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56a41ca8-45a8-4362-9146-4266fa73c49b" containerName="istio-proxy"
Sep 07 13:15:00.144671 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:00.144613    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="56a41ca8-45a8-4362-9146-4266fa73c49b" containerName="istio-proxy"
Sep 07 13:15:00.144727 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:00.144679    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="56a41ca8-45a8-4362-9146-4266fa73c49b" containerName="istio-proxy"
Sep 07 13:15:00.147675 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:00.147652    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813115-6rvvt"
Sep 07 13:15:00.149960 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:00.149938    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-50f0dc8e-29813115-pc4l8"]
Sep 07 13:15:00.150263 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:00.150244    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jlvcf\""
Sep 07 13:15:00.150345 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:00.150333    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="56a41ca8-45a8-4362-9146-4266fa73c49b" containerName="istio-proxy"
Sep 07 13:15:00.153166 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:00.153150    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-50f0dc8e-29813115-pc4l8"
Sep 07 13:15:00.154445 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:00.154428    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-ebfa46-29813115-fwnwq"]
Sep 07 13:15:00.158135 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:00.158118    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-ebfa46-29813115-fwnwq"
Sep 07 13:15:00.159602 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:00.159588    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813115-6rvvt"
Sep 07 13:15:00.165808 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:00.165787    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29813115-6rvvt"]
Sep 07 13:15:00.169861 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:00.169844    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-50f0dc8e-29813115-pc4l8"]
Sep 07 13:15:00.171532 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:00.171498    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-ebfa46-29813115-fwnwq"]
Sep 07 13:15:00.172469 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:00.172455    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-50f0dc8e-29813115-pc4l8"
Sep 07 13:15:00.214610 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:00.214580    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-ebfa46-29813115-fwnwq"
Sep 07 13:15:00.448379 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:00.448335    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29813115-6rvvt"]
Sep 07 13:15:00.450327 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:00.450302    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-50f0dc8e-29813115-pc4l8"]
Sep 07 13:15:00.450470 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:15:00.450449    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf8fa039_c7d4_4e2a_8300_0efb419c669d.slice/crio-1e853e19d2954849d26d573a6fd0548a8c7a460eb7c211e8fcaa82c90ccdd2a7 WatchSource:0}: Error finding container 1e853e19d2954849d26d573a6fd0548a8c7a460eb7c211e8fcaa82c90ccdd2a7: Status 404 returned error can't find the container with id 1e853e19d2954849d26d573a6fd0548a8c7a460eb7c211e8fcaa82c90ccdd2a7
Sep 07 13:15:00.451748 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:15:00.451726    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb06f2881_e47a_4a6d_86d6_8aacffadae07.slice/crio-6a717ecb0f49ed7b5b5e1b7102c5628546109cf386d034e7494ea1163026a1b7 WatchSource:0}: Error finding container 6a717ecb0f49ed7b5b5e1b7102c5628546109cf386d034e7494ea1163026a1b7: Status 404 returned error can't find the container with id 6a717ecb0f49ed7b5b5e1b7102c5628546109cf386d034e7494ea1163026a1b7
Sep 07 13:15:00.511142 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:00.511121    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-ebfa46-29813115-fwnwq"]
Sep 07 13:15:00.513889 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:15:00.513862    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e97082f_ac27_4143_b045_903df551face.slice/crio-13beac463ce0a2ddc01d2fd38645050cba368ec1c9760ca94ae9fdc4ccdc5284 WatchSource:0}: Error finding container 13beac463ce0a2ddc01d2fd38645050cba368ec1c9760ca94ae9fdc4ccdc5284: Status 404 returned error can't find the container with id 13beac463ce0a2ddc01d2fd38645050cba368ec1c9760ca94ae9fdc4ccdc5284
Sep 07 13:15:00.543987 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:00.543962    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-50f0dc8e-29813115-pc4l8" event={"ID":"b06f2881-e47a-4a6d-86d6-8aacffadae07","Type":"ContainerStarted","Data":"6a717ecb0f49ed7b5b5e1b7102c5628546109cf386d034e7494ea1163026a1b7"}
Sep 07 13:15:00.545160 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:00.545141    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-ebfa46-29813115-fwnwq" event={"ID":"9e97082f-ac27-4143-b045-903df551face","Type":"ContainerStarted","Data":"13beac463ce0a2ddc01d2fd38645050cba368ec1c9760ca94ae9fdc4ccdc5284"}
Sep 07 13:15:00.546261 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:00.546244    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813115-6rvvt" event={"ID":"df8fa039-c7d4-4e2a-8300-0efb419c669d","Type":"ContainerStarted","Data":"1e853e19d2954849d26d573a6fd0548a8c7a460eb7c211e8fcaa82c90ccdd2a7"}
Sep 07 13:15:03.544052 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:03.543967    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:15:03.570658 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:03.570613    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-50f0dc8e-29813115-pc4l8" event={"ID":"b06f2881-e47a-4a6d-86d6-8aacffadae07","Type":"ContainerStarted","Data":"50d88c1b1cb0624fb145280455b25f5a9480319c1e3a7cd4dfebec8cec3f7631"}
Sep 07 13:15:03.573086 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:03.573050    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-ebfa46-29813115-fwnwq" event={"ID":"9e97082f-ac27-4143-b045-903df551face","Type":"ContainerStarted","Data":"b54f416e9f1fd66c194e9aa38a81708be2a37a6943c84d2b07bd004c514727f2"}
Sep 07 13:15:03.576119 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:03.576089    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813115-6rvvt" event={"ID":"df8fa039-c7d4-4e2a-8300-0efb419c669d","Type":"ContainerStarted","Data":"d2dd36964507e5592d26bbd9298d67357018e405acf4ad5b48564472c43fbcaf"}
Sep 07 13:15:03.596254 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:03.591256    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-50f0dc8e-29813115-pc4l8" podStartSLOduration=1.074847974 podStartE2EDuration="3.591236434s" totalImagesPullingTime="2.51638846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:15:03.586940416 +0000 UTC m=+930.643822075" watchObservedRunningTime="2026-09-07 13:15:03.591236434 +0000 UTC m=+930.648118121"
Sep 07 13:15:03.610212 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:03.610163    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813115-6rvvt" podStartSLOduration=1.150024815 podStartE2EDuration="3.610149141s" totalImagesPullingTime="2.460124326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:15:03.608931063 +0000 UTC m=+930.665812905" watchObservedRunningTime="2026-09-07 13:15:03.610149141 +0000 UTC m=+930.667030800"
Sep 07 13:15:03.624087 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:03.624046    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-ebfa46-29813115-fwnwq" podStartSLOduration=1.174744223 podStartE2EDuration="3.624031217s" totalImagesPullingTime="2.449286994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:15:03.62234382 +0000 UTC m=+930.679225479" watchObservedRunningTime="2026-09-07 13:15:03.624031217 +0000 UTC m=+930.680912875"
Sep 07 13:15:04.587290 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:04.587198    2576 generic.go:356] "Generic (PLEG): container finished" podID="9e97082f-ac27-4143-b045-903df551face" containerID="b54f416e9f1fd66c194e9aa38a81708be2a37a6943c84d2b07bd004c514727f2" exitCode=0
Sep 07 13:15:04.587734 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:04.587291    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-ebfa46-29813115-fwnwq" event={"ID":"9e97082f-ac27-4143-b045-903df551face","Type":"ContainerDied","Data":"b54f416e9f1fd66c194e9aa38a81708be2a37a6943c84d2b07bd004c514727f2"}
Sep 07 13:15:04.589726 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:04.589695    2576 generic.go:356] "Generic (PLEG): container finished" podID="df8fa039-c7d4-4e2a-8300-0efb419c669d" containerID="d2dd36964507e5592d26bbd9298d67357018e405acf4ad5b48564472c43fbcaf" exitCode=0
Sep 07 13:15:04.589935 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:04.589909    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813115-6rvvt" event={"ID":"df8fa039-c7d4-4e2a-8300-0efb419c669d","Type":"ContainerDied","Data":"d2dd36964507e5592d26bbd9298d67357018e405acf4ad5b48564472c43fbcaf"}
Sep 07 13:15:04.591971 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:04.591940    2576 generic.go:356] "Generic (PLEG): container finished" podID="b06f2881-e47a-4a6d-86d6-8aacffadae07" containerID="50d88c1b1cb0624fb145280455b25f5a9480319c1e3a7cd4dfebec8cec3f7631" exitCode=0
Sep 07 13:15:04.592070 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:04.591983    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-50f0dc8e-29813115-pc4l8" event={"ID":"b06f2881-e47a-4a6d-86d6-8aacffadae07","Type":"ContainerDied","Data":"50d88c1b1cb0624fb145280455b25f5a9480319c1e3a7cd4dfebec8cec3f7631"}
Sep 07 13:15:05.794793 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:05.781922    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-ebfa46-29813115-fwnwq"
Sep 07 13:15:05.843588 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:05.843563    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-50f0dc8e-29813115-pc4l8"
Sep 07 13:15:05.846617 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:05.846599    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813115-6rvvt"
Sep 07 13:15:06.603761 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:06.603729    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-50f0dc8e-29813115-pc4l8"
Sep 07 13:15:06.603761 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:06.603743    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-50f0dc8e-29813115-pc4l8" event={"ID":"b06f2881-e47a-4a6d-86d6-8aacffadae07","Type":"ContainerDied","Data":"6a717ecb0f49ed7b5b5e1b7102c5628546109cf386d034e7494ea1163026a1b7"}
Sep 07 13:15:06.603981 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:06.603808    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a717ecb0f49ed7b5b5e1b7102c5628546109cf386d034e7494ea1163026a1b7"
Sep 07 13:15:06.605121 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:06.605092    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-ebfa46-29813115-fwnwq"
Sep 07 13:15:06.605121 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:06.605101    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-ebfa46-29813115-fwnwq" event={"ID":"9e97082f-ac27-4143-b045-903df551face","Type":"ContainerDied","Data":"13beac463ce0a2ddc01d2fd38645050cba368ec1c9760ca94ae9fdc4ccdc5284"}
Sep 07 13:15:06.605299 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:06.605137    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="13beac463ce0a2ddc01d2fd38645050cba368ec1c9760ca94ae9fdc4ccdc5284"
Sep 07 13:15:06.606699 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:06.606684    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813115-6rvvt"
Sep 07 13:15:06.606807 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:06.606722    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813115-6rvvt" event={"ID":"df8fa039-c7d4-4e2a-8300-0efb419c669d","Type":"ContainerDied","Data":"1e853e19d2954849d26d573a6fd0548a8c7a460eb7c211e8fcaa82c90ccdd2a7"}
Sep 07 13:15:06.606807 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:06.606761    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1e853e19d2954849d26d573a6fd0548a8c7a460eb7c211e8fcaa82c90ccdd2a7"
Sep 07 13:15:09.837848 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:09.837813    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:15:10.553909 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:10.553871    2576 patch_prober.go:28] interesting pod/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 07 13:15:10.554060 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:10.553933    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk" podUID="05e85627-e37d-4009-a153-7453c35cbc6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 07 13:15:11.636878 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:11.636854    2576 generic.go:356] "Generic (PLEG): container finished" podID="05e85627-e37d-4009-a153-7453c35cbc6f" containerID="30e237cb4e16a0813cfe29ac3f56ed052919cefd58169d1c42007d9aba2c3274" exitCode=0
Sep 07 13:15:11.637309 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:11.636934    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk" event={"ID":"05e85627-e37d-4009-a153-7453c35cbc6f","Type":"ContainerDied","Data":"30e237cb4e16a0813cfe29ac3f56ed052919cefd58169d1c42007d9aba2c3274"}
Sep 07 13:15:11.637431 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:11.637414    2576 scope.go:117] "RemoveContainer" containerID="30e237cb4e16a0813cfe29ac3f56ed052919cefd58169d1c42007d9aba2c3274"
Sep 07 13:15:11.638492 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:11.638463    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:15:11.638570 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:11.638533    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:15:11.638606 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:11.638567    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:15:12.643701 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:12.643664    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk" event={"ID":"05e85627-e37d-4009-a153-7453c35cbc6f","Type":"ContainerStarted","Data":"fee355f1e83572b3c4e4f65608f6e2ac726be619c03a000301f64eba9e4facc4"}
Sep 07 13:15:12.801714 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:12.801676    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:15:12.801956 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:12.801934    2576 patch_prober.go:28] interesting pod/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 07 13:15:12.802004 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:12.801986    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk" podUID="05e85627-e37d-4009-a153-7453c35cbc6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 07 13:15:13.802214 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:13.802181    2576 patch_prober.go:28] interesting pod/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 07 13:15:13.802669 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:13.802240    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk" podUID="05e85627-e37d-4009-a153-7453c35cbc6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 07 13:15:14.801644 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:14.801610    2576 patch_prober.go:28] interesting pod/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 07 13:15:14.801850 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:14.801666    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk" podUID="05e85627-e37d-4009-a153-7453c35cbc6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 07 13:15:15.390687 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:15.390625    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:15:15.801287 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:15.801200    2576 patch_prober.go:28] interesting pod/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 07 13:15:15.801287 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:15.801262    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk" podUID="05e85627-e37d-4009-a153-7453c35cbc6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 07 13:15:16.801992 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:16.801953    2576 patch_prober.go:28] interesting pod/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Sep 07 13:15:16.802401 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:16.802009    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk" podUID="05e85627-e37d-4009-a153-7453c35cbc6f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Sep 07 13:15:17.805381 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:17.805354    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:15:17.805761 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:17.805727    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:15:17.806471 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:17.806453    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:15:19.040649 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:19.040618    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-50f0dc8e-92fld"]
Sep 07 13:15:19.041035 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:19.041017    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e97082f-ac27-4143-b045-903df551face" containerName="cleanup"
Sep 07 13:15:19.041035 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:19.041030    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e97082f-ac27-4143-b045-903df551face" containerName="cleanup"
Sep 07 13:15:19.041103 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:19.041038    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b06f2881-e47a-4a6d-86d6-8aacffadae07" containerName="cleanup"
Sep 07 13:15:19.041103 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:19.041044    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b06f2881-e47a-4a6d-86d6-8aacffadae07" containerName="cleanup"
Sep 07 13:15:19.041103 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:19.041051    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df8fa039-c7d4-4e2a-8300-0efb419c669d" containerName="cleanup"
Sep 07 13:15:19.041103 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:19.041057    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="df8fa039-c7d4-4e2a-8300-0efb419c669d" containerName="cleanup"
Sep 07 13:15:19.041219 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:19.041123    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e97082f-ac27-4143-b045-903df551face" containerName="cleanup"
Sep 07 13:15:19.041219 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:19.041131    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="df8fa039-c7d4-4e2a-8300-0efb419c669d" containerName="cleanup"
Sep 07 13:15:19.041219 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:19.041137    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b06f2881-e47a-4a6d-86d6-8aacffadae07" containerName="cleanup"
Sep 07 13:15:19.046981 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:19.046966    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-50f0dc8e-92fld"
Sep 07 13:15:19.049085 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:19.049064    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jlvcf\""
Sep 07 13:15:19.049085 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:19.049078    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 13:15:19.054346 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:19.054322    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-50f0dc8e-92fld"]
Sep 07 13:15:19.140273 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:19.140250    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ecad48c-e1d2-4efa-bdcb-6f6f98dd0be3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-50f0dc8e-92fld\" (UID: \"3ecad48c-e1d2-4efa-bdcb-6f6f98dd0be3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-50f0dc8e-92fld"
Sep 07 13:15:19.240922 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:19.240891    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ecad48c-e1d2-4efa-bdcb-6f6f98dd0be3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-50f0dc8e-92fld\" (UID: \"3ecad48c-e1d2-4efa-bdcb-6f6f98dd0be3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-50f0dc8e-92fld"
Sep 07 13:15:19.241476 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:19.241454    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ecad48c-e1d2-4efa-bdcb-6f6f98dd0be3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-50f0dc8e-92fld\" (UID: \"3ecad48c-e1d2-4efa-bdcb-6f6f98dd0be3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-50f0dc8e-92fld"
Sep 07 13:15:19.359512 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:19.359463    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-50f0dc8e-92fld"
Sep 07 13:15:19.631941 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:19.631892    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-50f0dc8e-92fld"]
Sep 07 13:15:19.634594 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:15:19.634567    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ecad48c_e1d2_4efa_bdcb_6f6f98dd0be3.slice/crio-fc76c29278d1108c2f524323f0075c704a04bd814a66c9b9a8aa66d0486a4b76 WatchSource:0}: Error finding container fc76c29278d1108c2f524323f0075c704a04bd814a66c9b9a8aa66d0486a4b76: Status 404 returned error can't find the container with id fc76c29278d1108c2f524323f0075c704a04bd814a66c9b9a8aa66d0486a4b76
Sep 07 13:15:19.680904 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:19.680879    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-50f0dc8e-92fld" event={"ID":"3ecad48c-e1d2-4efa-bdcb-6f6f98dd0be3","Type":"ContainerStarted","Data":"fc76c29278d1108c2f524323f0075c704a04bd814a66c9b9a8aa66d0486a4b76"}
Sep 07 13:15:20.687263 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:20.687226    2576 generic.go:356] "Generic (PLEG): container finished" podID="3ecad48c-e1d2-4efa-bdcb-6f6f98dd0be3" containerID="f5764d27da598502f7a1f8128cefaeec5d6858c2c91479ae9f0e803dc3e3b7ec" exitCode=0
Sep 07 13:15:20.687679 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:20.687316    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-50f0dc8e-92fld" event={"ID":"3ecad48c-e1d2-4efa-bdcb-6f6f98dd0be3","Type":"ContainerDied","Data":"f5764d27da598502f7a1f8128cefaeec5d6858c2c91479ae9f0e803dc3e3b7ec"}
Sep 07 13:15:21.830194 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:21.830166    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-50f0dc8e-92fld"
Sep 07 13:15:21.865464 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:21.865431    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ecad48c-e1d2-4efa-bdcb-6f6f98dd0be3-maas-api-service-ca\") pod \"3ecad48c-e1d2-4efa-bdcb-6f6f98dd0be3\" (UID: \"3ecad48c-e1d2-4efa-bdcb-6f6f98dd0be3\") "
Sep 07 13:15:21.865909 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:21.865878    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ecad48c-e1d2-4efa-bdcb-6f6f98dd0be3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3ecad48c-e1d2-4efa-bdcb-6f6f98dd0be3" (UID: "3ecad48c-e1d2-4efa-bdcb-6f6f98dd0be3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:15:21.967133 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:21.967043    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ecad48c-e1d2-4efa-bdcb-6f6f98dd0be3-maas-api-service-ca\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:15:22.699332 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:22.699295    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-50f0dc8e-92fld" event={"ID":"3ecad48c-e1d2-4efa-bdcb-6f6f98dd0be3","Type":"ContainerDied","Data":"fc76c29278d1108c2f524323f0075c704a04bd814a66c9b9a8aa66d0486a4b76"}
Sep 07 13:15:22.699332 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:22.699312    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-50f0dc8e-92fld"
Sep 07 13:15:22.699543 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:22.699342    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fc76c29278d1108c2f524323f0075c704a04bd814a66c9b9a8aa66d0486a4b76"
Sep 07 13:15:24.348068 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:24.348031    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:15:24.522707 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:24.522661    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:15:24.581032 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:24.580995    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:15:25.788672 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:25.788633    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:15:25.794502 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:25.794473    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-50f0dc8e-29813115-pc4l8"]
Sep 07 13:15:25.796343 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:25.796320    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-50f0dc8e-29813115-pc4l8"]
Sep 07 13:15:25.876874 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:25.876824    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:15:25.944224 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:25.944190    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:15:26.020051 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:26.020015    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-50f0dc8e-92fld"]
Sep 07 13:15:26.023666 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:26.023634    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:15:26.024030 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:26.024015    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-50f0dc8e-92fld"]
Sep 07 13:15:26.092582 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:26.092499    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:15:26.163394 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:26.163360    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"]
Sep 07 13:15:26.163624 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:26.163599    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk" podUID="05e85627-e37d-4009-a153-7453c35cbc6f" containerName="istio-proxy" containerID="cri-o://fee355f1e83572b3c4e4f65608f6e2ac726be619c03a000301f64eba9e4facc4" gracePeriod=30
Sep 07 13:15:26.176730 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:26.176680    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:15:26.639913 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:26.639878    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:15:26.925105 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:26.925017    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"]
Sep 07 13:15:26.925627 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:26.925607    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ecad48c-e1d2-4efa-bdcb-6f6f98dd0be3" containerName="revoke-keys"
Sep 07 13:15:26.925708 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:26.925631    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ecad48c-e1d2-4efa-bdcb-6f6f98dd0be3" containerName="revoke-keys"
Sep 07 13:15:26.925823 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:26.925810    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ecad48c-e1d2-4efa-bdcb-6f6f98dd0be3" containerName="revoke-keys"
Sep 07 13:15:26.928980 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:26.928956    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:26.931212 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:26.931189    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-7d32a524-openshift-default-dockercfg-m5kgp\""
Sep 07 13:15:26.939638 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:26.939612    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"]
Sep 07 13:15:26.950100 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:26.950074    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:15:27.011638 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.011586    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5509dc9a-2836-4e51-b5e2-4450aaf48a69-workload-socket\") pod \"e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") " pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:27.011907 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.011709    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztfdg\" (UniqueName: \"kubernetes.io/projected/5509dc9a-2836-4e51-b5e2-4450aaf48a69-kube-api-access-ztfdg\") pod \"e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") " pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:27.011907 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.011799    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5509dc9a-2836-4e51-b5e2-4450aaf48a69-istio-token\") pod \"e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") " pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:27.011907 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.011831    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5509dc9a-2836-4e51-b5e2-4450aaf48a69-workload-certs\") pod \"e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") " pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:27.011907 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.011897    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5509dc9a-2836-4e51-b5e2-4450aaf48a69-istio-podinfo\") pod \"e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") " pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:27.012093 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.011957    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5509dc9a-2836-4e51-b5e2-4450aaf48a69-istio-envoy\") pod \"e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") " pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:27.012093 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.011986    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5509dc9a-2836-4e51-b5e2-4450aaf48a69-istio-data\") pod \"e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") " pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:27.012093 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.012009    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5509dc9a-2836-4e51-b5e2-4450aaf48a69-istiod-ca-cert\") pod \"e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") " pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:27.012093 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.012054    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5509dc9a-2836-4e51-b5e2-4450aaf48a69-credential-socket\") pod \"e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") " pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:27.113604 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.113568    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztfdg\" (UniqueName: \"kubernetes.io/projected/5509dc9a-2836-4e51-b5e2-4450aaf48a69-kube-api-access-ztfdg\") pod \"e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") " pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:27.113824 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.113622    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5509dc9a-2836-4e51-b5e2-4450aaf48a69-istio-token\") pod \"e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") " pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:27.113824 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.113641    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5509dc9a-2836-4e51-b5e2-4450aaf48a69-workload-certs\") pod \"e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") " pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:27.113824 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.113679    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5509dc9a-2836-4e51-b5e2-4450aaf48a69-istio-podinfo\") pod \"e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") " pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:27.113824 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.113705    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5509dc9a-2836-4e51-b5e2-4450aaf48a69-istio-envoy\") pod \"e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") " pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:27.113824 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.113722    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5509dc9a-2836-4e51-b5e2-4450aaf48a69-istio-data\") pod \"e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") " pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:27.113824 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.113739    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5509dc9a-2836-4e51-b5e2-4450aaf48a69-istiod-ca-cert\") pod \"e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") " pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:27.113824 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.113790    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5509dc9a-2836-4e51-b5e2-4450aaf48a69-credential-socket\") pod \"e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") " pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:27.114167 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.113851    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5509dc9a-2836-4e51-b5e2-4450aaf48a69-workload-socket\") pod \"e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") " pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:27.114253 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.114226    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5509dc9a-2836-4e51-b5e2-4450aaf48a69-workload-socket\") pod \"e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") " pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:27.114336 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.114311    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5509dc9a-2836-4e51-b5e2-4450aaf48a69-workload-certs\") pod \"e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") " pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:27.114442 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.114372    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5509dc9a-2836-4e51-b5e2-4450aaf48a69-istio-data\") pod \"e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") " pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:27.114442 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.114392    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5509dc9a-2836-4e51-b5e2-4450aaf48a69-credential-socket\") pod \"e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") " pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:27.114575 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.114553    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5509dc9a-2836-4e51-b5e2-4450aaf48a69-istiod-ca-cert\") pod \"e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") " pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:27.116219 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.116187    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:15:27.116459 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.116437    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5509dc9a-2836-4e51-b5e2-4450aaf48a69-istio-envoy\") pod \"e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") " pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:27.116612 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.116592    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5509dc9a-2836-4e51-b5e2-4450aaf48a69-istio-podinfo\") pod \"e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") " pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:27.127801 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.127756    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5509dc9a-2836-4e51-b5e2-4450aaf48a69-istio-token\") pod \"e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") " pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:27.127994 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.127973    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztfdg\" (UniqueName: \"kubernetes.io/projected/5509dc9a-2836-4e51-b5e2-4450aaf48a69-kube-api-access-ztfdg\") pod \"e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") " pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:27.216005 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.215892    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:15:27.240645 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.240603    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:27.367377 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.367331    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ecad48c-e1d2-4efa-bdcb-6f6f98dd0be3" path="/var/lib/kubelet/pods/3ecad48c-e1d2-4efa-bdcb-6f6f98dd0be3/volumes"
Sep 07 13:15:27.367793 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.367750    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b06f2881-e47a-4a6d-86d6-8aacffadae07" path="/var/lib/kubelet/pods/b06f2881-e47a-4a6d-86d6-8aacffadae07/volumes"
Sep 07 13:15:27.522071 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.522039    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"]
Sep 07 13:15:27.523996 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:15:27.523967    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5509dc9a_2836_4e51_b5e2_4450aaf48a69.slice/crio-0a6091de6e3e69f3fa411d35480d15b9bc41aa0d2211264c5fb58368f7095687 WatchSource:0}: Error finding container 0a6091de6e3e69f3fa411d35480d15b9bc41aa0d2211264c5fb58368f7095687: Status 404 returned error can't find the container with id 0a6091de6e3e69f3fa411d35480d15b9bc41aa0d2211264c5fb58368f7095687
Sep 07 13:15:27.526271 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.526238    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:15:27.526332 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.526304    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:15:27.526369 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.526332    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:15:27.728354 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.728311    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm" event={"ID":"5509dc9a-2836-4e51-b5e2-4450aaf48a69","Type":"ContainerStarted","Data":"e6dd94dedd5f41855dd65ee1d39da12135ccd2886fd713d9224883f49d8f65b4"}
Sep 07 13:15:27.728543 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.728376    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm" event={"ID":"5509dc9a-2836-4e51-b5e2-4450aaf48a69","Type":"ContainerStarted","Data":"0a6091de6e3e69f3fa411d35480d15b9bc41aa0d2211264c5fb58368f7095687"}
Sep 07 13:15:27.749170 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:27.749107    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm" podStartSLOduration=1.7490871270000001 podStartE2EDuration="1.749087127s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:15:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:15:27.748733901 +0000 UTC m=+954.805615559" watchObservedRunningTime="2026-09-07 13:15:27.749087127 +0000 UTC m=+954.805968784"
Sep 07 13:15:28.241540 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:28.241507    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:28.246518 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:28.246493    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:28.734724 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:28.734688    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:28.735820 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:28.735800    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:29.193316 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:29.193277    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:15:29.293491 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:29.293446    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:15:30.475128 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:30.475096    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:15:30.580075 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:30.580043    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:15:30.919943 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:30.919885    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:15:31.022856 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.022822    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:15:31.124931 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.124895    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:15:31.424378 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.424350    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:15:31.561488 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.561384    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05e85627-e37d-4009-a153-7453c35cbc6f-credential-socket\") pod \"05e85627-e37d-4009-a153-7453c35cbc6f\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") "
Sep 07 13:15:31.561488 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.561474    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05e85627-e37d-4009-a153-7453c35cbc6f-workload-certs\") pod \"05e85627-e37d-4009-a153-7453c35cbc6f\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") "
Sep 07 13:15:31.562054 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.561504    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05e85627-e37d-4009-a153-7453c35cbc6f-workload-socket\") pod \"05e85627-e37d-4009-a153-7453c35cbc6f\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") "
Sep 07 13:15:31.562054 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.561531    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-458zc\" (UniqueName: \"kubernetes.io/projected/05e85627-e37d-4009-a153-7453c35cbc6f-kube-api-access-458zc\") pod \"05e85627-e37d-4009-a153-7453c35cbc6f\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") "
Sep 07 13:15:31.562054 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.561559    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05e85627-e37d-4009-a153-7453c35cbc6f-istio-podinfo\") pod \"05e85627-e37d-4009-a153-7453c35cbc6f\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") "
Sep 07 13:15:31.562054 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.561581    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05e85627-e37d-4009-a153-7453c35cbc6f-istiod-ca-cert\") pod \"05e85627-e37d-4009-a153-7453c35cbc6f\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") "
Sep 07 13:15:31.562054 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.561611    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05e85627-e37d-4009-a153-7453c35cbc6f-istio-envoy\") pod \"05e85627-e37d-4009-a153-7453c35cbc6f\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") "
Sep 07 13:15:31.562054 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.561692    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05e85627-e37d-4009-a153-7453c35cbc6f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "05e85627-e37d-4009-a153-7453c35cbc6f" (UID: "05e85627-e37d-4009-a153-7453c35cbc6f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:15:31.562054 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.561745    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05e85627-e37d-4009-a153-7453c35cbc6f-istio-token\") pod \"05e85627-e37d-4009-a153-7453c35cbc6f\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") "
Sep 07 13:15:31.562054 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.561829    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05e85627-e37d-4009-a153-7453c35cbc6f-istio-data\") pod \"05e85627-e37d-4009-a153-7453c35cbc6f\" (UID: \"05e85627-e37d-4009-a153-7453c35cbc6f\") "
Sep 07 13:15:31.562054 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.561844    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05e85627-e37d-4009-a153-7453c35cbc6f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "05e85627-e37d-4009-a153-7453c35cbc6f" (UID: "05e85627-e37d-4009-a153-7453c35cbc6f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:15:31.562054 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.561860    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05e85627-e37d-4009-a153-7453c35cbc6f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "05e85627-e37d-4009-a153-7453c35cbc6f" (UID: "05e85627-e37d-4009-a153-7453c35cbc6f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:15:31.562054 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.562042    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05e85627-e37d-4009-a153-7453c35cbc6f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "05e85627-e37d-4009-a153-7453c35cbc6f" (UID: "05e85627-e37d-4009-a153-7453c35cbc6f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:15:31.562491 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.562128    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05e85627-e37d-4009-a153-7453c35cbc6f-istio-data" (OuterVolumeSpecName: "istio-data") pod "05e85627-e37d-4009-a153-7453c35cbc6f" (UID: "05e85627-e37d-4009-a153-7453c35cbc6f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:15:31.562491 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.562313    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05e85627-e37d-4009-a153-7453c35cbc6f-istiod-ca-cert\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:15:31.562491 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.562331    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05e85627-e37d-4009-a153-7453c35cbc6f-istio-data\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:15:31.562491 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.562344    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05e85627-e37d-4009-a153-7453c35cbc6f-credential-socket\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:15:31.562491 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.562357    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05e85627-e37d-4009-a153-7453c35cbc6f-workload-certs\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:15:31.562491 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.562370    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05e85627-e37d-4009-a153-7453c35cbc6f-workload-socket\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:15:31.564040 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.564007    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05e85627-e37d-4009-a153-7453c35cbc6f-istio-token" (OuterVolumeSpecName: "istio-token") pod "05e85627-e37d-4009-a153-7453c35cbc6f" (UID: "05e85627-e37d-4009-a153-7453c35cbc6f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:15:31.564133 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.564044    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05e85627-e37d-4009-a153-7453c35cbc6f-kube-api-access-458zc" (OuterVolumeSpecName: "kube-api-access-458zc") pod "05e85627-e37d-4009-a153-7453c35cbc6f" (UID: "05e85627-e37d-4009-a153-7453c35cbc6f"). InnerVolumeSpecName "kube-api-access-458zc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:15:31.564388 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.564362    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05e85627-e37d-4009-a153-7453c35cbc6f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "05e85627-e37d-4009-a153-7453c35cbc6f" (UID: "05e85627-e37d-4009-a153-7453c35cbc6f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:15:31.564461 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.564380    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/05e85627-e37d-4009-a153-7453c35cbc6f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "05e85627-e37d-4009-a153-7453c35cbc6f" (UID: "05e85627-e37d-4009-a153-7453c35cbc6f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 13:15:31.663560 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.663521    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05e85627-e37d-4009-a153-7453c35cbc6f-istio-token\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:15:31.663560 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.663551    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-458zc\" (UniqueName: \"kubernetes.io/projected/05e85627-e37d-4009-a153-7453c35cbc6f-kube-api-access-458zc\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:15:31.663560 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.663561    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05e85627-e37d-4009-a153-7453c35cbc6f-istio-podinfo\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:15:31.663560 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.663569    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05e85627-e37d-4009-a153-7453c35cbc6f-istio-envoy\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:15:31.752018 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.751983    2576 generic.go:356] "Generic (PLEG): container finished" podID="05e85627-e37d-4009-a153-7453c35cbc6f" containerID="fee355f1e83572b3c4e4f65608f6e2ac726be619c03a000301f64eba9e4facc4" exitCode=0
Sep 07 13:15:31.752193 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.752030    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"
Sep 07 13:15:31.752193 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.752072    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk" event={"ID":"05e85627-e37d-4009-a153-7453c35cbc6f","Type":"ContainerDied","Data":"fee355f1e83572b3c4e4f65608f6e2ac726be619c03a000301f64eba9e4facc4"}
Sep 07 13:15:31.752193 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.752126    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk" event={"ID":"05e85627-e37d-4009-a153-7453c35cbc6f","Type":"ContainerDied","Data":"165bc8797eb8fbceefba93e1a583ae0f085da388a746a07dbd84962e7133049f"}
Sep 07 13:15:31.752193 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.752149    2576 scope.go:117] "RemoveContainer" containerID="fee355f1e83572b3c4e4f65608f6e2ac726be619c03a000301f64eba9e4facc4"
Sep 07 13:15:31.762090 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.762072    2576 scope.go:117] "RemoveContainer" containerID="30e237cb4e16a0813cfe29ac3f56ed052919cefd58169d1c42007d9aba2c3274"
Sep 07 13:15:31.772242 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.772219    2576 scope.go:117] "RemoveContainer" containerID="fee355f1e83572b3c4e4f65608f6e2ac726be619c03a000301f64eba9e4facc4"
Sep 07 13:15:31.772616 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:15:31.772596    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fee355f1e83572b3c4e4f65608f6e2ac726be619c03a000301f64eba9e4facc4\": container with ID starting with fee355f1e83572b3c4e4f65608f6e2ac726be619c03a000301f64eba9e4facc4 not found: ID does not exist" containerID="fee355f1e83572b3c4e4f65608f6e2ac726be619c03a000301f64eba9e4facc4"
Sep 07 13:15:31.772674 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.772627    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fee355f1e83572b3c4e4f65608f6e2ac726be619c03a000301f64eba9e4facc4"} err="failed to get container status \"fee355f1e83572b3c4e4f65608f6e2ac726be619c03a000301f64eba9e4facc4\": rpc error: code = NotFound desc = could not find container \"fee355f1e83572b3c4e4f65608f6e2ac726be619c03a000301f64eba9e4facc4\": container with ID starting with fee355f1e83572b3c4e4f65608f6e2ac726be619c03a000301f64eba9e4facc4 not found: ID does not exist"
Sep 07 13:15:31.772674 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.772647    2576 scope.go:117] "RemoveContainer" containerID="30e237cb4e16a0813cfe29ac3f56ed052919cefd58169d1c42007d9aba2c3274"
Sep 07 13:15:31.772954 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:15:31.772936    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30e237cb4e16a0813cfe29ac3f56ed052919cefd58169d1c42007d9aba2c3274\": container with ID starting with 30e237cb4e16a0813cfe29ac3f56ed052919cefd58169d1c42007d9aba2c3274 not found: ID does not exist" containerID="30e237cb4e16a0813cfe29ac3f56ed052919cefd58169d1c42007d9aba2c3274"
Sep 07 13:15:31.773010 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.772957    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30e237cb4e16a0813cfe29ac3f56ed052919cefd58169d1c42007d9aba2c3274"} err="failed to get container status \"30e237cb4e16a0813cfe29ac3f56ed052919cefd58169d1c42007d9aba2c3274\": rpc error: code = NotFound desc = could not find container \"30e237cb4e16a0813cfe29ac3f56ed052919cefd58169d1c42007d9aba2c3274\": container with ID starting with 30e237cb4e16a0813cfe29ac3f56ed052919cefd58169d1c42007d9aba2c3274 not found: ID does not exist"
Sep 07 13:15:31.773507 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.773490    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"]
Sep 07 13:15:31.777579 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:31.777552    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-50f0dc8e-gw-openshift-default-7b7754bbfb-lxhxk"]
Sep 07 13:15:33.367134 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:33.367100    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05e85627-e37d-4009-a153-7453c35cbc6f" path="/var/lib/kubelet/pods/05e85627-e37d-4009-a153-7453c35cbc6f/volumes"
Sep 07 13:15:43.848211 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:43.848169    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:15:44.775969 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:44.775924    2576 patch_prober.go:28] interesting pod/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 07 13:15:44.776155 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:44.776018    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm" podUID="5509dc9a-2836-4e51-b5e2-4450aaf48a69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 07 13:15:45.851042 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:45.850962    2576 generic.go:356] "Generic (PLEG): container finished" podID="5509dc9a-2836-4e51-b5e2-4450aaf48a69" containerID="e6dd94dedd5f41855dd65ee1d39da12135ccd2886fd713d9224883f49d8f65b4" exitCode=0
Sep 07 13:15:45.851042 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:45.851029    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm" event={"ID":"5509dc9a-2836-4e51-b5e2-4450aaf48a69","Type":"ContainerDied","Data":"e6dd94dedd5f41855dd65ee1d39da12135ccd2886fd713d9224883f49d8f65b4"}
Sep 07 13:15:45.851466 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:45.851448    2576 scope.go:117] "RemoveContainer" containerID="e6dd94dedd5f41855dd65ee1d39da12135ccd2886fd713d9224883f49d8f65b4"
Sep 07 13:15:45.852655 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:45.852625    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:15:45.852723 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:45.852711    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:15:45.852759 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:45.852749    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:15:46.858346 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:46.858259    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm" event={"ID":"5509dc9a-2836-4e51-b5e2-4450aaf48a69","Type":"ContainerStarted","Data":"86be086fd737c53f5f426e3f43c1f833327052d5d7fb805a65decb020cec71b2"}
Sep 07 13:15:47.241125 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:47.241087    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:47.241376 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:47.241355    2576 patch_prober.go:28] interesting pod/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 07 13:15:47.241433 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:47.241410    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm" podUID="5509dc9a-2836-4e51-b5e2-4450aaf48a69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 07 13:15:48.241739 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:48.241700    2576 patch_prober.go:28] interesting pod/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 07 13:15:48.242257 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:48.241803    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm" podUID="5509dc9a-2836-4e51-b5e2-4450aaf48a69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 07 13:15:49.240962 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:49.240926    2576 patch_prober.go:28] interesting pod/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 07 13:15:49.241147 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:49.240979    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm" podUID="5509dc9a-2836-4e51-b5e2-4450aaf48a69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 07 13:15:50.242055 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:50.242010    2576 patch_prober.go:28] interesting pod/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 07 13:15:50.242452 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:50.242075    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm" podUID="5509dc9a-2836-4e51-b5e2-4450aaf48a69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 07 13:15:51.241583 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:51.241543    2576 patch_prober.go:28] interesting pod/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused" start-of-body=
Sep 07 13:15:51.241829 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:51.241624    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm" podUID="5509dc9a-2836-4e51-b5e2-4450aaf48a69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.51:15021/healthz/ready\": dial tcp 10.133.0.51:15021: connect: connection refused"
Sep 07 13:15:52.244548 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:52.244514    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:52.245012 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:52.244805    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:52.245622 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:52.245606    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:15:54.920842 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:54.920730    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d32a524-9hc7q"]
Sep 07 13:15:54.921373 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:54.921351    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05e85627-e37d-4009-a153-7453c35cbc6f" containerName="istio-proxy"
Sep 07 13:15:54.921373 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:54.921374    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="05e85627-e37d-4009-a153-7453c35cbc6f" containerName="istio-proxy"
Sep 07 13:15:54.921601 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:54.921494    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="05e85627-e37d-4009-a153-7453c35cbc6f" containerName="istio-proxy"
Sep 07 13:15:54.921601 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:54.921503    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="05e85627-e37d-4009-a153-7453c35cbc6f" containerName="istio-proxy"
Sep 07 13:15:54.925222 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:54.925203    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d32a524-9hc7q"
Sep 07 13:15:54.927628 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:54.927602    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jlvcf\""
Sep 07 13:15:54.927735 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:54.927655    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 13:15:54.932127 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:54.932096    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d32a524-9hc7q"]
Sep 07 13:15:54.995933 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:54.995897    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/478aac3d-df63-4e3a-8323-559772ff1a86-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7d32a524-9hc7q\" (UID: \"478aac3d-df63-4e3a-8323-559772ff1a86\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d32a524-9hc7q"
Sep 07 13:15:55.096694 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:55.096651    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/478aac3d-df63-4e3a-8323-559772ff1a86-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7d32a524-9hc7q\" (UID: \"478aac3d-df63-4e3a-8323-559772ff1a86\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d32a524-9hc7q"
Sep 07 13:15:55.097324 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:55.097304    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/478aac3d-df63-4e3a-8323-559772ff1a86-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7d32a524-9hc7q\" (UID: \"478aac3d-df63-4e3a-8323-559772ff1a86\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d32a524-9hc7q"
Sep 07 13:15:55.239044 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:55.238963    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d32a524-9hc7q"
Sep 07 13:15:55.268494 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:55.268446    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:15:55.515734 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:55.515550    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d32a524-9hc7q"]
Sep 07 13:15:55.919851 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:55.919816    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d32a524-9hc7q" event={"ID":"478aac3d-df63-4e3a-8323-559772ff1a86","Type":"ContainerStarted","Data":"ff5d28ec2bda1bf0ecfaae21afb4f7226ba4d1be79ed6fec5cf0c9868e027e6d"}
Sep 07 13:15:55.920025 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:55.919905    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d32a524-9hc7q" event={"ID":"478aac3d-df63-4e3a-8323-559772ff1a86","Type":"ContainerStarted","Data":"a3d7bf986cce5e03f1d20671eb492bcb5136cb05cb3eea2c4ed312078d93d4dc"}
Sep 07 13:15:55.937015 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:55.936968    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d32a524-9hc7q" podStartSLOduration=1.9369497230000001 podStartE2EDuration="1.936949723s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:15:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:15:55.936214059 +0000 UTC m=+982.993095717" watchObservedRunningTime="2026-09-07 13:15:55.936949723 +0000 UTC m=+982.993831383"
Sep 07 13:15:56.926327 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:56.926291    2576 generic.go:356] "Generic (PLEG): container finished" podID="478aac3d-df63-4e3a-8323-559772ff1a86" containerID="ff5d28ec2bda1bf0ecfaae21afb4f7226ba4d1be79ed6fec5cf0c9868e027e6d" exitCode=0
Sep 07 13:15:56.926497 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:56.926372    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d32a524-9hc7q" event={"ID":"478aac3d-df63-4e3a-8323-559772ff1a86","Type":"ContainerDied","Data":"ff5d28ec2bda1bf0ecfaae21afb4f7226ba4d1be79ed6fec5cf0c9868e027e6d"}
Sep 07 13:15:58.069726 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:58.069697    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d32a524-9hc7q"
Sep 07 13:15:58.129040 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:58.129010    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/478aac3d-df63-4e3a-8323-559772ff1a86-maas-api-service-ca\") pod \"478aac3d-df63-4e3a-8323-559772ff1a86\" (UID: \"478aac3d-df63-4e3a-8323-559772ff1a86\") "
Sep 07 13:15:58.129386 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:58.129359    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/478aac3d-df63-4e3a-8323-559772ff1a86-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "478aac3d-df63-4e3a-8323-559772ff1a86" (UID: "478aac3d-df63-4e3a-8323-559772ff1a86"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:15:58.230713 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:58.230632    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/478aac3d-df63-4e3a-8323-559772ff1a86-maas-api-service-ca\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:15:58.938578 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:58.938544    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d32a524-9hc7q"
Sep 07 13:15:58.938578 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:58.938572    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d32a524-9hc7q" event={"ID":"478aac3d-df63-4e3a-8323-559772ff1a86","Type":"ContainerDied","Data":"a3d7bf986cce5e03f1d20671eb492bcb5136cb05cb3eea2c4ed312078d93d4dc"}
Sep 07 13:15:58.938782 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:15:58.938614    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a3d7bf986cce5e03f1d20671eb492bcb5136cb05cb3eea2c4ed312078d93d4dc"
Sep 07 13:16:00.279302 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:00.279259    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:00.742891 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:00.742857    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:16:01.282270 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:01.282235    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:01.412109 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:01.412074    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:01.510503 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:01.510467    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:01.615826 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:01.615716    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:01.625736 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:01.625711    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d32a524-9hc7q"]
Sep 07 13:16:01.630904 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:01.630880    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7d32a524-9hc7q"]
Sep 07 13:16:01.749485 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:01.749449    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:02.829100 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:02.829067    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"]
Sep 07 13:16:02.829539 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:02.829326    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm" podUID="5509dc9a-2836-4e51-b5e2-4450aaf48a69" containerName="istio-proxy" containerID="cri-o://86be086fd737c53f5f426e3f43c1f833327052d5d7fb805a65decb020cec71b2" gracePeriod=30
Sep 07 13:16:02.914559 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:02.914523    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:03.302224 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.302188    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:03.366599 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.366564    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="478aac3d-df63-4e3a-8323-559772ff1a86" path="/var/lib/kubelet/pods/478aac3d-df63-4e3a-8323-559772ff1a86/volumes"
Sep 07 13:16:03.708545 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.708510    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:03.719509 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.719482    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"]
Sep 07 13:16:03.719948 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.719934    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="478aac3d-df63-4e3a-8323-559772ff1a86" containerName="revoke-keys"
Sep 07 13:16:03.720009 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.719950    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="478aac3d-df63-4e3a-8323-559772ff1a86" containerName="revoke-keys"
Sep 07 13:16:03.720009 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.719969    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05e85627-e37d-4009-a153-7453c35cbc6f" containerName="istio-proxy"
Sep 07 13:16:03.720009 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.719975    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="05e85627-e37d-4009-a153-7453c35cbc6f" containerName="istio-proxy"
Sep 07 13:16:03.720106 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.720035    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="478aac3d-df63-4e3a-8323-559772ff1a86" containerName="revoke-keys"
Sep 07 13:16:03.723026 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.723008    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:03.728451 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.728425    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-bc6fa7f3-openshift-default-dockercfg-nrh98\""
Sep 07 13:16:03.749855 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.749823    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"]
Sep 07 13:16:03.787220 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.787177    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4437f711-8637-4b84-b173-7e711166ead2-workload-certs\") pod \"e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") " pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:03.787422 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.787233    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4437f711-8637-4b84-b173-7e711166ead2-istio-envoy\") pod \"e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") " pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:03.787422 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.787313    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4437f711-8637-4b84-b173-7e711166ead2-istiod-ca-cert\") pod \"e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") " pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:03.787422 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.787377    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4437f711-8637-4b84-b173-7e711166ead2-credential-socket\") pod \"e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") " pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:03.787422 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.787408    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4437f711-8637-4b84-b173-7e711166ead2-workload-socket\") pod \"e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") " pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:03.787656 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.787449    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4437f711-8637-4b84-b173-7e711166ead2-istio-podinfo\") pod \"e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") " pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:03.787656 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.787498    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4437f711-8637-4b84-b173-7e711166ead2-istio-data\") pod \"e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") " pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:03.787656 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.787567    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zg4f\" (UniqueName: \"kubernetes.io/projected/4437f711-8637-4b84-b173-7e711166ead2-kube-api-access-4zg4f\") pod \"e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") " pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:03.787656 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.787599    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4437f711-8637-4b84-b173-7e711166ead2-istio-token\") pod \"e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") " pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:03.812423 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.812382    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:03.888846 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.888809    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4437f711-8637-4b84-b173-7e711166ead2-workload-certs\") pod \"e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") " pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:03.888846 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.888851    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4437f711-8637-4b84-b173-7e711166ead2-istio-envoy\") pod \"e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") " pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:03.889405 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.888894    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4437f711-8637-4b84-b173-7e711166ead2-istiod-ca-cert\") pod \"e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") " pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:03.889405 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.888927    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4437f711-8637-4b84-b173-7e711166ead2-credential-socket\") pod \"e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") " pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:03.889405 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.888955    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4437f711-8637-4b84-b173-7e711166ead2-workload-socket\") pod \"e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") " pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:03.889405 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.888989    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4437f711-8637-4b84-b173-7e711166ead2-istio-podinfo\") pod \"e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") " pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:03.889405 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.889037    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4437f711-8637-4b84-b173-7e711166ead2-istio-data\") pod \"e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") " pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:03.889405 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.889082    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zg4f\" (UniqueName: \"kubernetes.io/projected/4437f711-8637-4b84-b173-7e711166ead2-kube-api-access-4zg4f\") pod \"e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") " pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:03.889405 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.889113    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4437f711-8637-4b84-b173-7e711166ead2-istio-token\") pod \"e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") " pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:03.889405 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.889303    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4437f711-8637-4b84-b173-7e711166ead2-workload-certs\") pod \"e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") " pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:03.889405 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.889389    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4437f711-8637-4b84-b173-7e711166ead2-credential-socket\") pod \"e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") " pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:03.889788 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.889548    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4437f711-8637-4b84-b173-7e711166ead2-workload-socket\") pod \"e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") " pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:03.889788 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.889604    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4437f711-8637-4b84-b173-7e711166ead2-istio-data\") pod \"e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") " pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:03.889788 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.889663    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4437f711-8637-4b84-b173-7e711166ead2-istiod-ca-cert\") pod \"e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") " pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:03.891332 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.891304    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4437f711-8637-4b84-b173-7e711166ead2-istio-envoy\") pod \"e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") " pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:03.891672 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.891642    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4437f711-8637-4b84-b173-7e711166ead2-istio-podinfo\") pod \"e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") " pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:03.899066 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.899040    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zg4f\" (UniqueName: \"kubernetes.io/projected/4437f711-8637-4b84-b173-7e711166ead2-kube-api-access-4zg4f\") pod \"e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") " pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:03.899066 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:03.899057    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4437f711-8637-4b84-b173-7e711166ead2-istio-token\") pod \"e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") " pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:04.033257 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:04.033160    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:04.184498 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:04.184461    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:04.284179 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:04.284084    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:04.323571 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:04.323547    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"]
Sep 07 13:16:04.325602 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:16:04.325575    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4437f711_8637_4b84_b173_7e711166ead2.slice/crio-9de0e1c6ceb7a1f2dd266decedf901abd73c91b03f2b361f5f0087ec9f9db9a8 WatchSource:0}: Error finding container 9de0e1c6ceb7a1f2dd266decedf901abd73c91b03f2b361f5f0087ec9f9db9a8: Status 404 returned error can't find the container with id 9de0e1c6ceb7a1f2dd266decedf901abd73c91b03f2b361f5f0087ec9f9db9a8
Sep 07 13:16:04.327842 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:04.327804    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:16:04.327941 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:04.327877    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:16:04.327941 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:04.327906    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:16:04.972638 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:04.972604    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh" event={"ID":"4437f711-8637-4b84-b173-7e711166ead2","Type":"ContainerStarted","Data":"1f8681eae63c77bdf48104abee8a23bc5a52e4f1e1f957c6958cbafd7a8d6d71"}
Sep 07 13:16:04.973059 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:04.972662    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh" event={"ID":"4437f711-8637-4b84-b173-7e711166ead2","Type":"ContainerStarted","Data":"9de0e1c6ceb7a1f2dd266decedf901abd73c91b03f2b361f5f0087ec9f9db9a8"}
Sep 07 13:16:04.994535 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:04.994480    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh" podStartSLOduration=1.994463626 podStartE2EDuration="1.994463626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:16:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:16:04.99211611 +0000 UTC m=+992.048997762" watchObservedRunningTime="2026-09-07 13:16:04.994463626 +0000 UTC m=+992.051345283"
Sep 07 13:16:05.033857 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:05.033818    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:05.039003 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:05.038975    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:05.978144 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:05.978107    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:05.979150 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:05.979131    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:06.363150 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:06.363054    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:06.453057 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:06.453027    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:07.247090 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:07.247055    2576 patch_prober.go:28] interesting pod/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 07 13:16:07.247453 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:07.247107    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm" podUID="5509dc9a-2836-4e51-b5e2-4450aaf48a69" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 07 13:16:07.520591 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:07.520481    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:07.624097 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:07.624060    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:07.779567 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:07.779480    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:07.991924 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:07.991893    2576 generic.go:356] "Generic (PLEG): container finished" podID="5509dc9a-2836-4e51-b5e2-4450aaf48a69" containerID="86be086fd737c53f5f426e3f43c1f833327052d5d7fb805a65decb020cec71b2" exitCode=0
Sep 07 13:16:07.992103 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:07.991985    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm" event={"ID":"5509dc9a-2836-4e51-b5e2-4450aaf48a69","Type":"ContainerDied","Data":"86be086fd737c53f5f426e3f43c1f833327052d5d7fb805a65decb020cec71b2"}
Sep 07 13:16:07.992182 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:07.992100    2576 scope.go:117] "RemoveContainer" containerID="e6dd94dedd5f41855dd65ee1d39da12135ccd2886fd713d9224883f49d8f65b4"
Sep 07 13:16:08.037705 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:08.037590    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:08.100891 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:08.100858    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:16:08.140182 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:08.140149    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:08.237063 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:08.237033    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5509dc9a-2836-4e51-b5e2-4450aaf48a69-istio-data\") pod \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") "
Sep 07 13:16:08.237238 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:08.237090    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5509dc9a-2836-4e51-b5e2-4450aaf48a69-istio-podinfo\") pod \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") "
Sep 07 13:16:08.237238 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:08.237143    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5509dc9a-2836-4e51-b5e2-4450aaf48a69-workload-socket\") pod \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") "
Sep 07 13:16:08.237238 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:08.237168    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5509dc9a-2836-4e51-b5e2-4450aaf48a69-istio-envoy\") pod \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") "
Sep 07 13:16:08.237418 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:08.237321    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztfdg\" (UniqueName: \"kubernetes.io/projected/5509dc9a-2836-4e51-b5e2-4450aaf48a69-kube-api-access-ztfdg\") pod \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") "
Sep 07 13:16:08.237418 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:08.237358    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5509dc9a-2836-4e51-b5e2-4450aaf48a69-istio-data" (OuterVolumeSpecName: "istio-data") pod "5509dc9a-2836-4e51-b5e2-4450aaf48a69" (UID: "5509dc9a-2836-4e51-b5e2-4450aaf48a69"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:16:08.237418 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:08.237365    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5509dc9a-2836-4e51-b5e2-4450aaf48a69-workload-certs\") pod \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") "
Sep 07 13:16:08.237574 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:08.237465    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5509dc9a-2836-4e51-b5e2-4450aaf48a69-istiod-ca-cert\") pod \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") "
Sep 07 13:16:08.237574 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:08.237491    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5509dc9a-2836-4e51-b5e2-4450aaf48a69-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5509dc9a-2836-4e51-b5e2-4450aaf48a69" (UID: "5509dc9a-2836-4e51-b5e2-4450aaf48a69"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:16:08.237574 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:08.237528    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5509dc9a-2836-4e51-b5e2-4450aaf48a69-istio-token\") pod \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") "
Sep 07 13:16:08.237725 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:08.237634    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5509dc9a-2836-4e51-b5e2-4450aaf48a69-credential-socket\") pod \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\" (UID: \"5509dc9a-2836-4e51-b5e2-4450aaf48a69\") "
Sep 07 13:16:08.237910 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:08.237880    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5509dc9a-2836-4e51-b5e2-4450aaf48a69-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5509dc9a-2836-4e51-b5e2-4450aaf48a69" (UID: "5509dc9a-2836-4e51-b5e2-4450aaf48a69"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:16:08.238296 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:08.238041    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5509dc9a-2836-4e51-b5e2-4450aaf48a69-istio-data\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:08.238296 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:08.238066    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5509dc9a-2836-4e51-b5e2-4450aaf48a69-workload-socket\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:08.238296 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:08.238080    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5509dc9a-2836-4e51-b5e2-4450aaf48a69-istiod-ca-cert\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:08.238296 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:08.238118    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5509dc9a-2836-4e51-b5e2-4450aaf48a69-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5509dc9a-2836-4e51-b5e2-4450aaf48a69" (UID: "5509dc9a-2836-4e51-b5e2-4450aaf48a69"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:16:08.238296 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:08.238254    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5509dc9a-2836-4e51-b5e2-4450aaf48a69-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5509dc9a-2836-4e51-b5e2-4450aaf48a69" (UID: "5509dc9a-2836-4e51-b5e2-4450aaf48a69"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:16:08.239911 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:08.239880    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5509dc9a-2836-4e51-b5e2-4450aaf48a69-kube-api-access-ztfdg" (OuterVolumeSpecName: "kube-api-access-ztfdg") pod "5509dc9a-2836-4e51-b5e2-4450aaf48a69" (UID: "5509dc9a-2836-4e51-b5e2-4450aaf48a69"). InnerVolumeSpecName "kube-api-access-ztfdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:16:08.240003 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:08.239909    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5509dc9a-2836-4e51-b5e2-4450aaf48a69-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5509dc9a-2836-4e51-b5e2-4450aaf48a69" (UID: "5509dc9a-2836-4e51-b5e2-4450aaf48a69"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 13:16:08.240104 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:08.240087    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5509dc9a-2836-4e51-b5e2-4450aaf48a69-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5509dc9a-2836-4e51-b5e2-4450aaf48a69" (UID: "5509dc9a-2836-4e51-b5e2-4450aaf48a69"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:16:08.240150 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:08.240123    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5509dc9a-2836-4e51-b5e2-4450aaf48a69-istio-token" (OuterVolumeSpecName: "istio-token") pod "5509dc9a-2836-4e51-b5e2-4450aaf48a69" (UID: "5509dc9a-2836-4e51-b5e2-4450aaf48a69"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:16:08.339079 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:08.338979    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5509dc9a-2836-4e51-b5e2-4450aaf48a69-istio-podinfo\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:08.339079 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:08.339012    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5509dc9a-2836-4e51-b5e2-4450aaf48a69-istio-envoy\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:08.339079 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:08.339026    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztfdg\" (UniqueName: \"kubernetes.io/projected/5509dc9a-2836-4e51-b5e2-4450aaf48a69-kube-api-access-ztfdg\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:08.339079 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:08.339039    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5509dc9a-2836-4e51-b5e2-4450aaf48a69-workload-certs\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:08.339079 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:08.339050    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5509dc9a-2836-4e51-b5e2-4450aaf48a69-istio-token\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:08.339079 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:08.339060    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5509dc9a-2836-4e51-b5e2-4450aaf48a69-credential-socket\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:08.999490 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:08.999455    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm" event={"ID":"5509dc9a-2836-4e51-b5e2-4450aaf48a69","Type":"ContainerDied","Data":"0a6091de6e3e69f3fa411d35480d15b9bc41aa0d2211264c5fb58368f7095687"}
Sep 07 13:16:08.999677 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:08.999511    2576 scope.go:117] "RemoveContainer" containerID="86be086fd737c53f5f426e3f43c1f833327052d5d7fb805a65decb020cec71b2"
Sep 07 13:16:08.999677 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:08.999472    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"
Sep 07 13:16:09.021994 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:09.021961    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"]
Sep 07 13:16:09.024980 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:09.024953    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-7d32a524-openshift-default-68db7d4fdd-xncxm"]
Sep 07 13:16:09.368274 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:09.368184    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5509dc9a-2836-4e51-b5e2-4450aaf48a69" path="/var/lib/kubelet/pods/5509dc9a-2836-4e51-b5e2-4450aaf48a69/volumes"
Sep 07 13:16:14.669882 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:14.669848    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:14.782258 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:14.782225    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-adacb1-q96zd"]
Sep 07 13:16:14.783291 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:14.783263    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5509dc9a-2836-4e51-b5e2-4450aaf48a69" containerName="istio-proxy"
Sep 07 13:16:14.783449 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:14.783438    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5509dc9a-2836-4e51-b5e2-4450aaf48a69" containerName="istio-proxy"
Sep 07 13:16:14.783526 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:14.783517    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5509dc9a-2836-4e51-b5e2-4450aaf48a69" containerName="istio-proxy"
Sep 07 13:16:14.783591 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:14.783583    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5509dc9a-2836-4e51-b5e2-4450aaf48a69" containerName="istio-proxy"
Sep 07 13:16:14.783917 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:14.783901    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5509dc9a-2836-4e51-b5e2-4450aaf48a69" containerName="istio-proxy"
Sep 07 13:16:14.784024 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:14.784014    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5509dc9a-2836-4e51-b5e2-4450aaf48a69" containerName="istio-proxy"
Sep 07 13:16:14.790401 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:14.790376    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-adacb1-q96zd"]
Sep 07 13:16:14.790511 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:14.790479    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-adacb1-q96zd"
Sep 07 13:16:14.792933 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:14.792912    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jlvcf\""
Sep 07 13:16:14.793033 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:14.792912    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 13:16:14.908483 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:14.908434    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a77d3779-31bf-4a78-b4a7-5760e4dca730-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-adacb1-q96zd\" (UID: \"a77d3779-31bf-4a78-b4a7-5760e4dca730\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-adacb1-q96zd"
Sep 07 13:16:14.925662 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:14.925567    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:15.009224 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:15.009187    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a77d3779-31bf-4a78-b4a7-5760e4dca730-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-adacb1-q96zd\" (UID: \"a77d3779-31bf-4a78-b4a7-5760e4dca730\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-adacb1-q96zd"
Sep 07 13:16:15.009843 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:15.009826    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a77d3779-31bf-4a78-b4a7-5760e4dca730-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-adacb1-q96zd\" (UID: \"a77d3779-31bf-4a78-b4a7-5760e4dca730\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-adacb1-q96zd"
Sep 07 13:16:15.101301 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:15.101252    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-adacb1-q96zd"
Sep 07 13:16:15.372451 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:15.372425    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-adacb1-q96zd"]
Sep 07 13:16:15.374577 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:16:15.374551    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda77d3779_31bf_4a78_b4a7_5760e4dca730.slice/crio-e9d1243bad1f90fe7b2ef3853d9c17cf7394ea9b76b88cb464a3a88585bac953 WatchSource:0}: Error finding container e9d1243bad1f90fe7b2ef3853d9c17cf7394ea9b76b88cb464a3a88585bac953: Status 404 returned error can't find the container with id e9d1243bad1f90fe7b2ef3853d9c17cf7394ea9b76b88cb464a3a88585bac953
Sep 07 13:16:16.038692 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:16.038656    2576 generic.go:356] "Generic (PLEG): container finished" podID="a77d3779-31bf-4a78-b4a7-5760e4dca730" containerID="44460a24c2ebfbe197f2702a949b5108d10089f38160e449e7f2dfcaada3f91c" exitCode=0
Sep 07 13:16:16.039025 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:16.038701    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-adacb1-q96zd" event={"ID":"a77d3779-31bf-4a78-b4a7-5760e4dca730","Type":"ContainerDied","Data":"44460a24c2ebfbe197f2702a949b5108d10089f38160e449e7f2dfcaada3f91c"}
Sep 07 13:16:16.039025 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:16.038749    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-adacb1-q96zd" event={"ID":"a77d3779-31bf-4a78-b4a7-5760e4dca730","Type":"ContainerStarted","Data":"e9d1243bad1f90fe7b2ef3853d9c17cf7394ea9b76b88cb464a3a88585bac953"}
Sep 07 13:16:17.173863 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:17.173838    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-adacb1-q96zd"
Sep 07 13:16:17.328529 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:17.328470    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a77d3779-31bf-4a78-b4a7-5760e4dca730-maas-api-service-ca\") pod \"a77d3779-31bf-4a78-b4a7-5760e4dca730\" (UID: \"a77d3779-31bf-4a78-b4a7-5760e4dca730\") "
Sep 07 13:16:17.328801 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:17.328757    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a77d3779-31bf-4a78-b4a7-5760e4dca730-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a77d3779-31bf-4a78-b4a7-5760e4dca730" (UID: "a77d3779-31bf-4a78-b4a7-5760e4dca730"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:16:17.429366 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:17.429343    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a77d3779-31bf-4a78-b4a7-5760e4dca730-maas-api-service-ca\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:18.050403 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:18.050367    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-adacb1-q96zd" event={"ID":"a77d3779-31bf-4a78-b4a7-5760e4dca730","Type":"ContainerDied","Data":"e9d1243bad1f90fe7b2ef3853d9c17cf7394ea9b76b88cb464a3a88585bac953"}
Sep 07 13:16:18.050528 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:18.050410    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-adacb1-q96zd"
Sep 07 13:16:18.050528 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:18.050424    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9d1243bad1f90fe7b2ef3853d9c17cf7394ea9b76b88cb464a3a88585bac953"
Sep 07 13:16:20.836790 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:20.836728    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:16:25.398790 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:25.397419    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:25.480017 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:25.479985    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:25.677784 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:25.677677    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:25.727442 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:25.727414    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-adacb1-q96zd"]
Sep 07 13:16:25.730892 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:25.730872    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-adacb1-q96zd"]
Sep 07 13:16:25.749584 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:25.749557    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:26.092514 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:26.092420    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:27.366213 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:27.366179    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a77d3779-31bf-4a78-b4a7-5760e4dca730" path="/var/lib/kubelet/pods/a77d3779-31bf-4a78-b4a7-5760e4dca730/volumes"
Sep 07 13:16:28.594679 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:28.594637    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:31.129531 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:31.129501    2576 generic.go:356] "Generic (PLEG): container finished" podID="4437f711-8637-4b84-b173-7e711166ead2" containerID="1f8681eae63c77bdf48104abee8a23bc5a52e4f1e1f957c6958cbafd7a8d6d71" exitCode=0
Sep 07 13:16:31.129943 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:31.129535    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh" event={"ID":"4437f711-8637-4b84-b173-7e711166ead2","Type":"ContainerDied","Data":"1f8681eae63c77bdf48104abee8a23bc5a52e4f1e1f957c6958cbafd7a8d6d71"}
Sep 07 13:16:31.129943 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:31.129928    2576 scope.go:117] "RemoveContainer" containerID="1f8681eae63c77bdf48104abee8a23bc5a52e4f1e1f957c6958cbafd7a8d6d71"
Sep 07 13:16:31.130933 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:31.130900    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:16:31.131008 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:31.130966    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:16:31.131008 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:31.130998    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:16:31.250716 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:31.250679    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bc6fa7f3-jbd4j"]
Sep 07 13:16:31.251253 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:31.251237    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a77d3779-31bf-4a78-b4a7-5760e4dca730" containerName="revoke-keys"
Sep 07 13:16:31.251297 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:31.251257    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a77d3779-31bf-4a78-b4a7-5760e4dca730" containerName="revoke-keys"
Sep 07 13:16:31.251381 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:31.251371    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a77d3779-31bf-4a78-b4a7-5760e4dca730" containerName="revoke-keys"
Sep 07 13:16:31.254608 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:31.254592    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bc6fa7f3-jbd4j"
Sep 07 13:16:31.257191 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:31.257165    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 13:16:31.257316 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:31.257248    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jlvcf\""
Sep 07 13:16:31.257518 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:31.257501    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93c7bce8-f18e-4a71-a59e-1fde3bc498b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-bc6fa7f3-jbd4j\" (UID: \"93c7bce8-f18e-4a71-a59e-1fde3bc498b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bc6fa7f3-jbd4j"
Sep 07 13:16:31.262323 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:31.262295    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bc6fa7f3-jbd4j"]
Sep 07 13:16:31.358904 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:31.358871    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93c7bce8-f18e-4a71-a59e-1fde3bc498b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-bc6fa7f3-jbd4j\" (UID: \"93c7bce8-f18e-4a71-a59e-1fde3bc498b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bc6fa7f3-jbd4j"
Sep 07 13:16:31.359447 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:31.359431    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93c7bce8-f18e-4a71-a59e-1fde3bc498b4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-bc6fa7f3-jbd4j\" (UID: \"93c7bce8-f18e-4a71-a59e-1fde3bc498b4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bc6fa7f3-jbd4j"
Sep 07 13:16:31.566693 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:31.566608    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bc6fa7f3-jbd4j"
Sep 07 13:16:31.838544 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:31.838518    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bc6fa7f3-jbd4j"]
Sep 07 13:16:31.840424 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:16:31.840394    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93c7bce8_f18e_4a71_a59e_1fde3bc498b4.slice/crio-c5ccdd35c9ef13fecfa414e4fb2a94e150f4f933f24ab4cc7dd39a7dae1c1190 WatchSource:0}: Error finding container c5ccdd35c9ef13fecfa414e4fb2a94e150f4f933f24ab4cc7dd39a7dae1c1190: Status 404 returned error can't find the container with id c5ccdd35c9ef13fecfa414e4fb2a94e150f4f933f24ab4cc7dd39a7dae1c1190
Sep 07 13:16:32.137342 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:32.137308    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh" event={"ID":"4437f711-8637-4b84-b173-7e711166ead2","Type":"ContainerStarted","Data":"6ddc0705308644f65403420a3998941aa3bd1819d8d6b14a60896c680aeb3ff2"}
Sep 07 13:16:32.138648 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:32.138627    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bc6fa7f3-jbd4j" event={"ID":"93c7bce8-f18e-4a71-a59e-1fde3bc498b4","Type":"ContainerStarted","Data":"c5ccdd35c9ef13fecfa414e4fb2a94e150f4f933f24ab4cc7dd39a7dae1c1190"}
Sep 07 13:16:32.244131 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:32.244099    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:32.345713 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:32.345605    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:32.495420 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:32.495378    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"]
Sep 07 13:16:32.496175 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:32.496142    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb" podUID="f54036df-524e-4e36-9717-626767a5e1d0" containerName="istio-proxy" containerID="cri-o://a64502b03c86825602cff76ec6c614ca18c7d9b8726f5f84a303d3833a17bd43" gracePeriod=30
Sep 07 13:16:32.530353 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:32.530323    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:32.986421 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:32.986348    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:33.033509 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.033436    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:33.034309 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.034288    2576 patch_prober.go:28] interesting pod/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 07 13:16:33.034396 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.034333    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh" podUID="4437f711-8637-4b84-b173-7e711166ead2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 07 13:16:33.145137 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.145113    2576 generic.go:356] "Generic (PLEG): container finished" podID="93c7bce8-f18e-4a71-a59e-1fde3bc498b4" containerID="1768b74a2893314b82614de7bd605b4113295be10e3ad99e497ee8b8bd8fb1d9" exitCode=0
Sep 07 13:16:33.145471 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.145205    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bc6fa7f3-jbd4j" event={"ID":"93c7bce8-f18e-4a71-a59e-1fde3bc498b4","Type":"ContainerDied","Data":"1768b74a2893314b82614de7bd605b4113295be10e3ad99e497ee8b8bd8fb1d9"}
Sep 07 13:16:33.286839 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.283331    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"]
Sep 07 13:16:33.291022 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.290995    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:16:33.305097 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.305079    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-f5e4c4-openshift-default-dockercfg-7nblj\""
Sep 07 13:16:33.314622 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.314603    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"]
Sep 07 13:16:33.403315 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.403276    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed14e766-13eb-4361-83eb-159e9455e714-workload-socket\") pod \"e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") " pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:16:33.403627 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.403605    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed14e766-13eb-4361-83eb-159e9455e714-istio-data\") pod \"e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") " pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:16:33.403827 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.403808    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed14e766-13eb-4361-83eb-159e9455e714-workload-certs\") pod \"e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") " pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:16:33.404002 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.403983    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed14e766-13eb-4361-83eb-159e9455e714-credential-socket\") pod \"e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") " pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:16:33.404133 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.404118    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed14e766-13eb-4361-83eb-159e9455e714-istio-podinfo\") pod \"e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") " pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:16:33.404298 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.404282    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed14e766-13eb-4361-83eb-159e9455e714-istio-envoy\") pod \"e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") " pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:16:33.404424 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.404408    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8vrr\" (UniqueName: \"kubernetes.io/projected/ed14e766-13eb-4361-83eb-159e9455e714-kube-api-access-x8vrr\") pod \"e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") " pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:16:33.404549 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.404534    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed14e766-13eb-4361-83eb-159e9455e714-istiod-ca-cert\") pod \"e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") " pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:16:33.404677 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.404663    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed14e766-13eb-4361-83eb-159e9455e714-istio-token\") pod \"e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") " pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:16:33.414925 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.414901    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:33.506725 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.506700    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed14e766-13eb-4361-83eb-159e9455e714-istio-envoy\") pod \"e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") " pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:16:33.506872 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.506729    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8vrr\" (UniqueName: \"kubernetes.io/projected/ed14e766-13eb-4361-83eb-159e9455e714-kube-api-access-x8vrr\") pod \"e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") " pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:16:33.506872 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.506750    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed14e766-13eb-4361-83eb-159e9455e714-istiod-ca-cert\") pod \"e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") " pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:16:33.506872 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.506787    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed14e766-13eb-4361-83eb-159e9455e714-istio-token\") pod \"e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") " pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:16:33.506872 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.506818    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed14e766-13eb-4361-83eb-159e9455e714-workload-socket\") pod \"e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") " pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:16:33.507111 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.506884    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed14e766-13eb-4361-83eb-159e9455e714-istio-data\") pod \"e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") " pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:16:33.507111 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.506946    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed14e766-13eb-4361-83eb-159e9455e714-workload-certs\") pod \"e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") " pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:16:33.507111 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.506984    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed14e766-13eb-4361-83eb-159e9455e714-credential-socket\") pod \"e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") " pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:16:33.507111 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.507011    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed14e766-13eb-4361-83eb-159e9455e714-istio-podinfo\") pod \"e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") " pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:16:33.507509 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.507454    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed14e766-13eb-4361-83eb-159e9455e714-credential-socket\") pod \"e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") " pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:16:33.507720 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.507704    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed14e766-13eb-4361-83eb-159e9455e714-workload-certs\") pod \"e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") " pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:16:33.507848 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.507807    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed14e766-13eb-4361-83eb-159e9455e714-istiod-ca-cert\") pod \"e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") " pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:16:33.507947 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.507859    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed14e766-13eb-4361-83eb-159e9455e714-workload-socket\") pod \"e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") " pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:16:33.508021 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.507892    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed14e766-13eb-4361-83eb-159e9455e714-istio-data\") pod \"e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") " pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:16:33.509877 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.509855    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed14e766-13eb-4361-83eb-159e9455e714-istio-envoy\") pod \"e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") " pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:16:33.510017 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.510000    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed14e766-13eb-4361-83eb-159e9455e714-istio-podinfo\") pod \"e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") " pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:16:33.524040 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.524016    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed14e766-13eb-4361-83eb-159e9455e714-istio-token\") pod \"e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") " pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:16:33.552568 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.552516    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8vrr\" (UniqueName: \"kubernetes.io/projected/ed14e766-13eb-4361-83eb-159e9455e714-kube-api-access-x8vrr\") pod \"e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") " pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:16:33.601292 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.601252    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:16:33.663373 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.663341    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:33.889562 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.889459    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"]
Sep 07 13:16:33.892599 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:16:33.892566    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded14e766_13eb_4361_83eb_159e9455e714.slice/crio-9b86c0b01a41b3ba198d0b0a0546fb8d83ae35d3c7239b8785bead2b70369594 WatchSource:0}: Error finding container 9b86c0b01a41b3ba198d0b0a0546fb8d83ae35d3c7239b8785bead2b70369594: Status 404 returned error can't find the container with id 9b86c0b01a41b3ba198d0b0a0546fb8d83ae35d3c7239b8785bead2b70369594
Sep 07 13:16:33.895807 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.895748    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:16:33.895884 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.895851    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:16:33.895884 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:33.895881    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:16:34.033756 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:34.033722    2576 patch_prober.go:28] interesting pod/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 07 13:16:34.033931 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:34.033791    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh" podUID="4437f711-8637-4b84-b173-7e711166ead2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 07 13:16:34.153882 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:34.153797    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw" event={"ID":"ed14e766-13eb-4361-83eb-159e9455e714","Type":"ContainerStarted","Data":"970f09164dd64e7a32381e1d44f967fc51b628c85b5d64612655274fca0833e1"}
Sep 07 13:16:34.153882 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:34.153860    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw" event={"ID":"ed14e766-13eb-4361-83eb-159e9455e714","Type":"ContainerStarted","Data":"9b86c0b01a41b3ba198d0b0a0546fb8d83ae35d3c7239b8785bead2b70369594"}
Sep 07 13:16:34.186795 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:34.186633    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw" podStartSLOduration=1.186612516 podStartE2EDuration="1.186612516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:16:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:16:34.183212728 +0000 UTC m=+1021.240094428" watchObservedRunningTime="2026-09-07 13:16:34.186612516 +0000 UTC m=+1021.243494178"
Sep 07 13:16:34.333946 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:34.333923    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bc6fa7f3-jbd4j"
Sep 07 13:16:34.415415 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:34.415337    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93c7bce8-f18e-4a71-a59e-1fde3bc498b4-maas-api-service-ca\") pod \"93c7bce8-f18e-4a71-a59e-1fde3bc498b4\" (UID: \"93c7bce8-f18e-4a71-a59e-1fde3bc498b4\") "
Sep 07 13:16:34.415667 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:34.415646    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93c7bce8-f18e-4a71-a59e-1fde3bc498b4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "93c7bce8-f18e-4a71-a59e-1fde3bc498b4" (UID: "93c7bce8-f18e-4a71-a59e-1fde3bc498b4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:16:34.516460 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:34.516433    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/93c7bce8-f18e-4a71-a59e-1fde3bc498b4-maas-api-service-ca\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:34.601962 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:34.601931    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:16:34.603359 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:34.603336    2576 patch_prober.go:28] interesting pod/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 07 13:16:34.603452 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:34.603392    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw" podUID="ed14e766-13eb-4361-83eb-159e9455e714" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 07 13:16:35.033598 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:35.033564    2576 patch_prober.go:28] interesting pod/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 07 13:16:35.033758 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:35.033616    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh" podUID="4437f711-8637-4b84-b173-7e711166ead2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 07 13:16:35.160540 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:35.160514    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bc6fa7f3-jbd4j"
Sep 07 13:16:35.160941 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:35.160563    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bc6fa7f3-jbd4j" event={"ID":"93c7bce8-f18e-4a71-a59e-1fde3bc498b4","Type":"ContainerDied","Data":"c5ccdd35c9ef13fecfa414e4fb2a94e150f4f933f24ab4cc7dd39a7dae1c1190"}
Sep 07 13:16:35.160941 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:35.160613    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c5ccdd35c9ef13fecfa414e4fb2a94e150f4f933f24ab4cc7dd39a7dae1c1190"
Sep 07 13:16:35.606481 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:35.606452    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:16:35.978707 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:35.978670    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:36.034112 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:36.034083    2576 patch_prober.go:28] interesting pod/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Sep 07 13:16:36.034257 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:36.034133    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh" podUID="4437f711-8637-4b84-b173-7e711166ead2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Sep 07 13:16:36.165688 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:36.165661    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:16:36.170664 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:36.170637    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:16:36.228147 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:36.228106    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:36.327976 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:36.327882    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:37.045419 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.045389    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:37.047338 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.047315    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:37.338439 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.338355    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq"]
Sep 07 13:16:37.379405 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.379359    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:37.480961 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.480926    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:16:37.530846 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.530820    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:37.630710 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.630665    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:37.732848 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.732815    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:37.759928 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.759904    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:16:37.845755 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.845723    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f54036df-524e-4e36-9717-626767a5e1d0-istio-token\") pod \"f54036df-524e-4e36-9717-626767a5e1d0\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") "
Sep 07 13:16:37.845929 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.845828    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f54036df-524e-4e36-9717-626767a5e1d0-workload-socket\") pod \"f54036df-524e-4e36-9717-626767a5e1d0\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") "
Sep 07 13:16:37.845929 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.845870    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f54036df-524e-4e36-9717-626767a5e1d0-istio-podinfo\") pod \"f54036df-524e-4e36-9717-626767a5e1d0\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") "
Sep 07 13:16:37.845929 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.845891    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f54036df-524e-4e36-9717-626767a5e1d0-istio-envoy\") pod \"f54036df-524e-4e36-9717-626767a5e1d0\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") "
Sep 07 13:16:37.846100 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.845939    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9rm6\" (UniqueName: \"kubernetes.io/projected/f54036df-524e-4e36-9717-626767a5e1d0-kube-api-access-f9rm6\") pod \"f54036df-524e-4e36-9717-626767a5e1d0\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") "
Sep 07 13:16:37.846100 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.845975    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f54036df-524e-4e36-9717-626767a5e1d0-istiod-ca-cert\") pod \"f54036df-524e-4e36-9717-626767a5e1d0\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") "
Sep 07 13:16:37.846100 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.846008    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f54036df-524e-4e36-9717-626767a5e1d0-credential-socket\") pod \"f54036df-524e-4e36-9717-626767a5e1d0\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") "
Sep 07 13:16:37.846100 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.846053    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f54036df-524e-4e36-9717-626767a5e1d0-workload-certs\") pod \"f54036df-524e-4e36-9717-626767a5e1d0\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") "
Sep 07 13:16:37.846100 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.846076    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f54036df-524e-4e36-9717-626767a5e1d0-istio-data\") pod \"f54036df-524e-4e36-9717-626767a5e1d0\" (UID: \"f54036df-524e-4e36-9717-626767a5e1d0\") "
Sep 07 13:16:37.846374 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.846148    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f54036df-524e-4e36-9717-626767a5e1d0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f54036df-524e-4e36-9717-626767a5e1d0" (UID: "f54036df-524e-4e36-9717-626767a5e1d0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:16:37.846460 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.846435    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f54036df-524e-4e36-9717-626767a5e1d0-workload-socket\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:37.846881 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.846801    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f54036df-524e-4e36-9717-626767a5e1d0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f54036df-524e-4e36-9717-626767a5e1d0" (UID: "f54036df-524e-4e36-9717-626767a5e1d0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:16:37.846881 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.846834    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f54036df-524e-4e36-9717-626767a5e1d0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f54036df-524e-4e36-9717-626767a5e1d0" (UID: "f54036df-524e-4e36-9717-626767a5e1d0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:16:37.847095 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.846877    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f54036df-524e-4e36-9717-626767a5e1d0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f54036df-524e-4e36-9717-626767a5e1d0" (UID: "f54036df-524e-4e36-9717-626767a5e1d0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:16:37.847095 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.847044    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f54036df-524e-4e36-9717-626767a5e1d0-istio-data" (OuterVolumeSpecName: "istio-data") pod "f54036df-524e-4e36-9717-626767a5e1d0" (UID: "f54036df-524e-4e36-9717-626767a5e1d0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:16:37.848126 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.848104    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f54036df-524e-4e36-9717-626767a5e1d0-istio-token" (OuterVolumeSpecName: "istio-token") pod "f54036df-524e-4e36-9717-626767a5e1d0" (UID: "f54036df-524e-4e36-9717-626767a5e1d0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:16:37.848507 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.848490    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f54036df-524e-4e36-9717-626767a5e1d0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f54036df-524e-4e36-9717-626767a5e1d0" (UID: "f54036df-524e-4e36-9717-626767a5e1d0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 13:16:37.848857 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.848817    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f54036df-524e-4e36-9717-626767a5e1d0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f54036df-524e-4e36-9717-626767a5e1d0" (UID: "f54036df-524e-4e36-9717-626767a5e1d0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:16:37.848955 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.848933    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f54036df-524e-4e36-9717-626767a5e1d0-kube-api-access-f9rm6" (OuterVolumeSpecName: "kube-api-access-f9rm6") pod "f54036df-524e-4e36-9717-626767a5e1d0" (UID: "f54036df-524e-4e36-9717-626767a5e1d0"). InnerVolumeSpecName "kube-api-access-f9rm6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:16:37.947546 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.947521    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f54036df-524e-4e36-9717-626767a5e1d0-istio-podinfo\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:37.947546 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.947546    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f54036df-524e-4e36-9717-626767a5e1d0-istio-envoy\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:37.947692 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.947559    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9rm6\" (UniqueName: \"kubernetes.io/projected/f54036df-524e-4e36-9717-626767a5e1d0-kube-api-access-f9rm6\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:37.947692 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.947573    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f54036df-524e-4e36-9717-626767a5e1d0-istiod-ca-cert\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:37.947692 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.947585    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f54036df-524e-4e36-9717-626767a5e1d0-credential-socket\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:37.947692 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.947595    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f54036df-524e-4e36-9717-626767a5e1d0-workload-certs\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:37.947692 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.947607    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f54036df-524e-4e36-9717-626767a5e1d0-istio-data\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:37.947692 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:37.947617    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f54036df-524e-4e36-9717-626767a5e1d0-istio-token\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:38.140296 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:38.140266    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:38.179837 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:38.179810    2576 generic.go:356] "Generic (PLEG): container finished" podID="f54036df-524e-4e36-9717-626767a5e1d0" containerID="a64502b03c86825602cff76ec6c614ca18c7d9b8726f5f84a303d3833a17bd43" exitCode=0
Sep 07 13:16:38.179980 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:38.179862    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"
Sep 07 13:16:38.179980 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:38.179889    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb" event={"ID":"f54036df-524e-4e36-9717-626767a5e1d0","Type":"ContainerDied","Data":"a64502b03c86825602cff76ec6c614ca18c7d9b8726f5f84a303d3833a17bd43"}
Sep 07 13:16:38.179980 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:38.179947    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb" event={"ID":"f54036df-524e-4e36-9717-626767a5e1d0","Type":"ContainerDied","Data":"1afd2c16ab282693a5a7e697bf7312b9c659ee31788693e85fe178df7bc586fb"}
Sep 07 13:16:38.179980 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:38.179974    2576 scope.go:117] "RemoveContainer" containerID="a64502b03c86825602cff76ec6c614ca18c7d9b8726f5f84a303d3833a17bd43"
Sep 07 13:16:38.191016 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:38.190997    2576 scope.go:117] "RemoveContainer" containerID="ac01de891cf92a866ecf366b7e9d6e1aa26cd38bc53ba73cc3b0233055261779"
Sep 07 13:16:38.201572 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:38.201485    2576 scope.go:117] "RemoveContainer" containerID="a64502b03c86825602cff76ec6c614ca18c7d9b8726f5f84a303d3833a17bd43"
Sep 07 13:16:38.202027 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:16:38.202003    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a64502b03c86825602cff76ec6c614ca18c7d9b8726f5f84a303d3833a17bd43\": container with ID starting with a64502b03c86825602cff76ec6c614ca18c7d9b8726f5f84a303d3833a17bd43 not found: ID does not exist" containerID="a64502b03c86825602cff76ec6c614ca18c7d9b8726f5f84a303d3833a17bd43"
Sep 07 13:16:38.202136 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:38.202034    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a64502b03c86825602cff76ec6c614ca18c7d9b8726f5f84a303d3833a17bd43"} err="failed to get container status \"a64502b03c86825602cff76ec6c614ca18c7d9b8726f5f84a303d3833a17bd43\": rpc error: code = NotFound desc = could not find container \"a64502b03c86825602cff76ec6c614ca18c7d9b8726f5f84a303d3833a17bd43\": container with ID starting with a64502b03c86825602cff76ec6c614ca18c7d9b8726f5f84a303d3833a17bd43 not found: ID does not exist"
Sep 07 13:16:38.202136 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:38.202054    2576 scope.go:117] "RemoveContainer" containerID="ac01de891cf92a866ecf366b7e9d6e1aa26cd38bc53ba73cc3b0233055261779"
Sep 07 13:16:38.202331 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:16:38.202313    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac01de891cf92a866ecf366b7e9d6e1aa26cd38bc53ba73cc3b0233055261779\": container with ID starting with ac01de891cf92a866ecf366b7e9d6e1aa26cd38bc53ba73cc3b0233055261779 not found: ID does not exist" containerID="ac01de891cf92a866ecf366b7e9d6e1aa26cd38bc53ba73cc3b0233055261779"
Sep 07 13:16:38.202410 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:38.202336    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac01de891cf92a866ecf366b7e9d6e1aa26cd38bc53ba73cc3b0233055261779"} err="failed to get container status \"ac01de891cf92a866ecf366b7e9d6e1aa26cd38bc53ba73cc3b0233055261779\": rpc error: code = NotFound desc = could not find container \"ac01de891cf92a866ecf366b7e9d6e1aa26cd38bc53ba73cc3b0233055261779\": container with ID starting with ac01de891cf92a866ecf366b7e9d6e1aa26cd38bc53ba73cc3b0233055261779 not found: ID does not exist"
Sep 07 13:16:38.211443 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:38.211420    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"]
Sep 07 13:16:38.220085 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:38.220065    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-adacb1-openshift-default-84d5db9dc4-fwsmb"]
Sep 07 13:16:38.238113 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:38.238090    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:38.550172 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:38.550086    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:38.628830 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:38.628792    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:38.731048 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:38.731015    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:38.833083 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:38.832993    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:38.950339 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:38.950309    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bc6fa7f3-jbd4j"]
Sep 07 13:16:38.958819 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:38.958792    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-bc6fa7f3-jbd4j"]
Sep 07 13:16:38.959295 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:38.959272    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:39.110115 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:39.110038    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"]
Sep 07 13:16:39.110272 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:39.110212    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh" podUID="4437f711-8637-4b84-b173-7e711166ead2" containerName="istio-proxy" containerID="cri-o://6ddc0705308644f65403420a3998941aa3bd1819d8d6b14a60896c680aeb3ff2" gracePeriod=30
Sep 07 13:16:39.132922 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:39.132885    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:39.366461 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:39.366384    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93c7bce8-f18e-4a71-a59e-1fde3bc498b4" path="/var/lib/kubelet/pods/93c7bce8-f18e-4a71-a59e-1fde3bc498b4/volumes"
Sep 07 13:16:39.367015 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:39.366994    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f54036df-524e-4e36-9717-626767a5e1d0" path="/var/lib/kubelet/pods/f54036df-524e-4e36-9717-626767a5e1d0/volumes"
Sep 07 13:16:39.906967 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:39.906935    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:40.007738 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:40.007710    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:41.471238 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:41.471184    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:44.356803 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:44.356782    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:44.404869 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:44.404846    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4437f711-8637-4b84-b173-7e711166ead2-istiod-ca-cert\") pod \"4437f711-8637-4b84-b173-7e711166ead2\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") "
Sep 07 13:16:44.404995 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:44.404875    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4437f711-8637-4b84-b173-7e711166ead2-istio-token\") pod \"4437f711-8637-4b84-b173-7e711166ead2\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") "
Sep 07 13:16:44.404995 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:44.404894    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4437f711-8637-4b84-b173-7e711166ead2-istio-podinfo\") pod \"4437f711-8637-4b84-b173-7e711166ead2\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") "
Sep 07 13:16:44.404995 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:44.404937    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4437f711-8637-4b84-b173-7e711166ead2-workload-certs\") pod \"4437f711-8637-4b84-b173-7e711166ead2\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") "
Sep 07 13:16:44.405129 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:44.405002    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zg4f\" (UniqueName: \"kubernetes.io/projected/4437f711-8637-4b84-b173-7e711166ead2-kube-api-access-4zg4f\") pod \"4437f711-8637-4b84-b173-7e711166ead2\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") "
Sep 07 13:16:44.405129 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:44.405063    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4437f711-8637-4b84-b173-7e711166ead2-istio-data\") pod \"4437f711-8637-4b84-b173-7e711166ead2\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") "
Sep 07 13:16:44.405129 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:44.405125    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4437f711-8637-4b84-b173-7e711166ead2-workload-socket\") pod \"4437f711-8637-4b84-b173-7e711166ead2\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") "
Sep 07 13:16:44.405292 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:44.405158    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4437f711-8637-4b84-b173-7e711166ead2-istio-envoy\") pod \"4437f711-8637-4b84-b173-7e711166ead2\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") "
Sep 07 13:16:44.405292 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:44.405184    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4437f711-8637-4b84-b173-7e711166ead2-credential-socket\") pod \"4437f711-8637-4b84-b173-7e711166ead2\" (UID: \"4437f711-8637-4b84-b173-7e711166ead2\") "
Sep 07 13:16:44.405389 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:44.405305    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4437f711-8637-4b84-b173-7e711166ead2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4437f711-8637-4b84-b173-7e711166ead2" (UID: "4437f711-8637-4b84-b173-7e711166ead2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:16:44.405389 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:44.405226    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4437f711-8637-4b84-b173-7e711166ead2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4437f711-8637-4b84-b173-7e711166ead2" (UID: "4437f711-8637-4b84-b173-7e711166ead2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:16:44.405531 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:44.405509    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4437f711-8637-4b84-b173-7e711166ead2-istio-data" (OuterVolumeSpecName: "istio-data") pod "4437f711-8637-4b84-b173-7e711166ead2" (UID: "4437f711-8637-4b84-b173-7e711166ead2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:16:44.405577 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:44.405523    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4437f711-8637-4b84-b173-7e711166ead2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4437f711-8637-4b84-b173-7e711166ead2" (UID: "4437f711-8637-4b84-b173-7e711166ead2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:16:44.405577 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:44.405532    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4437f711-8637-4b84-b173-7e711166ead2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4437f711-8637-4b84-b173-7e711166ead2" (UID: "4437f711-8637-4b84-b173-7e711166ead2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:16:44.405655 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:44.405631    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4437f711-8637-4b84-b173-7e711166ead2-workload-socket\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:44.405655 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:44.405648    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4437f711-8637-4b84-b173-7e711166ead2-credential-socket\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:44.405736 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:44.405663    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4437f711-8637-4b84-b173-7e711166ead2-istiod-ca-cert\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:44.405736 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:44.405676    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4437f711-8637-4b84-b173-7e711166ead2-workload-certs\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:44.405736 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:44.405687    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4437f711-8637-4b84-b173-7e711166ead2-istio-data\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:44.407385 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:44.407358    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4437f711-8637-4b84-b173-7e711166ead2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4437f711-8637-4b84-b173-7e711166ead2" (UID: "4437f711-8637-4b84-b173-7e711166ead2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:16:44.407582 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:44.407557    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4437f711-8637-4b84-b173-7e711166ead2-istio-token" (OuterVolumeSpecName: "istio-token") pod "4437f711-8637-4b84-b173-7e711166ead2" (UID: "4437f711-8637-4b84-b173-7e711166ead2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:16:44.407739 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:44.407714    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4437f711-8637-4b84-b173-7e711166ead2-kube-api-access-4zg4f" (OuterVolumeSpecName: "kube-api-access-4zg4f") pod "4437f711-8637-4b84-b173-7e711166ead2" (UID: "4437f711-8637-4b84-b173-7e711166ead2"). InnerVolumeSpecName "kube-api-access-4zg4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:16:44.407850 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:44.407785    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4437f711-8637-4b84-b173-7e711166ead2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4437f711-8637-4b84-b173-7e711166ead2" (UID: "4437f711-8637-4b84-b173-7e711166ead2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 13:16:44.506457 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:44.506427    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4437f711-8637-4b84-b173-7e711166ead2-istio-envoy\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:44.506457 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:44.506451    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4437f711-8637-4b84-b173-7e711166ead2-istio-token\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:44.506584 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:44.506466    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4437f711-8637-4b84-b173-7e711166ead2-istio-podinfo\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:44.506584 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:44.506477    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zg4f\" (UniqueName: \"kubernetes.io/projected/4437f711-8637-4b84-b173-7e711166ead2-kube-api-access-4zg4f\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:45.218466 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:45.218439    2576 generic.go:356] "Generic (PLEG): container finished" podID="4437f711-8637-4b84-b173-7e711166ead2" containerID="6ddc0705308644f65403420a3998941aa3bd1819d8d6b14a60896c680aeb3ff2" exitCode=0
Sep 07 13:16:45.218634 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:45.218480    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"
Sep 07 13:16:45.218634 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:45.218528    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh" event={"ID":"4437f711-8637-4b84-b173-7e711166ead2","Type":"ContainerDied","Data":"6ddc0705308644f65403420a3998941aa3bd1819d8d6b14a60896c680aeb3ff2"}
Sep 07 13:16:45.218634 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:45.218578    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh" event={"ID":"4437f711-8637-4b84-b173-7e711166ead2","Type":"ContainerDied","Data":"9de0e1c6ceb7a1f2dd266decedf901abd73c91b03f2b361f5f0087ec9f9db9a8"}
Sep 07 13:16:45.218634 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:45.218605    2576 scope.go:117] "RemoveContainer" containerID="6ddc0705308644f65403420a3998941aa3bd1819d8d6b14a60896c680aeb3ff2"
Sep 07 13:16:45.228207 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:45.228028    2576 scope.go:117] "RemoveContainer" containerID="1f8681eae63c77bdf48104abee8a23bc5a52e4f1e1f957c6958cbafd7a8d6d71"
Sep 07 13:16:45.236023 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:45.236007    2576 scope.go:117] "RemoveContainer" containerID="6ddc0705308644f65403420a3998941aa3bd1819d8d6b14a60896c680aeb3ff2"
Sep 07 13:16:45.236289 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:16:45.236271    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ddc0705308644f65403420a3998941aa3bd1819d8d6b14a60896c680aeb3ff2\": container with ID starting with 6ddc0705308644f65403420a3998941aa3bd1819d8d6b14a60896c680aeb3ff2 not found: ID does not exist" containerID="6ddc0705308644f65403420a3998941aa3bd1819d8d6b14a60896c680aeb3ff2"
Sep 07 13:16:45.236335 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:45.236297    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ddc0705308644f65403420a3998941aa3bd1819d8d6b14a60896c680aeb3ff2"} err="failed to get container status \"6ddc0705308644f65403420a3998941aa3bd1819d8d6b14a60896c680aeb3ff2\": rpc error: code = NotFound desc = could not find container \"6ddc0705308644f65403420a3998941aa3bd1819d8d6b14a60896c680aeb3ff2\": container with ID starting with 6ddc0705308644f65403420a3998941aa3bd1819d8d6b14a60896c680aeb3ff2 not found: ID does not exist"
Sep 07 13:16:45.236335 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:45.236312    2576 scope.go:117] "RemoveContainer" containerID="1f8681eae63c77bdf48104abee8a23bc5a52e4f1e1f957c6958cbafd7a8d6d71"
Sep 07 13:16:45.236562 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:16:45.236545    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f8681eae63c77bdf48104abee8a23bc5a52e4f1e1f957c6958cbafd7a8d6d71\": container with ID starting with 1f8681eae63c77bdf48104abee8a23bc5a52e4f1e1f957c6958cbafd7a8d6d71 not found: ID does not exist" containerID="1f8681eae63c77bdf48104abee8a23bc5a52e4f1e1f957c6958cbafd7a8d6d71"
Sep 07 13:16:45.236604 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:45.236567    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f8681eae63c77bdf48104abee8a23bc5a52e4f1e1f957c6958cbafd7a8d6d71"} err="failed to get container status \"1f8681eae63c77bdf48104abee8a23bc5a52e4f1e1f957c6958cbafd7a8d6d71\": rpc error: code = NotFound desc = could not find container \"1f8681eae63c77bdf48104abee8a23bc5a52e4f1e1f957c6958cbafd7a8d6d71\": container with ID starting with 1f8681eae63c77bdf48104abee8a23bc5a52e4f1e1f957c6958cbafd7a8d6d71 not found: ID does not exist"
Sep 07 13:16:45.240861 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:45.240840    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"]
Sep 07 13:16:45.248075 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:45.248055    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-bc6fa7f3-openshift-default-58766c6c5b-rhfxh"]
Sep 07 13:16:45.365998 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:45.365973    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4437f711-8637-4b84-b173-7e711166ead2" path="/var/lib/kubelet/pods/4437f711-8637-4b84-b173-7e711166ead2/volumes"
Sep 07 13:16:48.087995 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:48.087940    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:48.245153 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:48.245108    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:48.459646 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:48.459611    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:48.923211 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:48.923179    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:52.357633 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:52.357573    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq" podUID="30cb6da2-5c24-4ce0-9046-c8c3f38cd27c" containerName="main" containerID="cri-o://ca7c94c61b7526a3e003ef8cf2d1cd99c44eb58dd3094d7e32e455c938f9d2ad" gracePeriod=45
Sep 07 13:16:52.644652 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:52.644626    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq"
Sep 07 13:16:52.796233 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:52.796201    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-tls-certs\") pod \"30cb6da2-5c24-4ce0-9046-c8c3f38cd27c\" (UID: \"30cb6da2-5c24-4ce0-9046-c8c3f38cd27c\") "
Sep 07 13:16:52.796428 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:52.796250    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-dshm\") pod \"30cb6da2-5c24-4ce0-9046-c8c3f38cd27c\" (UID: \"30cb6da2-5c24-4ce0-9046-c8c3f38cd27c\") "
Sep 07 13:16:52.796428 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:52.796269    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-tmp-dir\") pod \"30cb6da2-5c24-4ce0-9046-c8c3f38cd27c\" (UID: \"30cb6da2-5c24-4ce0-9046-c8c3f38cd27c\") "
Sep 07 13:16:52.796428 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:52.796285    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-model-cache\") pod \"30cb6da2-5c24-4ce0-9046-c8c3f38cd27c\" (UID: \"30cb6da2-5c24-4ce0-9046-c8c3f38cd27c\") "
Sep 07 13:16:52.796428 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:52.796357    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-home\") pod \"30cb6da2-5c24-4ce0-9046-c8c3f38cd27c\" (UID: \"30cb6da2-5c24-4ce0-9046-c8c3f38cd27c\") "
Sep 07 13:16:52.796428 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:52.796389    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlmlg\" (UniqueName: \"kubernetes.io/projected/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-kube-api-access-xlmlg\") pod \"30cb6da2-5c24-4ce0-9046-c8c3f38cd27c\" (UID: \"30cb6da2-5c24-4ce0-9046-c8c3f38cd27c\") "
Sep 07 13:16:52.796697 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:52.796516    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "30cb6da2-5c24-4ce0-9046-c8c3f38cd27c" (UID: "30cb6da2-5c24-4ce0-9046-c8c3f38cd27c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:16:52.796697 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:52.796551    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-model-cache" (OuterVolumeSpecName: "model-cache") pod "30cb6da2-5c24-4ce0-9046-c8c3f38cd27c" (UID: "30cb6da2-5c24-4ce0-9046-c8c3f38cd27c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:16:52.796697 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:52.796687    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-tmp-dir\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:52.796697 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:52.796700    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-model-cache\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:52.797082 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:52.796791    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-home" (OuterVolumeSpecName: "home") pod "30cb6da2-5c24-4ce0-9046-c8c3f38cd27c" (UID: "30cb6da2-5c24-4ce0-9046-c8c3f38cd27c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:16:52.798582 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:52.798549    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-kube-api-access-xlmlg" (OuterVolumeSpecName: "kube-api-access-xlmlg") pod "30cb6da2-5c24-4ce0-9046-c8c3f38cd27c" (UID: "30cb6da2-5c24-4ce0-9046-c8c3f38cd27c"). InnerVolumeSpecName "kube-api-access-xlmlg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:16:52.798582 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:52.798556    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-dshm" (OuterVolumeSpecName: "dshm") pod "30cb6da2-5c24-4ce0-9046-c8c3f38cd27c" (UID: "30cb6da2-5c24-4ce0-9046-c8c3f38cd27c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:16:52.798735 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:52.798610    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "30cb6da2-5c24-4ce0-9046-c8c3f38cd27c" (UID: "30cb6da2-5c24-4ce0-9046-c8c3f38cd27c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:16:52.897397 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:52.897320    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-home\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:52.897397 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:52.897348    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlmlg\" (UniqueName: \"kubernetes.io/projected/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-kube-api-access-xlmlg\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:52.897397 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:52.897359    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-tls-certs\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:52.897397 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:52.897367    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c-dshm\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:16:53.142537 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:53.142501    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:16:53.262953 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:53.262926    2576 generic.go:356] "Generic (PLEG): container finished" podID="30cb6da2-5c24-4ce0-9046-c8c3f38cd27c" containerID="ca7c94c61b7526a3e003ef8cf2d1cd99c44eb58dd3094d7e32e455c938f9d2ad" exitCode=0
Sep 07 13:16:53.263097 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:53.262994    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq"
Sep 07 13:16:53.263097 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:53.262997    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq" event={"ID":"30cb6da2-5c24-4ce0-9046-c8c3f38cd27c","Type":"ContainerDied","Data":"ca7c94c61b7526a3e003ef8cf2d1cd99c44eb58dd3094d7e32e455c938f9d2ad"}
Sep 07 13:16:53.263203 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:53.263101    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq" event={"ID":"30cb6da2-5c24-4ce0-9046-c8c3f38cd27c","Type":"ContainerDied","Data":"c48b356c4eb42b5c893de3057c4ae565a30dda5496e09b3d9e855e5790775dbf"}
Sep 07 13:16:53.263203 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:53.263116    2576 scope.go:117] "RemoveContainer" containerID="ca7c94c61b7526a3e003ef8cf2d1cd99c44eb58dd3094d7e32e455c938f9d2ad"
Sep 07 13:16:53.273583 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:53.273567    2576 scope.go:117] "RemoveContainer" containerID="ca7c94c61b7526a3e003ef8cf2d1cd99c44eb58dd3094d7e32e455c938f9d2ad"
Sep 07 13:16:53.273878 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:16:53.273859    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca7c94c61b7526a3e003ef8cf2d1cd99c44eb58dd3094d7e32e455c938f9d2ad\": container with ID starting with ca7c94c61b7526a3e003ef8cf2d1cd99c44eb58dd3094d7e32e455c938f9d2ad not found: ID does not exist" containerID="ca7c94c61b7526a3e003ef8cf2d1cd99c44eb58dd3094d7e32e455c938f9d2ad"
Sep 07 13:16:53.273955 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:53.273889    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca7c94c61b7526a3e003ef8cf2d1cd99c44eb58dd3094d7e32e455c938f9d2ad"} err="failed to get container status \"ca7c94c61b7526a3e003ef8cf2d1cd99c44eb58dd3094d7e32e455c938f9d2ad\": rpc error: code = NotFound desc = could not find container \"ca7c94c61b7526a3e003ef8cf2d1cd99c44eb58dd3094d7e32e455c938f9d2ad\": container with ID starting with ca7c94c61b7526a3e003ef8cf2d1cd99c44eb58dd3094d7e32e455c938f9d2ad not found: ID does not exist"
Sep 07 13:16:53.285344 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:53.285323    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq"]
Sep 07 13:16:53.289539 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:53.289511    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-a-4aad6a88-kserve-6494d46688-vqjhq"]
Sep 07 13:16:53.365733 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:53.365709    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30cb6da2-5c24-4ce0-9046-c8c3f38cd27c" path="/var/lib/kubelet/pods/30cb6da2-5c24-4ce0-9046-c8c3f38cd27c/volumes"
Sep 07 13:16:54.272378 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:54.272340    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:54.555611 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:54.555526    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:55.156892 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.156861    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh"]
Sep 07 13:16:55.157323 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.157305    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f54036df-524e-4e36-9717-626767a5e1d0" containerName="istio-proxy"
Sep 07 13:16:55.157432 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.157325    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f54036df-524e-4e36-9717-626767a5e1d0" containerName="istio-proxy"
Sep 07 13:16:55.157432 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.157335    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4437f711-8637-4b84-b173-7e711166ead2" containerName="istio-proxy"
Sep 07 13:16:55.157432 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.157343    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4437f711-8637-4b84-b173-7e711166ead2" containerName="istio-proxy"
Sep 07 13:16:55.157432 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.157356    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f54036df-524e-4e36-9717-626767a5e1d0" containerName="istio-proxy"
Sep 07 13:16:55.157432 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.157364    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f54036df-524e-4e36-9717-626767a5e1d0" containerName="istio-proxy"
Sep 07 13:16:55.157432 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.157379    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30cb6da2-5c24-4ce0-9046-c8c3f38cd27c" containerName="main"
Sep 07 13:16:55.157432 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.157386    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="30cb6da2-5c24-4ce0-9046-c8c3f38cd27c" containerName="main"
Sep 07 13:16:55.157432 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.157423    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93c7bce8-f18e-4a71-a59e-1fde3bc498b4" containerName="revoke-keys"
Sep 07 13:16:55.157432 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.157430    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="93c7bce8-f18e-4a71-a59e-1fde3bc498b4" containerName="revoke-keys"
Sep 07 13:16:55.157897 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.157534    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4437f711-8637-4b84-b173-7e711166ead2" containerName="istio-proxy"
Sep 07 13:16:55.157897 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.157545    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f54036df-524e-4e36-9717-626767a5e1d0" containerName="istio-proxy"
Sep 07 13:16:55.157897 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.157555    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="30cb6da2-5c24-4ce0-9046-c8c3f38cd27c" containerName="main"
Sep 07 13:16:55.157897 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.157565    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="93c7bce8-f18e-4a71-a59e-1fde3bc498b4" containerName="revoke-keys"
Sep 07 13:16:55.161936 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.161915    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh"
Sep 07 13:16:55.164877 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.164859    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-824a79\"/\"kube-root-ca.crt\""
Sep 07 13:16:55.165647 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.165627    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-824a79\"/\"default-dockercfg-672xp\""
Sep 07 13:16:55.165736 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.165648    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-824a79\"/\"test-model-824a79-kserve-self-signed-certs\""
Sep 07 13:16:55.165736 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.165630    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-824a79\"/\"openshift-service-ca.crt\""
Sep 07 13:16:55.179442 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.179419    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh"]
Sep 07 13:16:55.184608 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.184585    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:16:55.320782 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.320746    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36521406-43a6-4fd4-b7fb-9226d6a92b79-model-cache\") pod \"test-model-824a79-kserve-759d54b667-j9pxh\" (UID: \"36521406-43a6-4fd4-b7fb-9226d6a92b79\") " pod="ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh"
Sep 07 13:16:55.320940 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.320832    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36521406-43a6-4fd4-b7fb-9226d6a92b79-home\") pod \"test-model-824a79-kserve-759d54b667-j9pxh\" (UID: \"36521406-43a6-4fd4-b7fb-9226d6a92b79\") " pod="ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh"
Sep 07 13:16:55.320940 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.320868    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36521406-43a6-4fd4-b7fb-9226d6a92b79-tmp-dir\") pod \"test-model-824a79-kserve-759d54b667-j9pxh\" (UID: \"36521406-43a6-4fd4-b7fb-9226d6a92b79\") " pod="ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh"
Sep 07 13:16:55.320940 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.320885    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36521406-43a6-4fd4-b7fb-9226d6a92b79-tls-certs\") pod \"test-model-824a79-kserve-759d54b667-j9pxh\" (UID: \"36521406-43a6-4fd4-b7fb-9226d6a92b79\") " pod="ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh"
Sep 07 13:16:55.321043 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.321027    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xplt\" (UniqueName: \"kubernetes.io/projected/36521406-43a6-4fd4-b7fb-9226d6a92b79-kube-api-access-9xplt\") pod \"test-model-824a79-kserve-759d54b667-j9pxh\" (UID: \"36521406-43a6-4fd4-b7fb-9226d6a92b79\") " pod="ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh"
Sep 07 13:16:55.321074 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.321062    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36521406-43a6-4fd4-b7fb-9226d6a92b79-dshm\") pod \"test-model-824a79-kserve-759d54b667-j9pxh\" (UID: \"36521406-43a6-4fd4-b7fb-9226d6a92b79\") " pod="ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh"
Sep 07 13:16:55.422059 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.422000    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xplt\" (UniqueName: \"kubernetes.io/projected/36521406-43a6-4fd4-b7fb-9226d6a92b79-kube-api-access-9xplt\") pod \"test-model-824a79-kserve-759d54b667-j9pxh\" (UID: \"36521406-43a6-4fd4-b7fb-9226d6a92b79\") " pod="ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh"
Sep 07 13:16:55.422059 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.422026    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36521406-43a6-4fd4-b7fb-9226d6a92b79-dshm\") pod \"test-model-824a79-kserve-759d54b667-j9pxh\" (UID: \"36521406-43a6-4fd4-b7fb-9226d6a92b79\") " pod="ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh"
Sep 07 13:16:55.422059 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.422055    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36521406-43a6-4fd4-b7fb-9226d6a92b79-model-cache\") pod \"test-model-824a79-kserve-759d54b667-j9pxh\" (UID: \"36521406-43a6-4fd4-b7fb-9226d6a92b79\") " pod="ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh"
Sep 07 13:16:55.422283 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.422080    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36521406-43a6-4fd4-b7fb-9226d6a92b79-home\") pod \"test-model-824a79-kserve-759d54b667-j9pxh\" (UID: \"36521406-43a6-4fd4-b7fb-9226d6a92b79\") " pod="ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh"
Sep 07 13:16:55.422283 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.422117    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36521406-43a6-4fd4-b7fb-9226d6a92b79-tmp-dir\") pod \"test-model-824a79-kserve-759d54b667-j9pxh\" (UID: \"36521406-43a6-4fd4-b7fb-9226d6a92b79\") " pod="ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh"
Sep 07 13:16:55.422283 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.422139    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36521406-43a6-4fd4-b7fb-9226d6a92b79-tls-certs\") pod \"test-model-824a79-kserve-759d54b667-j9pxh\" (UID: \"36521406-43a6-4fd4-b7fb-9226d6a92b79\") " pod="ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh"
Sep 07 13:16:55.422529 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.422498    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36521406-43a6-4fd4-b7fb-9226d6a92b79-model-cache\") pod \"test-model-824a79-kserve-759d54b667-j9pxh\" (UID: \"36521406-43a6-4fd4-b7fb-9226d6a92b79\") " pod="ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh"
Sep 07 13:16:55.422662 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.422559    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36521406-43a6-4fd4-b7fb-9226d6a92b79-home\") pod \"test-model-824a79-kserve-759d54b667-j9pxh\" (UID: \"36521406-43a6-4fd4-b7fb-9226d6a92b79\") " pod="ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh"
Sep 07 13:16:55.422662 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.422597    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36521406-43a6-4fd4-b7fb-9226d6a92b79-tmp-dir\") pod \"test-model-824a79-kserve-759d54b667-j9pxh\" (UID: \"36521406-43a6-4fd4-b7fb-9226d6a92b79\") " pod="ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh"
Sep 07 13:16:55.424358 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.424335    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36521406-43a6-4fd4-b7fb-9226d6a92b79-dshm\") pod \"test-model-824a79-kserve-759d54b667-j9pxh\" (UID: \"36521406-43a6-4fd4-b7fb-9226d6a92b79\") " pod="ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh"
Sep 07 13:16:55.424603 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.424585    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36521406-43a6-4fd4-b7fb-9226d6a92b79-tls-certs\") pod \"test-model-824a79-kserve-759d54b667-j9pxh\" (UID: \"36521406-43a6-4fd4-b7fb-9226d6a92b79\") " pod="ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh"
Sep 07 13:16:55.430599 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.430577    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xplt\" (UniqueName: \"kubernetes.io/projected/36521406-43a6-4fd4-b7fb-9226d6a92b79-kube-api-access-9xplt\") pod \"test-model-824a79-kserve-759d54b667-j9pxh\" (UID: \"36521406-43a6-4fd4-b7fb-9226d6a92b79\") " pod="ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh"
Sep 07 13:16:55.472653 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.472631    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh"
Sep 07 13:16:55.751633 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:55.751585    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh"]
Sep 07 13:16:55.754273 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:16:55.754235    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod36521406_43a6_4fd4_b7fb_9226d6a92b79.slice/crio-35b796c894b4ef367db59ec2509619c5bc693c1675b67af134224a8448d1e28b WatchSource:0}: Error finding container 35b796c894b4ef367db59ec2509619c5bc693c1675b67af134224a8448d1e28b: Status 404 returned error can't find the container with id 35b796c894b4ef367db59ec2509619c5bc693c1675b67af134224a8448d1e28b
Sep 07 13:16:56.284871 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:56.284843    2576 generic.go:356] "Generic (PLEG): container finished" podID="ed14e766-13eb-4361-83eb-159e9455e714" containerID="970f09164dd64e7a32381e1d44f967fc51b628c85b5d64612655274fca0833e1" exitCode=0
Sep 07 13:16:56.285009 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:56.284922    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw" event={"ID":"ed14e766-13eb-4361-83eb-159e9455e714","Type":"ContainerDied","Data":"970f09164dd64e7a32381e1d44f967fc51b628c85b5d64612655274fca0833e1"}
Sep 07 13:16:56.285337 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:56.285322    2576 scope.go:117] "RemoveContainer" containerID="970f09164dd64e7a32381e1d44f967fc51b628c85b5d64612655274fca0833e1"
Sep 07 13:16:56.286423 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:56.286390    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:16:56.286524 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:56.286467    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:16:56.286524 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:56.286503    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:16:56.286713 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:56.286693    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh" event={"ID":"36521406-43a6-4fd4-b7fb-9226d6a92b79","Type":"ContainerStarted","Data":"ccba9a0f828764ac062a459d365a4cc6fa49cc87d2e518b5ed49ef14857c4bef"}
Sep 07 13:16:56.286752 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:56.286725    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh" event={"ID":"36521406-43a6-4fd4-b7fb-9226d6a92b79","Type":"ContainerStarted","Data":"35b796c894b4ef367db59ec2509619c5bc693c1675b67af134224a8448d1e28b"}
Sep 07 13:16:56.335879 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:56.334606    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh" podStartSLOduration=1.334581425 podStartE2EDuration="1.334581425s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:16:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:16:56.323445769 +0000 UTC m=+1043.380327428" watchObservedRunningTime="2026-09-07 13:16:56.334581425 +0000 UTC m=+1043.391463084"
Sep 07 13:16:57.296588 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:57.296544    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw" event={"ID":"ed14e766-13eb-4361-83eb-159e9455e714","Type":"ContainerStarted","Data":"2c31d9901742b25212aa509a7d71f9999b93e43c4cc65c6a502ca821fd248e9d"}
Sep 07 13:16:57.602235 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:57.602152    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:16:57.602494 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:57.602470    2576 patch_prober.go:28] interesting pod/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 07 13:16:57.602585 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:57.602541    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw" podUID="ed14e766-13eb-4361-83eb-159e9455e714" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 07 13:16:58.602196 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:58.602162    2576 patch_prober.go:28] interesting pod/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 07 13:16:58.602545 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:58.602210    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw" podUID="ed14e766-13eb-4361-83eb-159e9455e714" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 07 13:16:59.601711 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:59.601673    2576 patch_prober.go:28] interesting pod/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 07 13:16:59.601907 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:16:59.601732    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw" podUID="ed14e766-13eb-4361-83eb-159e9455e714" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 07 13:17:00.602311 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:00.602271    2576 patch_prober.go:28] interesting pod/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 07 13:17:00.602732 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:00.602330    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw" podUID="ed14e766-13eb-4361-83eb-159e9455e714" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 07 13:17:01.201738 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:01.201707    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:17:01.602575 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:01.602487    2576 patch_prober.go:28] interesting pod/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Sep 07 13:17:01.602575 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:01.602552    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw" podUID="ed14e766-13eb-4361-83eb-159e9455e714" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Sep 07 13:17:02.700008 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:02.699974    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:17:02.700709 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:02.700282    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:17:02.701196 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:02.701177    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:17:05.472788 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:05.472739    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh"
Sep 07 13:17:05.473317 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:05.472801    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh"
Sep 07 13:17:05.485221 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:05.485199    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh"
Sep 07 13:17:06.354691 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:06.354659    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh"
Sep 07 13:17:10.057512 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:10.057478    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:17:14.789647 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:14.789605    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:17:20.941989 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:20.941946    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:17:21.020062 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:21.020025    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:17:21.123997 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:21.123961    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:17:21.595812 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:21.595760    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:17:24.153088 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:24.153052    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:17:34.555862 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:34.555822    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:17:35.320560 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:35.320527    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:17:37.071952 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:37.071887    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:17:43.784223 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:43.784182    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:17:43.922586 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:43.922547    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:17:44.124900 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:44.124865    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:17:45.764058 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:45.764025    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:17:53.484818 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:53.484756    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f5e4c4-ztlxw"]
Sep 07 13:17:53.485203 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:53.485149    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4437f711-8637-4b84-b173-7e711166ead2" containerName="istio-proxy"
Sep 07 13:17:53.485203 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:53.485160    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4437f711-8637-4b84-b173-7e711166ead2" containerName="istio-proxy"
Sep 07 13:17:53.485293 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:53.485247    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="4437f711-8637-4b84-b173-7e711166ead2" containerName="istio-proxy"
Sep 07 13:17:53.485293 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:53.485262    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f54036df-524e-4e36-9717-626767a5e1d0" containerName="istio-proxy"
Sep 07 13:17:53.488350 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:53.488335    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f5e4c4-ztlxw"
Sep 07 13:17:53.490561 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:53.490543    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jlvcf\""
Sep 07 13:17:53.491189 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:53.491177    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 13:17:53.498350 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:53.498325    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f5e4c4-ztlxw"]
Sep 07 13:17:53.549974 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:53.549950    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:17:53.583335 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:53.583308    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/690207c8-f47b-41b1-bcc8-bb3435208ebf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-f5e4c4-ztlxw\" (UID: \"690207c8-f47b-41b1-bcc8-bb3435208ebf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f5e4c4-ztlxw"
Sep 07 13:17:53.684734 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:53.684710    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/690207c8-f47b-41b1-bcc8-bb3435208ebf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-f5e4c4-ztlxw\" (UID: \"690207c8-f47b-41b1-bcc8-bb3435208ebf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f5e4c4-ztlxw"
Sep 07 13:17:53.685378 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:53.685355    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/690207c8-f47b-41b1-bcc8-bb3435208ebf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-f5e4c4-ztlxw\" (UID: \"690207c8-f47b-41b1-bcc8-bb3435208ebf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f5e4c4-ztlxw"
Sep 07 13:17:53.799013 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:53.798948    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f5e4c4-ztlxw"
Sep 07 13:17:54.076308 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:54.072883    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f5e4c4-ztlxw"]
Sep 07 13:17:54.495160 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:54.495125    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:17:54.605288 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:54.605232    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f5e4c4-ztlxw" event={"ID":"690207c8-f47b-41b1-bcc8-bb3435208ebf","Type":"ContainerStarted","Data":"733bfc9a0e505303eeb8cf31b0a5fc2a3371ad2efabfdd7e13b9e351702d8e04"}
Sep 07 13:17:54.605479 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:54.605297    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f5e4c4-ztlxw" event={"ID":"690207c8-f47b-41b1-bcc8-bb3435208ebf","Type":"ContainerStarted","Data":"1fb64f53cc2ad9e0aacff93e6c390cb5b02ad749afc7840a67361be2f27386c9"}
Sep 07 13:17:54.623031 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:54.622990    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f5e4c4-ztlxw" podStartSLOduration=1.622975321 podStartE2EDuration="1.622975321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:17:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:17:54.621688671 +0000 UTC m=+1101.678570356" watchObservedRunningTime="2026-09-07 13:17:54.622975321 +0000 UTC m=+1101.679856990"
Sep 07 13:17:55.303040 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:55.303003    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:17:55.612091 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:55.612008    2576 generic.go:356] "Generic (PLEG): container finished" podID="690207c8-f47b-41b1-bcc8-bb3435208ebf" containerID="733bfc9a0e505303eeb8cf31b0a5fc2a3371ad2efabfdd7e13b9e351702d8e04" exitCode=0
Sep 07 13:17:55.612439 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:55.612102    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f5e4c4-ztlxw" event={"ID":"690207c8-f47b-41b1-bcc8-bb3435208ebf","Type":"ContainerDied","Data":"733bfc9a0e505303eeb8cf31b0a5fc2a3371ad2efabfdd7e13b9e351702d8e04"}
Sep 07 13:17:56.749440 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:56.749411    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f5e4c4-ztlxw"
Sep 07 13:17:56.814421 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:56.814379    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/690207c8-f47b-41b1-bcc8-bb3435208ebf-maas-api-service-ca\") pod \"690207c8-f47b-41b1-bcc8-bb3435208ebf\" (UID: \"690207c8-f47b-41b1-bcc8-bb3435208ebf\") "
Sep 07 13:17:56.814803 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:56.814746    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/690207c8-f47b-41b1-bcc8-bb3435208ebf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "690207c8-f47b-41b1-bcc8-bb3435208ebf" (UID: "690207c8-f47b-41b1-bcc8-bb3435208ebf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:17:56.915457 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:56.915418    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/690207c8-f47b-41b1-bcc8-bb3435208ebf-maas-api-service-ca\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:17:57.623310 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:57.623231    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f5e4c4-ztlxw"
Sep 07 13:17:57.623310 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:57.623268    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f5e4c4-ztlxw" event={"ID":"690207c8-f47b-41b1-bcc8-bb3435208ebf","Type":"ContainerDied","Data":"1fb64f53cc2ad9e0aacff93e6c390cb5b02ad749afc7840a67361be2f27386c9"}
Sep 07 13:17:57.623310 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:17:57.623311    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1fb64f53cc2ad9e0aacff93e6c390cb5b02ad749afc7840a67361be2f27386c9"
Sep 07 13:18:00.383263 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:00.383220    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:01.321113 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:01.321073    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh"]
Sep 07 13:18:01.351417 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:01.351381    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:01.451471 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:01.451434    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ebfa46-fqwbb"]
Sep 07 13:18:01.451902 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:01.451887    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="690207c8-f47b-41b1-bcc8-bb3435208ebf" containerName="revoke-keys"
Sep 07 13:18:01.451902 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:01.451903    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="690207c8-f47b-41b1-bcc8-bb3435208ebf" containerName="revoke-keys"
Sep 07 13:18:01.451990 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:01.451985    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="690207c8-f47b-41b1-bcc8-bb3435208ebf" containerName="revoke-keys"
Sep 07 13:18:01.455064 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:01.455047    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ebfa46-fqwbb"
Sep 07 13:18:01.457168 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:01.457144    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 13:18:01.457302 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:01.457150    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jlvcf\""
Sep 07 13:18:01.464102 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:01.463563    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ebfa46-fqwbb"]
Sep 07 13:18:01.562608 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:01.562569    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/381bd957-c168-4d2f-843e-733660154c0d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-ebfa46-fqwbb\" (UID: \"381bd957-c168-4d2f-843e-733660154c0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ebfa46-fqwbb"
Sep 07 13:18:01.663625 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:01.663591    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/381bd957-c168-4d2f-843e-733660154c0d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-ebfa46-fqwbb\" (UID: \"381bd957-c168-4d2f-843e-733660154c0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ebfa46-fqwbb"
Sep 07 13:18:01.664322 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:01.664298    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/381bd957-c168-4d2f-843e-733660154c0d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-ebfa46-fqwbb\" (UID: \"381bd957-c168-4d2f-843e-733660154c0d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ebfa46-fqwbb"
Sep 07 13:18:01.768533 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:01.768492    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ebfa46-fqwbb"
Sep 07 13:18:01.802551 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:01.802499    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:01.944657 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:01.944562    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:02.095710 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:02.095681    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ebfa46-fqwbb"]
Sep 07 13:18:02.097676 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:18:02.097649    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod381bd957_c168_4d2f_843e_733660154c0d.slice/crio-bb7fe00f6637d7efbb2135b511a71494471576d1c00b66e389d4ff963daf7c17 WatchSource:0}: Error finding container bb7fe00f6637d7efbb2135b511a71494471576d1c00b66e389d4ff963daf7c17: Status 404 returned error can't find the container with id bb7fe00f6637d7efbb2135b511a71494471576d1c00b66e389d4ff963daf7c17
Sep 07 13:18:02.242608 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:02.242514    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:02.401097 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:02.401045    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:02.653786 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:02.653724    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ebfa46-fqwbb" event={"ID":"381bd957-c168-4d2f-843e-733660154c0d","Type":"ContainerStarted","Data":"a06e56a93d44f83d20de9eb805d4234b2f9229d98070b22c3430b0ce4b634a1d"}
Sep 07 13:18:02.654192 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:02.653812    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ebfa46-fqwbb" event={"ID":"381bd957-c168-4d2f-843e-733660154c0d","Type":"ContainerStarted","Data":"bb7fe00f6637d7efbb2135b511a71494471576d1c00b66e389d4ff963daf7c17"}
Sep 07 13:18:02.685414 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:02.685359    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ebfa46-fqwbb" podStartSLOduration=1.685339661 podStartE2EDuration="1.685339661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:18:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:18:02.68361979 +0000 UTC m=+1109.740501448" watchObservedRunningTime="2026-09-07 13:18:02.685339661 +0000 UTC m=+1109.742221317"
Sep 07 13:18:03.033120 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:03.033029    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:03.163085 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:03.163050    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:18:03.176232 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:03.176198    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:03.660585 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:03.660553    2576 generic.go:356] "Generic (PLEG): container finished" podID="381bd957-c168-4d2f-843e-733660154c0d" containerID="a06e56a93d44f83d20de9eb805d4234b2f9229d98070b22c3430b0ce4b634a1d" exitCode=0
Sep 07 13:18:03.661040 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:03.660670    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ebfa46-fqwbb" event={"ID":"381bd957-c168-4d2f-843e-733660154c0d","Type":"ContainerDied","Data":"a06e56a93d44f83d20de9eb805d4234b2f9229d98070b22c3430b0ce4b634a1d"}
Sep 07 13:18:04.094681 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:04.094583    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:04.332030 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:04.331991    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:04.634485 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:04.634448    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:04.805351 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:04.805323    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ebfa46-fqwbb"
Sep 07 13:18:04.838779 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:04.838731    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f5e4c4-ztlxw"]
Sep 07 13:18:04.847317 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:04.847284    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-f5e4c4-ztlxw"]
Sep 07 13:18:04.893690 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:04.893603    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/381bd957-c168-4d2f-843e-733660154c0d-maas-api-service-ca\") pod \"381bd957-c168-4d2f-843e-733660154c0d\" (UID: \"381bd957-c168-4d2f-843e-733660154c0d\") "
Sep 07 13:18:04.894001 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:04.893977    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/381bd957-c168-4d2f-843e-733660154c0d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "381bd957-c168-4d2f-843e-733660154c0d" (UID: "381bd957-c168-4d2f-843e-733660154c0d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:18:04.942658 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:04.942624    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:04.994947 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:04.994914    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/381bd957-c168-4d2f-843e-733660154c0d-maas-api-service-ca\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:18:05.157600 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:05.157513    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:05.292508 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:05.292464    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:05.366174 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:05.366142    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="690207c8-f47b-41b1-bcc8-bb3435208ebf" path="/var/lib/kubelet/pods/690207c8-f47b-41b1-bcc8-bb3435208ebf/volumes"
Sep 07 13:18:05.673814 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:05.673783    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ebfa46-fqwbb"
Sep 07 13:18:05.673814 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:05.673794    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ebfa46-fqwbb" event={"ID":"381bd957-c168-4d2f-843e-733660154c0d","Type":"ContainerDied","Data":"bb7fe00f6637d7efbb2135b511a71494471576d1c00b66e389d4ff963daf7c17"}
Sep 07 13:18:05.674055 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:05.673842    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb7fe00f6637d7efbb2135b511a71494471576d1c00b66e389d4ff963daf7c17"
Sep 07 13:18:10.062053 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:10.062016    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:11.734315 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:11.734279    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:11.836291 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:11.836256    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:12.284970 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:12.284928    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-ebfa46-29813115-fwnwq"]
Sep 07 13:18:12.288736 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:12.288708    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-ebfa46-29813115-fwnwq"]
Sep 07 13:18:12.292136 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:12.292103    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:12.405429 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:12.405400    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:12.507176 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:12.507128    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:12.611191 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:12.611104    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:12.649795 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:12.649735    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ebfa46-fqwbb"]
Sep 07 13:18:12.653802 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:12.653758    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-ebfa46-fqwbb"]
Sep 07 13:18:12.840123 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:12.840086    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:13.259641 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:13.259607    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:13.367354 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:13.367315    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="381bd957-c168-4d2f-843e-733660154c0d" path="/var/lib/kubelet/pods/381bd957-c168-4d2f-843e-733660154c0d/volumes"
Sep 07 13:18:13.367684 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:13.367664    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e97082f-ac27-4143-b045-903df551face" path="/var/lib/kubelet/pods/9e97082f-ac27-4143-b045-903df551face/volumes"
Sep 07 13:18:13.760330 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:13.760298    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:13.892188 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:13.892157    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:14.072046 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:14.071969    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"]
Sep 07 13:18:14.072251 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:14.072206    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw" podUID="ed14e766-13eb-4361-83eb-159e9455e714" containerName="istio-proxy" containerID="cri-o://2c31d9901742b25212aa509a7d71f9999b93e43c4cc65c6a502ca821fd248e9d" gracePeriod=30
Sep 07 13:18:14.106923 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:14.106891    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:14.587849 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:14.587809    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:14.934306 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:14.934266    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:15.114455 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:15.114421    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:16.223234 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:16.223204    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:16.335251 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:16.335212    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:16.340953 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:16.340919    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh" podUID="36521406-43a6-4fd4-b7fb-9226d6a92b79" containerName="main" containerID="cri-o://ccba9a0f828764ac062a459d365a4cc6fa49cc87d2e518b5ed49ef14857c4bef" gracePeriod=45
Sep 07 13:18:16.344636 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:16.344606    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh" podUID="36521406-43a6-4fd4-b7fb-9226d6a92b79" containerName="main" probeResult="failure" output="Get \"https://10.133.0.57:8000/ready\": dial tcp 10.133.0.57:8000: connect: connection refused"
Sep 07 13:18:16.372990 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:16.372962    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:18:16.463525 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:16.463490    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:16.602673 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:16.602644    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh"
Sep 07 13:18:16.707559 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:16.707529    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36521406-43a6-4fd4-b7fb-9226d6a92b79-model-cache\") pod \"36521406-43a6-4fd4-b7fb-9226d6a92b79\" (UID: \"36521406-43a6-4fd4-b7fb-9226d6a92b79\") "
Sep 07 13:18:16.707758 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:16.707567    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36521406-43a6-4fd4-b7fb-9226d6a92b79-tmp-dir\") pod \"36521406-43a6-4fd4-b7fb-9226d6a92b79\" (UID: \"36521406-43a6-4fd4-b7fb-9226d6a92b79\") "
Sep 07 13:18:16.707758 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:16.707613    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xplt\" (UniqueName: \"kubernetes.io/projected/36521406-43a6-4fd4-b7fb-9226d6a92b79-kube-api-access-9xplt\") pod \"36521406-43a6-4fd4-b7fb-9226d6a92b79\" (UID: \"36521406-43a6-4fd4-b7fb-9226d6a92b79\") "
Sep 07 13:18:16.707758 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:16.707738    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36521406-43a6-4fd4-b7fb-9226d6a92b79-tls-certs\") pod \"36521406-43a6-4fd4-b7fb-9226d6a92b79\" (UID: \"36521406-43a6-4fd4-b7fb-9226d6a92b79\") "
Sep 07 13:18:16.707950 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:16.707804    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36521406-43a6-4fd4-b7fb-9226d6a92b79-dshm\") pod \"36521406-43a6-4fd4-b7fb-9226d6a92b79\" (UID: \"36521406-43a6-4fd4-b7fb-9226d6a92b79\") "
Sep 07 13:18:16.707950 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:16.707842    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36521406-43a6-4fd4-b7fb-9226d6a92b79-home\") pod \"36521406-43a6-4fd4-b7fb-9226d6a92b79\" (UID: \"36521406-43a6-4fd4-b7fb-9226d6a92b79\") "
Sep 07 13:18:16.707950 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:16.707845    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36521406-43a6-4fd4-b7fb-9226d6a92b79-model-cache" (OuterVolumeSpecName: "model-cache") pod "36521406-43a6-4fd4-b7fb-9226d6a92b79" (UID: "36521406-43a6-4fd4-b7fb-9226d6a92b79"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:18:16.707950 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:16.707899    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36521406-43a6-4fd4-b7fb-9226d6a92b79-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "36521406-43a6-4fd4-b7fb-9226d6a92b79" (UID: "36521406-43a6-4fd4-b7fb-9226d6a92b79"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:18:16.708118 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:16.708063    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36521406-43a6-4fd4-b7fb-9226d6a92b79-home" (OuterVolumeSpecName: "home") pod "36521406-43a6-4fd4-b7fb-9226d6a92b79" (UID: "36521406-43a6-4fd4-b7fb-9226d6a92b79"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:18:16.708178 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:16.708162    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/36521406-43a6-4fd4-b7fb-9226d6a92b79-home\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:18:16.708226 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:16.708184    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/36521406-43a6-4fd4-b7fb-9226d6a92b79-model-cache\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:18:16.708226 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:16.708197    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36521406-43a6-4fd4-b7fb-9226d6a92b79-tmp-dir\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:18:16.710166 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:16.710144    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36521406-43a6-4fd4-b7fb-9226d6a92b79-kube-api-access-9xplt" (OuterVolumeSpecName: "kube-api-access-9xplt") pod "36521406-43a6-4fd4-b7fb-9226d6a92b79" (UID: "36521406-43a6-4fd4-b7fb-9226d6a92b79"). InnerVolumeSpecName "kube-api-access-9xplt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:18:16.710166 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:16.710145    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/36521406-43a6-4fd4-b7fb-9226d6a92b79-dshm" (OuterVolumeSpecName: "dshm") pod "36521406-43a6-4fd4-b7fb-9226d6a92b79" (UID: "36521406-43a6-4fd4-b7fb-9226d6a92b79"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:18:16.710309 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:16.710166    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/36521406-43a6-4fd4-b7fb-9226d6a92b79-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "36521406-43a6-4fd4-b7fb-9226d6a92b79" (UID: "36521406-43a6-4fd4-b7fb-9226d6a92b79"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:18:16.735274 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:16.735243    2576 generic.go:356] "Generic (PLEG): container finished" podID="36521406-43a6-4fd4-b7fb-9226d6a92b79" containerID="ccba9a0f828764ac062a459d365a4cc6fa49cc87d2e518b5ed49ef14857c4bef" exitCode=0
Sep 07 13:18:16.735417 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:16.735287    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh"
Sep 07 13:18:16.735417 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:16.735328    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh" event={"ID":"36521406-43a6-4fd4-b7fb-9226d6a92b79","Type":"ContainerDied","Data":"ccba9a0f828764ac062a459d365a4cc6fa49cc87d2e518b5ed49ef14857c4bef"}
Sep 07 13:18:16.735417 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:16.735374    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh" event={"ID":"36521406-43a6-4fd4-b7fb-9226d6a92b79","Type":"ContainerDied","Data":"35b796c894b4ef367db59ec2509619c5bc693c1675b67af134224a8448d1e28b"}
Sep 07 13:18:16.735417 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:16.735390    2576 scope.go:117] "RemoveContainer" containerID="ccba9a0f828764ac062a459d365a4cc6fa49cc87d2e518b5ed49ef14857c4bef"
Sep 07 13:18:16.744679 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:16.744659    2576 scope.go:117] "RemoveContainer" containerID="ccba9a0f828764ac062a459d365a4cc6fa49cc87d2e518b5ed49ef14857c4bef"
Sep 07 13:18:16.745064 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:18:16.745043    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ccba9a0f828764ac062a459d365a4cc6fa49cc87d2e518b5ed49ef14857c4bef\": container with ID starting with ccba9a0f828764ac062a459d365a4cc6fa49cc87d2e518b5ed49ef14857c4bef not found: ID does not exist" containerID="ccba9a0f828764ac062a459d365a4cc6fa49cc87d2e518b5ed49ef14857c4bef"
Sep 07 13:18:16.745125 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:16.745074    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ccba9a0f828764ac062a459d365a4cc6fa49cc87d2e518b5ed49ef14857c4bef"} err="failed to get container status \"ccba9a0f828764ac062a459d365a4cc6fa49cc87d2e518b5ed49ef14857c4bef\": rpc error: code = NotFound desc = could not find container \"ccba9a0f828764ac062a459d365a4cc6fa49cc87d2e518b5ed49ef14857c4bef\": container with ID starting with ccba9a0f828764ac062a459d365a4cc6fa49cc87d2e518b5ed49ef14857c4bef not found: ID does not exist"
Sep 07 13:18:16.755700 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:16.755637    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh"]
Sep 07 13:18:16.762501 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:16.762481    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-824a79/test-model-824a79-kserve-759d54b667-j9pxh"]
Sep 07 13:18:16.809075 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:16.809036    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/36521406-43a6-4fd4-b7fb-9226d6a92b79-tls-certs\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:18:16.809075 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:16.809068    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/36521406-43a6-4fd4-b7fb-9226d6a92b79-dshm\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:18:16.809311 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:16.809091    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xplt\" (UniqueName: \"kubernetes.io/projected/36521406-43a6-4fd4-b7fb-9226d6a92b79-kube-api-access-9xplt\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:18:17.367041 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:17.367008    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36521406-43a6-4fd4-b7fb-9226d6a92b79" path="/var/lib/kubelet/pods/36521406-43a6-4fd4-b7fb-9226d6a92b79/volumes"
Sep 07 13:18:17.702761 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:17.702728    2576 patch_prober.go:28] interesting pod/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 07 13:18:17.702970 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:17.702810    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw" podUID="ed14e766-13eb-4361-83eb-159e9455e714" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 07 13:18:19.331451 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.331425    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:18:19.435071 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.435040    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed14e766-13eb-4361-83eb-159e9455e714-istio-envoy\") pod \"ed14e766-13eb-4361-83eb-159e9455e714\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") "
Sep 07 13:18:19.435255 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.435089    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8vrr\" (UniqueName: \"kubernetes.io/projected/ed14e766-13eb-4361-83eb-159e9455e714-kube-api-access-x8vrr\") pod \"ed14e766-13eb-4361-83eb-159e9455e714\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") "
Sep 07 13:18:19.435255 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.435150    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed14e766-13eb-4361-83eb-159e9455e714-istio-data\") pod \"ed14e766-13eb-4361-83eb-159e9455e714\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") "
Sep 07 13:18:19.435255 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.435168    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed14e766-13eb-4361-83eb-159e9455e714-istiod-ca-cert\") pod \"ed14e766-13eb-4361-83eb-159e9455e714\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") "
Sep 07 13:18:19.435255 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.435194    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed14e766-13eb-4361-83eb-159e9455e714-workload-certs\") pod \"ed14e766-13eb-4361-83eb-159e9455e714\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") "
Sep 07 13:18:19.435255 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.435224    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed14e766-13eb-4361-83eb-159e9455e714-istio-podinfo\") pod \"ed14e766-13eb-4361-83eb-159e9455e714\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") "
Sep 07 13:18:19.435255 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.435256    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed14e766-13eb-4361-83eb-159e9455e714-workload-socket\") pod \"ed14e766-13eb-4361-83eb-159e9455e714\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") "
Sep 07 13:18:19.435560 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.435293    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed14e766-13eb-4361-83eb-159e9455e714-credential-socket\") pod \"ed14e766-13eb-4361-83eb-159e9455e714\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") "
Sep 07 13:18:19.435560 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.435324    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed14e766-13eb-4361-83eb-159e9455e714-istio-token\") pod \"ed14e766-13eb-4361-83eb-159e9455e714\" (UID: \"ed14e766-13eb-4361-83eb-159e9455e714\") "
Sep 07 13:18:19.435560 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.435412    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed14e766-13eb-4361-83eb-159e9455e714-istio-data" (OuterVolumeSpecName: "istio-data") pod "ed14e766-13eb-4361-83eb-159e9455e714" (UID: "ed14e766-13eb-4361-83eb-159e9455e714"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:18:19.435703 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.435643    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ed14e766-13eb-4361-83eb-159e9455e714-istio-data\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:18:19.435703 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.435653    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed14e766-13eb-4361-83eb-159e9455e714-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ed14e766-13eb-4361-83eb-159e9455e714" (UID: "ed14e766-13eb-4361-83eb-159e9455e714"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:18:19.435703 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.435665    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed14e766-13eb-4361-83eb-159e9455e714-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ed14e766-13eb-4361-83eb-159e9455e714" (UID: "ed14e766-13eb-4361-83eb-159e9455e714"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:18:19.435703 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.435680    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed14e766-13eb-4361-83eb-159e9455e714-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ed14e766-13eb-4361-83eb-159e9455e714" (UID: "ed14e766-13eb-4361-83eb-159e9455e714"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:18:19.435931 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.435698    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed14e766-13eb-4361-83eb-159e9455e714-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ed14e766-13eb-4361-83eb-159e9455e714" (UID: "ed14e766-13eb-4361-83eb-159e9455e714"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:18:19.437424 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.437399    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed14e766-13eb-4361-83eb-159e9455e714-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ed14e766-13eb-4361-83eb-159e9455e714" (UID: "ed14e766-13eb-4361-83eb-159e9455e714"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:18:19.437540 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.437519    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed14e766-13eb-4361-83eb-159e9455e714-istio-token" (OuterVolumeSpecName: "istio-token") pod "ed14e766-13eb-4361-83eb-159e9455e714" (UID: "ed14e766-13eb-4361-83eb-159e9455e714"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:18:19.437748 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.437729    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ed14e766-13eb-4361-83eb-159e9455e714-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ed14e766-13eb-4361-83eb-159e9455e714" (UID: "ed14e766-13eb-4361-83eb-159e9455e714"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 13:18:19.437748 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.437729    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed14e766-13eb-4361-83eb-159e9455e714-kube-api-access-x8vrr" (OuterVolumeSpecName: "kube-api-access-x8vrr") pod "ed14e766-13eb-4361-83eb-159e9455e714" (UID: "ed14e766-13eb-4361-83eb-159e9455e714"). InnerVolumeSpecName "kube-api-access-x8vrr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:18:19.536998 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.536962    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ed14e766-13eb-4361-83eb-159e9455e714-workload-certs\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:18:19.536998 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.536995    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ed14e766-13eb-4361-83eb-159e9455e714-istio-podinfo\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:18:19.536998 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.537005    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed14e766-13eb-4361-83eb-159e9455e714-workload-socket\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:18:19.537239 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.537014    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ed14e766-13eb-4361-83eb-159e9455e714-credential-socket\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:18:19.537239 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.537023    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ed14e766-13eb-4361-83eb-159e9455e714-istio-token\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:18:19.537239 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.537031    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ed14e766-13eb-4361-83eb-159e9455e714-istio-envoy\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:18:19.537239 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.537040    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8vrr\" (UniqueName: \"kubernetes.io/projected/ed14e766-13eb-4361-83eb-159e9455e714-kube-api-access-x8vrr\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:18:19.537239 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.537048    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ed14e766-13eb-4361-83eb-159e9455e714-istiod-ca-cert\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:18:19.754402 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.754319    2576 generic.go:356] "Generic (PLEG): container finished" podID="ed14e766-13eb-4361-83eb-159e9455e714" containerID="2c31d9901742b25212aa509a7d71f9999b93e43c4cc65c6a502ca821fd248e9d" exitCode=0
Sep 07 13:18:19.754402 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.754364    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw" event={"ID":"ed14e766-13eb-4361-83eb-159e9455e714","Type":"ContainerDied","Data":"2c31d9901742b25212aa509a7d71f9999b93e43c4cc65c6a502ca821fd248e9d"}
Sep 07 13:18:19.754402 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.754368    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"
Sep 07 13:18:19.754631 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.754405    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw" event={"ID":"ed14e766-13eb-4361-83eb-159e9455e714","Type":"ContainerDied","Data":"9b86c0b01a41b3ba198d0b0a0546fb8d83ae35d3c7239b8785bead2b70369594"}
Sep 07 13:18:19.754631 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.754427    2576 scope.go:117] "RemoveContainer" containerID="2c31d9901742b25212aa509a7d71f9999b93e43c4cc65c6a502ca821fd248e9d"
Sep 07 13:18:19.766303 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.766258    2576 scope.go:117] "RemoveContainer" containerID="970f09164dd64e7a32381e1d44f967fc51b628c85b5d64612655274fca0833e1"
Sep 07 13:18:19.775307 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.775286    2576 scope.go:117] "RemoveContainer" containerID="2c31d9901742b25212aa509a7d71f9999b93e43c4cc65c6a502ca821fd248e9d"
Sep 07 13:18:19.775613 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:18:19.775594    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c31d9901742b25212aa509a7d71f9999b93e43c4cc65c6a502ca821fd248e9d\": container with ID starting with 2c31d9901742b25212aa509a7d71f9999b93e43c4cc65c6a502ca821fd248e9d not found: ID does not exist" containerID="2c31d9901742b25212aa509a7d71f9999b93e43c4cc65c6a502ca821fd248e9d"
Sep 07 13:18:19.775677 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.775625    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c31d9901742b25212aa509a7d71f9999b93e43c4cc65c6a502ca821fd248e9d"} err="failed to get container status \"2c31d9901742b25212aa509a7d71f9999b93e43c4cc65c6a502ca821fd248e9d\": rpc error: code = NotFound desc = could not find container \"2c31d9901742b25212aa509a7d71f9999b93e43c4cc65c6a502ca821fd248e9d\": container with ID starting with 2c31d9901742b25212aa509a7d71f9999b93e43c4cc65c6a502ca821fd248e9d not found: ID does not exist"
Sep 07 13:18:19.775677 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.775644    2576 scope.go:117] "RemoveContainer" containerID="970f09164dd64e7a32381e1d44f967fc51b628c85b5d64612655274fca0833e1"
Sep 07 13:18:19.775906 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:18:19.775888    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"970f09164dd64e7a32381e1d44f967fc51b628c85b5d64612655274fca0833e1\": container with ID starting with 970f09164dd64e7a32381e1d44f967fc51b628c85b5d64612655274fca0833e1 not found: ID does not exist" containerID="970f09164dd64e7a32381e1d44f967fc51b628c85b5d64612655274fca0833e1"
Sep 07 13:18:19.775957 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.775910    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"970f09164dd64e7a32381e1d44f967fc51b628c85b5d64612655274fca0833e1"} err="failed to get container status \"970f09164dd64e7a32381e1d44f967fc51b628c85b5d64612655274fca0833e1\": rpc error: code = NotFound desc = could not find container \"970f09164dd64e7a32381e1d44f967fc51b628c85b5d64612655274fca0833e1\": container with ID starting with 970f09164dd64e7a32381e1d44f967fc51b628c85b5d64612655274fca0833e1 not found: ID does not exist"
Sep 07 13:18:19.801655 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.801624    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"]
Sep 07 13:18:19.806634 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:19.806607    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-f5e4c4-openshift-default-5fc8dbfc9b-zwdnw"]
Sep 07 13:18:21.366891 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:21.366858    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed14e766-13eb-4361-83eb-159e9455e714" path="/var/lib/kubelet/pods/ed14e766-13eb-4361-83eb-159e9455e714/volumes"
Sep 07 13:18:21.781492 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:21.781458    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:21.968841 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:21.968810    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:22.165555 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.165517    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:22.493246 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.493169    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"]
Sep 07 13:18:22.493604 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.493544    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed14e766-13eb-4361-83eb-159e9455e714" containerName="istio-proxy"
Sep 07 13:18:22.493604 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.493555    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed14e766-13eb-4361-83eb-159e9455e714" containerName="istio-proxy"
Sep 07 13:18:22.493604 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.493568    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="381bd957-c168-4d2f-843e-733660154c0d" containerName="revoke-keys"
Sep 07 13:18:22.493604 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.493573    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="381bd957-c168-4d2f-843e-733660154c0d" containerName="revoke-keys"
Sep 07 13:18:22.493604 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.493584    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36521406-43a6-4fd4-b7fb-9226d6a92b79" containerName="main"
Sep 07 13:18:22.493604 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.493589    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="36521406-43a6-4fd4-b7fb-9226d6a92b79" containerName="main"
Sep 07 13:18:22.493828 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.493644    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed14e766-13eb-4361-83eb-159e9455e714" containerName="istio-proxy"
Sep 07 13:18:22.493828 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.493654    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="36521406-43a6-4fd4-b7fb-9226d6a92b79" containerName="main"
Sep 07 13:18:22.493828 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.493663    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="381bd957-c168-4d2f-843e-733660154c0d" containerName="revoke-keys"
Sep 07 13:18:22.498319 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.498298    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:18:22.531798 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.531760    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-3dd3e936-openshift-default-dockercfg-f7t48\""
Sep 07 13:18:22.534403 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.534381    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"]
Sep 07 13:18:22.563845 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.563808    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8901af6c-3203-48e4-8749-0a9b32e13596-istio-envoy\") pod \"e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") " pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:18:22.564037 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.563862    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs87j\" (UniqueName: \"kubernetes.io/projected/8901af6c-3203-48e4-8749-0a9b32e13596-kube-api-access-cs87j\") pod \"e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") " pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:18:22.564037 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.563926    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8901af6c-3203-48e4-8749-0a9b32e13596-istio-token\") pod \"e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") " pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:18:22.564037 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.563966    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8901af6c-3203-48e4-8749-0a9b32e13596-workload-certs\") pod \"e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") " pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:18:22.564037 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.563989    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8901af6c-3203-48e4-8749-0a9b32e13596-istiod-ca-cert\") pod \"e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") " pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:18:22.564037 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.564012    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8901af6c-3203-48e4-8749-0a9b32e13596-credential-socket\") pod \"e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") " pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:18:22.564242 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.564048    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8901af6c-3203-48e4-8749-0a9b32e13596-istio-podinfo\") pod \"e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") " pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:18:22.564242 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.564105    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8901af6c-3203-48e4-8749-0a9b32e13596-workload-socket\") pod \"e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") " pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:18:22.564242 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.564162    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8901af6c-3203-48e4-8749-0a9b32e13596-istio-data\") pod \"e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") " pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:18:22.585739 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.585711    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:22.664636 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.664604    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8901af6c-3203-48e4-8749-0a9b32e13596-istio-data\") pod \"e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") " pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:18:22.664828 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.664682    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8901af6c-3203-48e4-8749-0a9b32e13596-istio-envoy\") pod \"e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") " pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:18:22.664828 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.664719    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs87j\" (UniqueName: \"kubernetes.io/projected/8901af6c-3203-48e4-8749-0a9b32e13596-kube-api-access-cs87j\") pod \"e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") " pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:18:22.664828 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.664740    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8901af6c-3203-48e4-8749-0a9b32e13596-istio-token\") pod \"e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") " pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:18:22.664828 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.664760    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8901af6c-3203-48e4-8749-0a9b32e13596-workload-certs\") pod \"e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") " pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:18:22.665050 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.664898    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8901af6c-3203-48e4-8749-0a9b32e13596-istiod-ca-cert\") pod \"e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") " pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:18:22.665050 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.664939    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8901af6c-3203-48e4-8749-0a9b32e13596-credential-socket\") pod \"e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") " pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:18:22.665050 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.664968    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8901af6c-3203-48e4-8749-0a9b32e13596-istio-podinfo\") pod \"e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") " pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:18:22.665050 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.665014    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8901af6c-3203-48e4-8749-0a9b32e13596-workload-socket\") pod \"e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") " pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:18:22.665252 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.665059    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8901af6c-3203-48e4-8749-0a9b32e13596-istio-data\") pod \"e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") " pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:18:22.665252 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.665136    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8901af6c-3203-48e4-8749-0a9b32e13596-workload-certs\") pod \"e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") " pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:18:22.665368 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.665345    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8901af6c-3203-48e4-8749-0a9b32e13596-credential-socket\") pod \"e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") " pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:18:22.665429 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.665363    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8901af6c-3203-48e4-8749-0a9b32e13596-workload-socket\") pod \"e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") " pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:18:22.665608 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.665586    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8901af6c-3203-48e4-8749-0a9b32e13596-istiod-ca-cert\") pod \"e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") " pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:18:22.667138 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.667115    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8901af6c-3203-48e4-8749-0a9b32e13596-istio-envoy\") pod \"e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") " pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:18:22.667445 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.667427    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8901af6c-3203-48e4-8749-0a9b32e13596-istio-podinfo\") pod \"e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") " pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:18:22.684927 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.684904    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs87j\" (UniqueName: \"kubernetes.io/projected/8901af6c-3203-48e4-8749-0a9b32e13596-kube-api-access-cs87j\") pod \"e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") " pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:18:22.685017 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.684932    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8901af6c-3203-48e4-8749-0a9b32e13596-istio-token\") pod \"e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") " pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:18:22.807732 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:22.807649    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:18:23.081925 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:23.081838    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:23.114694 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:23.114668    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"]
Sep 07 13:18:23.117271 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:18:23.117242    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8901af6c_3203_48e4_8749_0a9b32e13596.slice/crio-518d589dad274649612b4c60e848a8d088e8590c84d8aac1e79afca2b7db0863 WatchSource:0}: Error finding container 518d589dad274649612b4c60e848a8d088e8590c84d8aac1e79afca2b7db0863: Status 404 returned error can't find the container with id 518d589dad274649612b4c60e848a8d088e8590c84d8aac1e79afca2b7db0863
Sep 07 13:18:23.119429 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:23.119393    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:18:23.119502 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:23.119463    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:18:23.119502 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:23.119490    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:18:23.319057 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:23.319020    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:23.571049 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:23.571011    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:23.782696 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:23.782662    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm" event={"ID":"8901af6c-3203-48e4-8749-0a9b32e13596","Type":"ContainerStarted","Data":"2270959dfae152da7979291762d816967a52cfd4c22b844eca11ebd4dd1c7707"}
Sep 07 13:18:23.782929 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:23.782715    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm" event={"ID":"8901af6c-3203-48e4-8749-0a9b32e13596","Type":"ContainerStarted","Data":"518d589dad274649612b4c60e848a8d088e8590c84d8aac1e79afca2b7db0863"}
Sep 07 13:18:23.808334 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:23.808304    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:18:23.810204 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:23.810176    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:23.825513 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:23.825434    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm" podStartSLOduration=1.825417425 podStartE2EDuration="1.825417425s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:18:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:18:23.823056656 +0000 UTC m=+1130.879938314" watchObservedRunningTime="2026-09-07 13:18:23.825417425 +0000 UTC m=+1130.882299083"
Sep 07 13:18:24.118427 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:24.118337    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-824a79-jvd56"]
Sep 07 13:18:24.118848 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:24.118831    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed14e766-13eb-4361-83eb-159e9455e714" containerName="istio-proxy"
Sep 07 13:18:24.118945 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:24.118850    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed14e766-13eb-4361-83eb-159e9455e714" containerName="istio-proxy"
Sep 07 13:18:24.119004 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:24.118965    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed14e766-13eb-4361-83eb-159e9455e714" containerName="istio-proxy"
Sep 07 13:18:24.122017 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:24.121996    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-824a79-jvd56"
Sep 07 13:18:24.125561 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:24.125540    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jlvcf\""
Sep 07 13:18:24.125862 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:24.125847    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 13:18:24.178582 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:24.178549    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ba160cb-439a-40a3-8218-9f08ee1443de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-824a79-jvd56\" (UID: \"5ba160cb-439a-40a3-8218-9f08ee1443de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-824a79-jvd56"
Sep 07 13:18:24.210039 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:24.210006    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-824a79-jvd56"]
Sep 07 13:18:24.279914 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:24.279881    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ba160cb-439a-40a3-8218-9f08ee1443de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-824a79-jvd56\" (UID: \"5ba160cb-439a-40a3-8218-9f08ee1443de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-824a79-jvd56"
Sep 07 13:18:24.280498 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:24.280479    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ba160cb-439a-40a3-8218-9f08ee1443de-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-824a79-jvd56\" (UID: \"5ba160cb-439a-40a3-8218-9f08ee1443de\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-824a79-jvd56"
Sep 07 13:18:24.432657 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:24.432614    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-824a79-jvd56"
Sep 07 13:18:24.465850 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:24.465809    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:24.728824 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:24.728720    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-824a79-jvd56"]
Sep 07 13:18:24.738494 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:18:24.738469    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ba160cb_439a_40a3_8218_9f08ee1443de.slice/crio-8c49f7dc02a1bbaa8be779c16a92957df5668f2ac0b17214c4b0b4f060265f8d WatchSource:0}: Error finding container 8c49f7dc02a1bbaa8be779c16a92957df5668f2ac0b17214c4b0b4f060265f8d: Status 404 returned error can't find the container with id 8c49f7dc02a1bbaa8be779c16a92957df5668f2ac0b17214c4b0b4f060265f8d
Sep 07 13:18:24.789058 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:24.789029    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-824a79-jvd56" event={"ID":"5ba160cb-439a-40a3-8218-9f08ee1443de","Type":"ContainerStarted","Data":"8c49f7dc02a1bbaa8be779c16a92957df5668f2ac0b17214c4b0b4f060265f8d"}
Sep 07 13:18:24.813126 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:24.813099    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:18:25.796140 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:25.796042    2576 generic.go:356] "Generic (PLEG): container finished" podID="5ba160cb-439a-40a3-8218-9f08ee1443de" containerID="16b68de59e563d8d6a3fd9c0829474c225aae1184f9daba67f2cff68eb83145b" exitCode=0
Sep 07 13:18:25.796602 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:25.796133    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-824a79-jvd56" event={"ID":"5ba160cb-439a-40a3-8218-9f08ee1443de","Type":"ContainerDied","Data":"16b68de59e563d8d6a3fd9c0829474c225aae1184f9daba67f2cff68eb83145b"}
Sep 07 13:18:25.796602 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:25.796431    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:18:25.797447 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:25.797426    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:18:26.289605 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:26.289573    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:26.519653 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:26.519618    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:26.932718 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:26.932695    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-824a79-jvd56"
Sep 07 13:18:27.005847 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:27.005818    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ba160cb-439a-40a3-8218-9f08ee1443de-maas-api-service-ca\") pod \"5ba160cb-439a-40a3-8218-9f08ee1443de\" (UID: \"5ba160cb-439a-40a3-8218-9f08ee1443de\") "
Sep 07 13:18:27.006184 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:27.006160    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ba160cb-439a-40a3-8218-9f08ee1443de-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5ba160cb-439a-40a3-8218-9f08ee1443de" (UID: "5ba160cb-439a-40a3-8218-9f08ee1443de"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:18:27.107253 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:27.107167    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ba160cb-439a-40a3-8218-9f08ee1443de-maas-api-service-ca\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:18:27.809502 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:27.809437    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-824a79-jvd56"
Sep 07 13:18:27.809502 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:27.809425    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-824a79-jvd56" event={"ID":"5ba160cb-439a-40a3-8218-9f08ee1443de","Type":"ContainerDied","Data":"8c49f7dc02a1bbaa8be779c16a92957df5668f2ac0b17214c4b0b4f060265f8d"}
Sep 07 13:18:27.809502 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:27.809490    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8c49f7dc02a1bbaa8be779c16a92957df5668f2ac0b17214c4b0b4f060265f8d"
Sep 07 13:18:27.971430 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:27.971398    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:28.163995 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:28.163959    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:28.414234 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:28.414148    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:29.429013 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:29.428982    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:29.681234 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:29.681143    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:33.218987 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:33.218959    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:18:34.524476 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:34.524442    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:35.668936 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:35.668891    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:35.868133 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:35.868094    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:36.138688 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:36.138644    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:36.333459 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:36.333415    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-824a79-jvd56"]
Sep 07 13:18:36.351322 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:36.351286    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-824a79-jvd56"]
Sep 07 13:18:36.353240 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:36.353209    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:36.489646 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:36.489554    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:36.856235 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:36.856144    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:37.366546 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:37.366513    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ba160cb-439a-40a3-8218-9f08ee1443de" path="/var/lib/kubelet/pods/5ba160cb-439a-40a3-8218-9f08ee1443de/volumes"
Sep 07 13:18:43.242127 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:43.242097    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:18:44.025032 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:44.025001    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:44.287856 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:44.287677    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:44.355457 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:44.355426    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"]
Sep 07 13:18:44.355687 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:44.355664    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7" podUID="5a226d06-4b26-4b1b-bc02-2acbb56ab37a" containerName="istio-proxy" containerID="cri-o://2240f02a8387535f26cced055ad1442639a07189184ef8f7e6b45279311605d2" gracePeriod=30
Sep 07 13:18:44.444049 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:44.444016    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:45.088085 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:45.088050    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:45.461807 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:45.461750    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:45.618626 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:45.618589    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:49.241822 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.241782    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:49.340665 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.340629    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:49.653662 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.653637    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:18:49.809314 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.809229    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gbpb\" (UniqueName: \"kubernetes.io/projected/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-kube-api-access-2gbpb\") pod \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") "
Sep 07 13:18:49.809314 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.809281    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-istiod-ca-cert\") pod \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") "
Sep 07 13:18:49.809490 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.809328    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-istio-podinfo\") pod \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") "
Sep 07 13:18:49.809490 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.809381    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-istio-data\") pod \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") "
Sep 07 13:18:49.809579 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.809507    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-credential-socket\") pod \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") "
Sep 07 13:18:49.809579 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.809568    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-workload-socket\") pod \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") "
Sep 07 13:18:49.809673 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.809612    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-workload-certs\") pod \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") "
Sep 07 13:18:49.809673 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.809611    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-istio-data" (OuterVolumeSpecName: "istio-data") pod "5a226d06-4b26-4b1b-bc02-2acbb56ab37a" (UID: "5a226d06-4b26-4b1b-bc02-2acbb56ab37a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:18:49.809673 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.809638    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-istio-envoy\") pod \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") "
Sep 07 13:18:49.809873 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.809714    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5a226d06-4b26-4b1b-bc02-2acbb56ab37a" (UID: "5a226d06-4b26-4b1b-bc02-2acbb56ab37a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:18:49.809873 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.809726    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-istio-token\") pod \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\" (UID: \"5a226d06-4b26-4b1b-bc02-2acbb56ab37a\") "
Sep 07 13:18:49.809873 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.809709    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5a226d06-4b26-4b1b-bc02-2acbb56ab37a" (UID: "5a226d06-4b26-4b1b-bc02-2acbb56ab37a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:18:49.809873 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.809755    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5a226d06-4b26-4b1b-bc02-2acbb56ab37a" (UID: "5a226d06-4b26-4b1b-bc02-2acbb56ab37a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:18:49.809873 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.809846    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5a226d06-4b26-4b1b-bc02-2acbb56ab37a" (UID: "5a226d06-4b26-4b1b-bc02-2acbb56ab37a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:18:49.810111 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.810086    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-istiod-ca-cert\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:18:49.810111 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.810106    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-istio-data\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:18:49.810213 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.810119    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-credential-socket\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:18:49.810213 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.810134    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-workload-socket\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:18:49.810213 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.810147    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-workload-certs\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:18:49.811670 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.811645    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-kube-api-access-2gbpb" (OuterVolumeSpecName: "kube-api-access-2gbpb") pod "5a226d06-4b26-4b1b-bc02-2acbb56ab37a" (UID: "5a226d06-4b26-4b1b-bc02-2acbb56ab37a"). InnerVolumeSpecName "kube-api-access-2gbpb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:18:49.811827 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.811806    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-istio-token" (OuterVolumeSpecName: "istio-token") pod "5a226d06-4b26-4b1b-bc02-2acbb56ab37a" (UID: "5a226d06-4b26-4b1b-bc02-2acbb56ab37a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:18:49.812256 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.812236    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5a226d06-4b26-4b1b-bc02-2acbb56ab37a" (UID: "5a226d06-4b26-4b1b-bc02-2acbb56ab37a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 13:18:49.812310 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.812245    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5a226d06-4b26-4b1b-bc02-2acbb56ab37a" (UID: "5a226d06-4b26-4b1b-bc02-2acbb56ab37a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:18:49.911053 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.911030    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-istio-envoy\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:18:49.911053 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.911052    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-istio-token\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:18:49.911194 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.911061    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gbpb\" (UniqueName: \"kubernetes.io/projected/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-kube-api-access-2gbpb\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:18:49.911194 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.911071    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a226d06-4b26-4b1b-bc02-2acbb56ab37a-istio-podinfo\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:18:49.934220 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.934192    2576 generic.go:356] "Generic (PLEG): container finished" podID="5a226d06-4b26-4b1b-bc02-2acbb56ab37a" containerID="2240f02a8387535f26cced055ad1442639a07189184ef8f7e6b45279311605d2" exitCode=0
Sep 07 13:18:49.934325 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.934244    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"
Sep 07 13:18:49.934325 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.934254    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7" event={"ID":"5a226d06-4b26-4b1b-bc02-2acbb56ab37a","Type":"ContainerDied","Data":"2240f02a8387535f26cced055ad1442639a07189184ef8f7e6b45279311605d2"}
Sep 07 13:18:49.934325 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.934298    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7" event={"ID":"5a226d06-4b26-4b1b-bc02-2acbb56ab37a","Type":"ContainerDied","Data":"ee677406e4d8871247676c194c4d4e6e0b9121c369c26948f1bb8c0e6532902a"}
Sep 07 13:18:49.934325 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.934320    2576 scope.go:117] "RemoveContainer" containerID="2240f02a8387535f26cced055ad1442639a07189184ef8f7e6b45279311605d2"
Sep 07 13:18:49.945973 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.945957    2576 scope.go:117] "RemoveContainer" containerID="a6b2c9c725e27b0c6ad6b92ac32e24c1985423114424555903937d8942176808"
Sep 07 13:18:49.954155 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.954139    2576 scope.go:117] "RemoveContainer" containerID="2240f02a8387535f26cced055ad1442639a07189184ef8f7e6b45279311605d2"
Sep 07 13:18:49.954416 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:18:49.954397    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2240f02a8387535f26cced055ad1442639a07189184ef8f7e6b45279311605d2\": container with ID starting with 2240f02a8387535f26cced055ad1442639a07189184ef8f7e6b45279311605d2 not found: ID does not exist" containerID="2240f02a8387535f26cced055ad1442639a07189184ef8f7e6b45279311605d2"
Sep 07 13:18:49.954489 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.954428    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2240f02a8387535f26cced055ad1442639a07189184ef8f7e6b45279311605d2"} err="failed to get container status \"2240f02a8387535f26cced055ad1442639a07189184ef8f7e6b45279311605d2\": rpc error: code = NotFound desc = could not find container \"2240f02a8387535f26cced055ad1442639a07189184ef8f7e6b45279311605d2\": container with ID starting with 2240f02a8387535f26cced055ad1442639a07189184ef8f7e6b45279311605d2 not found: ID does not exist"
Sep 07 13:18:49.954489 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.954452    2576 scope.go:117] "RemoveContainer" containerID="a6b2c9c725e27b0c6ad6b92ac32e24c1985423114424555903937d8942176808"
Sep 07 13:18:49.954709 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:18:49.954692    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6b2c9c725e27b0c6ad6b92ac32e24c1985423114424555903937d8942176808\": container with ID starting with a6b2c9c725e27b0c6ad6b92ac32e24c1985423114424555903937d8942176808 not found: ID does not exist" containerID="a6b2c9c725e27b0c6ad6b92ac32e24c1985423114424555903937d8942176808"
Sep 07 13:18:49.954747 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.954715    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6b2c9c725e27b0c6ad6b92ac32e24c1985423114424555903937d8942176808"} err="failed to get container status \"a6b2c9c725e27b0c6ad6b92ac32e24c1985423114424555903937d8942176808\": rpc error: code = NotFound desc = could not find container \"a6b2c9c725e27b0c6ad6b92ac32e24c1985423114424555903937d8942176808\": container with ID starting with a6b2c9c725e27b0c6ad6b92ac32e24c1985423114424555903937d8942176808 not found: ID does not exist"
Sep 07 13:18:49.964495 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.964475    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"]
Sep 07 13:18:49.968820 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:49.968797    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-824a79-openshift-default-57fd4849f4-xz7p7"]
Sep 07 13:18:50.418738 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:50.418705    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:50.514168 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:50.514127    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:50.954786 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:50.954741    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:51.278371 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:51.278286    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:51.380790 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:51.366341    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a226d06-4b26-4b1b-bc02-2acbb56ab37a" path="/var/lib/kubelet/pods/5a226d06-4b26-4b1b-bc02-2acbb56ab37a/volumes"
Sep 07 13:18:51.391463 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:51.391429    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:52.745695 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:52.745664    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:53.900302 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:53.900263    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:54.638478 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:54.638442    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:18:55.057896 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:55.057806    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:56.259449 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:56.259411    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:56.837928 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:56.837887    2576 patch_prober.go:28] interesting pod/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 07 13:18:56.838101 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:56.837955    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm" podUID="8901af6c-3203-48e4-8749-0a9b32e13596" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 07 13:18:56.993342 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:56.993303    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:57.174995 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:57.174959    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:57.509233 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:57.509171    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:18:57.987379 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:57.987345    2576 generic.go:356] "Generic (PLEG): container finished" podID="8901af6c-3203-48e4-8749-0a9b32e13596" containerID="2270959dfae152da7979291762d816967a52cfd4c22b844eca11ebd4dd1c7707" exitCode=0
Sep 07 13:18:57.987514 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:57.987427    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm" event={"ID":"8901af6c-3203-48e4-8749-0a9b32e13596","Type":"ContainerDied","Data":"2270959dfae152da7979291762d816967a52cfd4c22b844eca11ebd4dd1c7707"}
Sep 07 13:18:57.988169 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:57.988146    2576 scope.go:117] "RemoveContainer" containerID="2270959dfae152da7979291762d816967a52cfd4c22b844eca11ebd4dd1c7707"
Sep 07 13:18:57.989201 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:57.989172    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:18:57.989297 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:57.989254    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:18:57.989297 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:57.989289    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:18:58.996711 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:58.996668    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm" event={"ID":"8901af6c-3203-48e4-8749-0a9b32e13596","Type":"ContainerStarted","Data":"88003add7c1e2d24d339f20c371e1151c1cb6b08f32c02edf4208817e42db828"}
Sep 07 13:18:59.808025 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:59.807988    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:18:59.808195 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:59.808163    2576 patch_prober.go:28] interesting pod/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 07 13:18:59.808238 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:18:59.808209    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm" podUID="8901af6c-3203-48e4-8749-0a9b32e13596" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 07 13:19:00.808525 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:00.808489    2576 patch_prober.go:28] interesting pod/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 07 13:19:00.809019 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:00.808549    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm" podUID="8901af6c-3203-48e4-8749-0a9b32e13596" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 07 13:19:01.808623 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:01.808589    2576 patch_prober.go:28] interesting pod/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 07 13:19:01.809040 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:01.808649    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm" podUID="8901af6c-3203-48e4-8749-0a9b32e13596" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 07 13:19:02.808856 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:02.808824    2576 patch_prober.go:28] interesting pod/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused" start-of-body=
Sep 07 13:19:02.809220 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:02.808872    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm" podUID="8901af6c-3203-48e4-8749-0a9b32e13596" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.60:15021/healthz/ready\": dial tcp 10.133.0.60:15021: connect: connection refused"
Sep 07 13:19:03.313093 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:03.313056    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:03.967229 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:03.967198    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:19:03.967704 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:03.967639    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:19:03.968899 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:03.968873    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:19:04.632813 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:04.632752    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:04.734988 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:04.734961    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:05.046505 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:05.046443    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3dd3e936-jshb2"]
Sep 07 13:19:05.046849 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:05.046837    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a226d06-4b26-4b1b-bc02-2acbb56ab37a" containerName="istio-proxy"
Sep 07 13:19:05.046849 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:05.046851    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a226d06-4b26-4b1b-bc02-2acbb56ab37a" containerName="istio-proxy"
Sep 07 13:19:05.046928 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:05.046865    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ba160cb-439a-40a3-8218-9f08ee1443de" containerName="revoke-keys"
Sep 07 13:19:05.046928 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:05.046870    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ba160cb-439a-40a3-8218-9f08ee1443de" containerName="revoke-keys"
Sep 07 13:19:05.046928 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:05.046876    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a226d06-4b26-4b1b-bc02-2acbb56ab37a" containerName="istio-proxy"
Sep 07 13:19:05.046928 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:05.046881    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a226d06-4b26-4b1b-bc02-2acbb56ab37a" containerName="istio-proxy"
Sep 07 13:19:05.047048 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:05.046932    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ba160cb-439a-40a3-8218-9f08ee1443de" containerName="revoke-keys"
Sep 07 13:19:05.047048 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:05.046941    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a226d06-4b26-4b1b-bc02-2acbb56ab37a" containerName="istio-proxy"
Sep 07 13:19:05.047048 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:05.046947    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a226d06-4b26-4b1b-bc02-2acbb56ab37a" containerName="istio-proxy"
Sep 07 13:19:05.049969 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:05.049954    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3dd3e936-jshb2"
Sep 07 13:19:05.053171 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:05.053152    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 13:19:05.053324 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:05.053304    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jlvcf\""
Sep 07 13:19:05.060992 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:05.060973    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3dd3e936-jshb2"]
Sep 07 13:19:05.144125 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:05.144098    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/306eb903-3d46-481e-af64-179b0adc5dc8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3dd3e936-jshb2\" (UID: \"306eb903-3d46-481e-af64-179b0adc5dc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3dd3e936-jshb2"
Sep 07 13:19:05.245245 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:05.245217    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/306eb903-3d46-481e-af64-179b0adc5dc8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3dd3e936-jshb2\" (UID: \"306eb903-3d46-481e-af64-179b0adc5dc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3dd3e936-jshb2"
Sep 07 13:19:05.245781 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:05.245754    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/306eb903-3d46-481e-af64-179b0adc5dc8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-3dd3e936-jshb2\" (UID: \"306eb903-3d46-481e-af64-179b0adc5dc8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3dd3e936-jshb2"
Sep 07 13:19:05.360462 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:05.360405    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3dd3e936-jshb2"
Sep 07 13:19:05.665243 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:05.665111    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3dd3e936-jshb2"]
Sep 07 13:19:05.667730 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:19:05.667697    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod306eb903_3d46_481e_af64_179b0adc5dc8.slice/crio-3977a369842a28550943c9e8ae01c999a9d1e4b8dcc0548d515de17528a302f4 WatchSource:0}: Error finding container 3977a369842a28550943c9e8ae01c999a9d1e4b8dcc0548d515de17528a302f4: Status 404 returned error can't find the container with id 3977a369842a28550943c9e8ae01c999a9d1e4b8dcc0548d515de17528a302f4
Sep 07 13:19:06.037404 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:06.037343    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3dd3e936-jshb2" event={"ID":"306eb903-3d46-481e-af64-179b0adc5dc8","Type":"ContainerStarted","Data":"0ae09bf55c23d536286bb690b1cd807df2ddffba2a5e3bcc9ce040db1ce6f014"}
Sep 07 13:19:06.037404 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:06.037394    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3dd3e936-jshb2" event={"ID":"306eb903-3d46-481e-af64-179b0adc5dc8","Type":"ContainerStarted","Data":"3977a369842a28550943c9e8ae01c999a9d1e4b8dcc0548d515de17528a302f4"}
Sep 07 13:19:07.043985 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:07.043953    2576 generic.go:356] "Generic (PLEG): container finished" podID="306eb903-3d46-481e-af64-179b0adc5dc8" containerID="0ae09bf55c23d536286bb690b1cd807df2ddffba2a5e3bcc9ce040db1ce6f014" exitCode=0
Sep 07 13:19:07.044367 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:07.044032    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3dd3e936-jshb2" event={"ID":"306eb903-3d46-481e-af64-179b0adc5dc8","Type":"ContainerDied","Data":"0ae09bf55c23d536286bb690b1cd807df2ddffba2a5e3bcc9ce040db1ce6f014"}
Sep 07 13:19:08.182241 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:08.182218    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3dd3e936-jshb2"
Sep 07 13:19:08.269334 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:08.269313    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/306eb903-3d46-481e-af64-179b0adc5dc8-maas-api-service-ca\") pod \"306eb903-3d46-481e-af64-179b0adc5dc8\" (UID: \"306eb903-3d46-481e-af64-179b0adc5dc8\") "
Sep 07 13:19:08.269612 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:08.269590    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/306eb903-3d46-481e-af64-179b0adc5dc8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "306eb903-3d46-481e-af64-179b0adc5dc8" (UID: "306eb903-3d46-481e-af64-179b0adc5dc8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:19:08.370340 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:08.370272    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/306eb903-3d46-481e-af64-179b0adc5dc8-maas-api-service-ca\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:19:09.056314 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:09.056285    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3dd3e936-jshb2"
Sep 07 13:19:09.056499 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:09.056285    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3dd3e936-jshb2" event={"ID":"306eb903-3d46-481e-af64-179b0adc5dc8","Type":"ContainerDied","Data":"3977a369842a28550943c9e8ae01c999a9d1e4b8dcc0548d515de17528a302f4"}
Sep 07 13:19:09.056499 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:09.056408    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3977a369842a28550943c9e8ae01c999a9d1e4b8dcc0548d515de17528a302f4"
Sep 07 13:19:15.021785 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:15.021737    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:15.984304 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:15.984268    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:16.148173 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:16.148143    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:16.246544 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:16.246452    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:16.354759 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:16.354721    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:16.400578 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:16.400542    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3dd3e936-jshb2"]
Sep 07 13:19:16.405098 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:16.405074    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-3dd3e936-jshb2"]
Sep 07 13:19:16.735174 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:16.735138    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:17.367138 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:17.367103    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="306eb903-3d46-481e-af64-179b0adc5dc8" path="/var/lib/kubelet/pods/306eb903-3d46-481e-af64-179b0adc5dc8/volumes"
Sep 07 13:19:17.602875 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:17.602838    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:18.751729 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:18.751700    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:19:19.276964 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:19.276928    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:19.608326 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:19.608249    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:19.900162 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:19.900133    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"]
Sep 07 13:19:19.900525 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:19.900505    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="306eb903-3d46-481e-af64-179b0adc5dc8" containerName="revoke-keys"
Sep 07 13:19:19.900525 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:19.900516    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="306eb903-3d46-481e-af64-179b0adc5dc8" containerName="revoke-keys"
Sep 07 13:19:19.900612 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:19.900580    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="306eb903-3d46-481e-af64-179b0adc5dc8" containerName="revoke-keys"
Sep 07 13:19:19.903904 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:19.903884    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:19.906795 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:19.906780    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-c7c371-openshift-default-dockercfg-jkx5c\""
Sep 07 13:19:19.922071 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:19.922052    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"]
Sep 07 13:19:19.950554 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:19.950528    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:19.970243 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:19.970224    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmhn7\" (UniqueName: \"kubernetes.io/projected/27a9b368-f0fb-44b5-ab0c-cb72509654c3-kube-api-access-lmhn7\") pod \"e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") " pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:19.970352 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:19.970261    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27a9b368-f0fb-44b5-ab0c-cb72509654c3-istio-token\") pod \"e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") " pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:19.970352 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:19.970281    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27a9b368-f0fb-44b5-ab0c-cb72509654c3-istio-envoy\") pod \"e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") " pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:19.970352 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:19.970335    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27a9b368-f0fb-44b5-ab0c-cb72509654c3-workload-socket\") pod \"e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") " pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:19.970483 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:19.970370    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27a9b368-f0fb-44b5-ab0c-cb72509654c3-credential-socket\") pod \"e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") " pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:19.970483 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:19.970451    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27a9b368-f0fb-44b5-ab0c-cb72509654c3-istio-podinfo\") pod \"e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") " pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:19.970556 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:19.970496    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27a9b368-f0fb-44b5-ab0c-cb72509654c3-workload-certs\") pod \"e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") " pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:19.970556 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:19.970524    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27a9b368-f0fb-44b5-ab0c-cb72509654c3-istio-data\") pod \"e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") " pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:19.970623 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:19.970579    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27a9b368-f0fb-44b5-ab0c-cb72509654c3-istiod-ca-cert\") pod \"e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") " pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:20.071927 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:20.071890    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27a9b368-f0fb-44b5-ab0c-cb72509654c3-istio-podinfo\") pod \"e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") " pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:20.072059 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:20.071963    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27a9b368-f0fb-44b5-ab0c-cb72509654c3-workload-certs\") pod \"e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") " pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:20.072059 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:20.071999    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27a9b368-f0fb-44b5-ab0c-cb72509654c3-istio-data\") pod \"e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") " pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:20.072167 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:20.072057    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27a9b368-f0fb-44b5-ab0c-cb72509654c3-istiod-ca-cert\") pod \"e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") " pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:20.072167 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:20.072106    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmhn7\" (UniqueName: \"kubernetes.io/projected/27a9b368-f0fb-44b5-ab0c-cb72509654c3-kube-api-access-lmhn7\") pod \"e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") " pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:20.072167 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:20.072160    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27a9b368-f0fb-44b5-ab0c-cb72509654c3-istio-token\") pod \"e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") " pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:20.072310 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:20.072189    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27a9b368-f0fb-44b5-ab0c-cb72509654c3-istio-envoy\") pod \"e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") " pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:20.072310 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:20.072238    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27a9b368-f0fb-44b5-ab0c-cb72509654c3-workload-socket\") pod \"e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") " pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:20.072310 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:20.072267    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27a9b368-f0fb-44b5-ab0c-cb72509654c3-credential-socket\") pod \"e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") " pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:20.072709 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:20.072687    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27a9b368-f0fb-44b5-ab0c-cb72509654c3-credential-socket\") pod \"e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") " pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:20.073002 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:20.072980    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27a9b368-f0fb-44b5-ab0c-cb72509654c3-workload-certs\") pod \"e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") " pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:20.073243 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:20.073225    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27a9b368-f0fb-44b5-ab0c-cb72509654c3-istio-data\") pod \"e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") " pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:20.073833 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:20.073812    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27a9b368-f0fb-44b5-ab0c-cb72509654c3-istiod-ca-cert\") pod \"e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") " pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:20.079375 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:20.077322    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27a9b368-f0fb-44b5-ab0c-cb72509654c3-istio-envoy\") pod \"e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") " pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:20.079375 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:20.077328    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27a9b368-f0fb-44b5-ab0c-cb72509654c3-istio-podinfo\") pod \"e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") " pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:20.079375 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:20.077563    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27a9b368-f0fb-44b5-ab0c-cb72509654c3-workload-socket\") pod \"e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") " pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:20.085274 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:20.085252    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27a9b368-f0fb-44b5-ab0c-cb72509654c3-istio-token\") pod \"e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") " pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:20.090243 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:20.090212    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmhn7\" (UniqueName: \"kubernetes.io/projected/27a9b368-f0fb-44b5-ab0c-cb72509654c3-kube-api-access-lmhn7\") pod \"e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") " pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:20.213789 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:20.213681    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:20.263392 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:20.263354    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:20.489828 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:20.489721    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:20.501375 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:20.501352    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"]
Sep 07 13:19:20.503743 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:19:20.503707    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27a9b368_f0fb_44b5_ab0c_cb72509654c3.slice/crio-69b990820049b5aae6c53aff98df6125033c4d07786f30aabd3913e866a45b19 WatchSource:0}: Error finding container 69b990820049b5aae6c53aff98df6125033c4d07786f30aabd3913e866a45b19: Status 404 returned error can't find the container with id 69b990820049b5aae6c53aff98df6125033c4d07786f30aabd3913e866a45b19
Sep 07 13:19:20.506287 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:20.506243    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:19:20.506389 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:20.506338    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:19:20.506389 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:20.506378    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:19:20.585417 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:20.585366    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:21.120568 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:21.120532    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4" event={"ID":"27a9b368-f0fb-44b5-ab0c-cb72509654c3","Type":"ContainerStarted","Data":"c526d140e2d11faed0813495033495105a5a96a146e5e75d376918419b7bd7cf"}
Sep 07 13:19:21.120973 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:21.120586    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4" event={"ID":"27a9b368-f0fb-44b5-ab0c-cb72509654c3","Type":"ContainerStarted","Data":"69b990820049b5aae6c53aff98df6125033c4d07786f30aabd3913e866a45b19"}
Sep 07 13:19:21.150018 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:21.149965    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4" podStartSLOduration=2.149949759 podStartE2EDuration="2.149949759s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:19:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:19:21.148601965 +0000 UTC m=+1188.205483624" watchObservedRunningTime="2026-09-07 13:19:21.149949759 +0000 UTC m=+1188.206831416"
Sep 07 13:19:21.213995 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:21.213954    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:21.218992 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:21.218968    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:22.125947 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:22.125916    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:22.126729 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:22.126710    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:23.344071 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:23.344031    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:23.524341 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:23.524303    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:24.418514 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:24.418476    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:24.569090 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:24.569055    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:24.692583 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:24.692494    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:24.732557 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:24.732527    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"]
Sep 07 13:19:24.732814 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:24.732792    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm" podUID="8901af6c-3203-48e4-8749-0a9b32e13596" containerName="istio-proxy" containerID="cri-o://88003add7c1e2d24d339f20c371e1151c1cb6b08f32c02edf4208817e42db828" gracePeriod=30
Sep 07 13:19:24.830324 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:24.830284    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:24.979634 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:24.979557    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:25.190776 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:25.190746    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:25.349553 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:25.349445    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:25.521908 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:25.521877    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:25.938165 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:25.938122    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:26.079884 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:26.079850    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:29.811893 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:29.811868    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:19:29.984281 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:29.984261    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:19:30.060846 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.060797    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8901af6c-3203-48e4-8749-0a9b32e13596-workload-certs\") pod \"8901af6c-3203-48e4-8749-0a9b32e13596\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") "
Sep 07 13:19:30.060846 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.060829    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8901af6c-3203-48e4-8749-0a9b32e13596-istio-podinfo\") pod \"8901af6c-3203-48e4-8749-0a9b32e13596\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") "
Sep 07 13:19:30.061033 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.060857    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8901af6c-3203-48e4-8749-0a9b32e13596-credential-socket\") pod \"8901af6c-3203-48e4-8749-0a9b32e13596\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") "
Sep 07 13:19:30.061033 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.060991    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cs87j\" (UniqueName: \"kubernetes.io/projected/8901af6c-3203-48e4-8749-0a9b32e13596-kube-api-access-cs87j\") pod \"8901af6c-3203-48e4-8749-0a9b32e13596\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") "
Sep 07 13:19:30.061147 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.061044    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8901af6c-3203-48e4-8749-0a9b32e13596-istio-token\") pod \"8901af6c-3203-48e4-8749-0a9b32e13596\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") "
Sep 07 13:19:30.061147 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.061059    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8901af6c-3203-48e4-8749-0a9b32e13596-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8901af6c-3203-48e4-8749-0a9b32e13596" (UID: "8901af6c-3203-48e4-8749-0a9b32e13596"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:19:30.061147 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.061073    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8901af6c-3203-48e4-8749-0a9b32e13596-istio-data\") pod \"8901af6c-3203-48e4-8749-0a9b32e13596\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") "
Sep 07 13:19:30.061147 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.061078    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8901af6c-3203-48e4-8749-0a9b32e13596-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8901af6c-3203-48e4-8749-0a9b32e13596" (UID: "8901af6c-3203-48e4-8749-0a9b32e13596"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:19:30.061147 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.061129    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8901af6c-3203-48e4-8749-0a9b32e13596-workload-socket\") pod \"8901af6c-3203-48e4-8749-0a9b32e13596\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") "
Sep 07 13:19:30.061416 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.061170    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8901af6c-3203-48e4-8749-0a9b32e13596-istiod-ca-cert\") pod \"8901af6c-3203-48e4-8749-0a9b32e13596\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") "
Sep 07 13:19:30.061416 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.061200    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8901af6c-3203-48e4-8749-0a9b32e13596-istio-envoy\") pod \"8901af6c-3203-48e4-8749-0a9b32e13596\" (UID: \"8901af6c-3203-48e4-8749-0a9b32e13596\") "
Sep 07 13:19:30.061416 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.061247    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8901af6c-3203-48e4-8749-0a9b32e13596-istio-data" (OuterVolumeSpecName: "istio-data") pod "8901af6c-3203-48e4-8749-0a9b32e13596" (UID: "8901af6c-3203-48e4-8749-0a9b32e13596"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:19:30.061416 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.061328    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8901af6c-3203-48e4-8749-0a9b32e13596-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8901af6c-3203-48e4-8749-0a9b32e13596" (UID: "8901af6c-3203-48e4-8749-0a9b32e13596"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:19:30.061873 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.061506    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8901af6c-3203-48e4-8749-0a9b32e13596-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8901af6c-3203-48e4-8749-0a9b32e13596" (UID: "8901af6c-3203-48e4-8749-0a9b32e13596"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:19:30.061873 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.061510    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8901af6c-3203-48e4-8749-0a9b32e13596-workload-certs\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:19:30.061873 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.061543    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8901af6c-3203-48e4-8749-0a9b32e13596-credential-socket\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:19:30.061873 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.061555    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8901af6c-3203-48e4-8749-0a9b32e13596-istio-data\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:19:30.061873 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.061564    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8901af6c-3203-48e4-8749-0a9b32e13596-workload-socket\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:19:30.063171 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.063138    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8901af6c-3203-48e4-8749-0a9b32e13596-kube-api-access-cs87j" (OuterVolumeSpecName: "kube-api-access-cs87j") pod "8901af6c-3203-48e4-8749-0a9b32e13596" (UID: "8901af6c-3203-48e4-8749-0a9b32e13596"). InnerVolumeSpecName "kube-api-access-cs87j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:19:30.063171 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.063160    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8901af6c-3203-48e4-8749-0a9b32e13596-istio-token" (OuterVolumeSpecName: "istio-token") pod "8901af6c-3203-48e4-8749-0a9b32e13596" (UID: "8901af6c-3203-48e4-8749-0a9b32e13596"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:19:30.063171 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.063161    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8901af6c-3203-48e4-8749-0a9b32e13596-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8901af6c-3203-48e4-8749-0a9b32e13596" (UID: "8901af6c-3203-48e4-8749-0a9b32e13596"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 13:19:30.063455 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.063442    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8901af6c-3203-48e4-8749-0a9b32e13596-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8901af6c-3203-48e4-8749-0a9b32e13596" (UID: "8901af6c-3203-48e4-8749-0a9b32e13596"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:19:30.162572 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.162544    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8901af6c-3203-48e4-8749-0a9b32e13596-istio-podinfo\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:19:30.162572 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.162572    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cs87j\" (UniqueName: \"kubernetes.io/projected/8901af6c-3203-48e4-8749-0a9b32e13596-kube-api-access-cs87j\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:19:30.162698 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.162588    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8901af6c-3203-48e4-8749-0a9b32e13596-istio-token\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:19:30.162698 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.162600    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8901af6c-3203-48e4-8749-0a9b32e13596-istiod-ca-cert\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:19:30.162698 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.162612    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8901af6c-3203-48e4-8749-0a9b32e13596-istio-envoy\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:19:30.168656 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.168631    2576 generic.go:356] "Generic (PLEG): container finished" podID="8901af6c-3203-48e4-8749-0a9b32e13596" containerID="88003add7c1e2d24d339f20c371e1151c1cb6b08f32c02edf4208817e42db828" exitCode=0
Sep 07 13:19:30.168799 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.168674    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"
Sep 07 13:19:30.168799 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.168715    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm" event={"ID":"8901af6c-3203-48e4-8749-0a9b32e13596","Type":"ContainerDied","Data":"88003add7c1e2d24d339f20c371e1151c1cb6b08f32c02edf4208817e42db828"}
Sep 07 13:19:30.168890 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.168829    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm" event={"ID":"8901af6c-3203-48e4-8749-0a9b32e13596","Type":"ContainerDied","Data":"518d589dad274649612b4c60e848a8d088e8590c84d8aac1e79afca2b7db0863"}
Sep 07 13:19:30.168890 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.168863    2576 scope.go:117] "RemoveContainer" containerID="88003add7c1e2d24d339f20c371e1151c1cb6b08f32c02edf4208817e42db828"
Sep 07 13:19:30.178368 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.178355    2576 scope.go:117] "RemoveContainer" containerID="2270959dfae152da7979291762d816967a52cfd4c22b844eca11ebd4dd1c7707"
Sep 07 13:19:30.186067 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.186051    2576 scope.go:117] "RemoveContainer" containerID="88003add7c1e2d24d339f20c371e1151c1cb6b08f32c02edf4208817e42db828"
Sep 07 13:19:30.186297 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:19:30.186281    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88003add7c1e2d24d339f20c371e1151c1cb6b08f32c02edf4208817e42db828\": container with ID starting with 88003add7c1e2d24d339f20c371e1151c1cb6b08f32c02edf4208817e42db828 not found: ID does not exist" containerID="88003add7c1e2d24d339f20c371e1151c1cb6b08f32c02edf4208817e42db828"
Sep 07 13:19:30.186344 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.186305    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88003add7c1e2d24d339f20c371e1151c1cb6b08f32c02edf4208817e42db828"} err="failed to get container status \"88003add7c1e2d24d339f20c371e1151c1cb6b08f32c02edf4208817e42db828\": rpc error: code = NotFound desc = could not find container \"88003add7c1e2d24d339f20c371e1151c1cb6b08f32c02edf4208817e42db828\": container with ID starting with 88003add7c1e2d24d339f20c371e1151c1cb6b08f32c02edf4208817e42db828 not found: ID does not exist"
Sep 07 13:19:30.186344 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.186320    2576 scope.go:117] "RemoveContainer" containerID="2270959dfae152da7979291762d816967a52cfd4c22b844eca11ebd4dd1c7707"
Sep 07 13:19:30.186577 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:19:30.186558    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2270959dfae152da7979291762d816967a52cfd4c22b844eca11ebd4dd1c7707\": container with ID starting with 2270959dfae152da7979291762d816967a52cfd4c22b844eca11ebd4dd1c7707 not found: ID does not exist" containerID="2270959dfae152da7979291762d816967a52cfd4c22b844eca11ebd4dd1c7707"
Sep 07 13:19:30.186662 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.186579    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2270959dfae152da7979291762d816967a52cfd4c22b844eca11ebd4dd1c7707"} err="failed to get container status \"2270959dfae152da7979291762d816967a52cfd4c22b844eca11ebd4dd1c7707\": rpc error: code = NotFound desc = could not find container \"2270959dfae152da7979291762d816967a52cfd4c22b844eca11ebd4dd1c7707\": container with ID starting with 2270959dfae152da7979291762d816967a52cfd4c22b844eca11ebd4dd1c7707 not found: ID does not exist"
Sep 07 13:19:30.207031 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.207008    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"]
Sep 07 13:19:30.215294 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:30.210008    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-3dd3e936-openshift-default-7887df9856-z8mfm"]
Sep 07 13:19:31.366350 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:31.366317    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8901af6c-3203-48e4-8749-0a9b32e13596" path="/var/lib/kubelet/pods/8901af6c-3203-48e4-8749-0a9b32e13596/volumes"
Sep 07 13:19:32.016758 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:32.016721    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:32.206982 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:32.206936    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:32.330681 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:32.330599    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:32.442977 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:32.442942    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:33.412643 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:33.412615    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-v9pd8_d2bb2527-1a29-4b7e-b6fb-9be32693a5cd/console-operator/1.log"
Sep 07 13:19:33.415240 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:33.415213    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-v9pd8_d2bb2527-1a29-4b7e-b6fb-9be32693a5cd/console-operator/1.log"
Sep 07 13:19:36.738423 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:36.738386    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:36.857799 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:36.857740    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:37.092522 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:37.092444    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:37.206707 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:37.206671    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:38.166940 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:38.166896    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 07 13:19:38.167373 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:38.166971    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4" podUID="27a9b368-f0fb-44b5-ab0c-cb72509654c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 07 13:19:38.702242 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:38.702209    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:38.822537 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:38.822495    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:39.700622 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:39.700591    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:39.993841 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:39.993704    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"]
Sep 07 13:19:39.994085 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:39.994071    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8901af6c-3203-48e4-8749-0a9b32e13596" containerName="istio-proxy"
Sep 07 13:19:39.994085 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:39.994085    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8901af6c-3203-48e4-8749-0a9b32e13596" containerName="istio-proxy"
Sep 07 13:19:39.994168 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:39.994098    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8901af6c-3203-48e4-8749-0a9b32e13596" containerName="istio-proxy"
Sep 07 13:19:39.994168 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:39.994103    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="8901af6c-3203-48e4-8749-0a9b32e13596" containerName="istio-proxy"
Sep 07 13:19:39.994236 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:39.994169    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8901af6c-3203-48e4-8749-0a9b32e13596" containerName="istio-proxy"
Sep 07 13:19:39.994236 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:39.994180    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="8901af6c-3203-48e4-8749-0a9b32e13596" containerName="istio-proxy"
Sep 07 13:19:39.997034 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:39.997020    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:19:40.002618 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.002594    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-d5da3f-openshift-default-dockercfg-jkn9l\""
Sep 07 13:19:40.017796 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.017758    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"]
Sep 07 13:19:40.058904 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.058876    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:40.151417 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.151387    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05774f6d-335d-4493-8bd0-7ffa9afe5485-workload-socket\") pod \"e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") " pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:19:40.151519 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.151432    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njrnj\" (UniqueName: \"kubernetes.io/projected/05774f6d-335d-4493-8bd0-7ffa9afe5485-kube-api-access-njrnj\") pod \"e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") " pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:19:40.151519 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.151458    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05774f6d-335d-4493-8bd0-7ffa9afe5485-istio-podinfo\") pod \"e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") " pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:19:40.151519 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.151475    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05774f6d-335d-4493-8bd0-7ffa9afe5485-istio-data\") pod \"e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") " pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:19:40.151620 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.151524    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05774f6d-335d-4493-8bd0-7ffa9afe5485-istio-token\") pod \"e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") " pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:19:40.151620 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.151540    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05774f6d-335d-4493-8bd0-7ffa9afe5485-istio-envoy\") pod \"e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") " pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:19:40.151620 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.151581    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05774f6d-335d-4493-8bd0-7ffa9afe5485-istiod-ca-cert\") pod \"e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") " pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:19:40.151713 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.151635    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05774f6d-335d-4493-8bd0-7ffa9afe5485-credential-socket\") pod \"e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") " pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:19:40.151713 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.151661    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05774f6d-335d-4493-8bd0-7ffa9afe5485-workload-certs\") pod \"e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") " pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:19:40.230245 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.230217    2576 generic.go:356] "Generic (PLEG): container finished" podID="27a9b368-f0fb-44b5-ab0c-cb72509654c3" containerID="c526d140e2d11faed0813495033495105a5a96a146e5e75d376918419b7bd7cf" exitCode=0
Sep 07 13:19:40.230363 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.230292    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4" event={"ID":"27a9b368-f0fb-44b5-ab0c-cb72509654c3","Type":"ContainerDied","Data":"c526d140e2d11faed0813495033495105a5a96a146e5e75d376918419b7bd7cf"}
Sep 07 13:19:40.230827 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.230811    2576 scope.go:117] "RemoveContainer" containerID="c526d140e2d11faed0813495033495105a5a96a146e5e75d376918419b7bd7cf"
Sep 07 13:19:40.231994 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.231965    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:19:40.232096 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.232037    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:19:40.232096 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.232084    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:19:40.252407 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.252390    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05774f6d-335d-4493-8bd0-7ffa9afe5485-workload-certs\") pod \"e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") " pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:19:40.252507 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.252438    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05774f6d-335d-4493-8bd0-7ffa9afe5485-workload-socket\") pod \"e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") " pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:19:40.252507 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.252471    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njrnj\" (UniqueName: \"kubernetes.io/projected/05774f6d-335d-4493-8bd0-7ffa9afe5485-kube-api-access-njrnj\") pod \"e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") " pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:19:40.252507 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.252498    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05774f6d-335d-4493-8bd0-7ffa9afe5485-istio-podinfo\") pod \"e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") " pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:19:40.252668 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.252525    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05774f6d-335d-4493-8bd0-7ffa9afe5485-istio-data\") pod \"e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") " pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:19:40.252668 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.252605    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05774f6d-335d-4493-8bd0-7ffa9afe5485-istio-token\") pod \"e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") " pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:19:40.252668 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.252633    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05774f6d-335d-4493-8bd0-7ffa9afe5485-istio-envoy\") pod \"e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") " pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:19:40.252839 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.252724    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05774f6d-335d-4493-8bd0-7ffa9afe5485-workload-certs\") pod \"e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") " pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:19:40.252896 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.252860    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05774f6d-335d-4493-8bd0-7ffa9afe5485-workload-socket\") pod \"e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") " pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:19:40.252988 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.252671    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05774f6d-335d-4493-8bd0-7ffa9afe5485-istiod-ca-cert\") pod \"e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") " pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:19:40.253104 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.253021    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05774f6d-335d-4493-8bd0-7ffa9afe5485-istio-data\") pod \"e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") " pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:19:40.253104 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.253029    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05774f6d-335d-4493-8bd0-7ffa9afe5485-credential-socket\") pod \"e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") " pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:19:40.253385 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.253356    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05774f6d-335d-4493-8bd0-7ffa9afe5485-credential-socket\") pod \"e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") " pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:19:40.253473 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.253392    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05774f6d-335d-4493-8bd0-7ffa9afe5485-istiod-ca-cert\") pod \"e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") " pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:19:40.255155 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.255134    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05774f6d-335d-4493-8bd0-7ffa9afe5485-istio-envoy\") pod \"e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") " pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:19:40.255362 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.255342    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05774f6d-335d-4493-8bd0-7ffa9afe5485-istio-podinfo\") pod \"e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") " pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:19:40.281613 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.281590    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05774f6d-335d-4493-8bd0-7ffa9afe5485-istio-token\") pod \"e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") " pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:19:40.282620 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.282593    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njrnj\" (UniqueName: \"kubernetes.io/projected/05774f6d-335d-4493-8bd0-7ffa9afe5485-kube-api-access-njrnj\") pod \"e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") " pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:19:40.306673 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.306658    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:19:40.394265 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.394184    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:40.622828 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.622802    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"]
Sep 07 13:19:40.625535 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:19:40.625492    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05774f6d_335d_4493_8bd0_7ffa9afe5485.slice/crio-832a33a0c454928369a78a57f0d7d2e4bf231dd808242f31195b0258bb42f00c WatchSource:0}: Error finding container 832a33a0c454928369a78a57f0d7d2e4bf231dd808242f31195b0258bb42f00c: Status 404 returned error can't find the container with id 832a33a0c454928369a78a57f0d7d2e4bf231dd808242f31195b0258bb42f00c
Sep 07 13:19:40.627997 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.627961    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:19:40.628083 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.628050    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:19:40.628121 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:40.628092    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:19:41.238602 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:41.238562    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4" event={"ID":"27a9b368-f0fb-44b5-ab0c-cb72509654c3","Type":"ContainerStarted","Data":"451686c558026f3ae7a195bb3858ee3518c69ec81326afaa55e24c6657fe54f8"}
Sep 07 13:19:41.240167 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:41.240141    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj" event={"ID":"05774f6d-335d-4493-8bd0-7ffa9afe5485","Type":"ContainerStarted","Data":"f8c023a82d327a79f8a71d4708294e0b9e7cdb66ef484d48d757aa4d6a207206"}
Sep 07 13:19:41.240291 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:41.240189    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj" event={"ID":"05774f6d-335d-4493-8bd0-7ffa9afe5485","Type":"ContainerStarted","Data":"832a33a0c454928369a78a57f0d7d2e4bf231dd808242f31195b0258bb42f00c"}
Sep 07 13:19:41.307471 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:41.307420    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj" podStartSLOduration=2.307403072 podStartE2EDuration="2.307403072s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:19:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:19:41.302907726 +0000 UTC m=+1208.359789384" watchObservedRunningTime="2026-09-07 13:19:41.307403072 +0000 UTC m=+1208.364284728"
Sep 07 13:19:41.307645 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:41.307594    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:19:41.309428 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:41.309401    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 07 13:19:41.309560 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:41.309450    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj" podUID="05774f6d-335d-4493-8bd0-7ffa9afe5485" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 07 13:19:42.213916 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:42.213887    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:42.214164 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:42.214141    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 07 13:19:42.214220 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:42.214202    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4" podUID="27a9b368-f0fb-44b5-ab0c-cb72509654c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 07 13:19:42.311497 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:42.311471    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:19:42.343870 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:42.343841    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:43.214633 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:43.214601    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 07 13:19:43.214830 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:43.214658    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4" podUID="27a9b368-f0fb-44b5-ab0c-cb72509654c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 07 13:19:43.251647 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:43.251618    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:19:43.252609 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:43.252589    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:19:43.450754 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:43.450702    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:43.625585 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:43.625552    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:44.214326 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:44.214291    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 07 13:19:44.214503 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:44.214349    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4" podUID="27a9b368-f0fb-44b5-ab0c-cb72509654c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 07 13:19:44.587841 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:44.586945    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:44.677151 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:44.677096    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:44.907779 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:44.907745    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:45.214859 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:45.214790    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Sep 07 13:19:45.214859 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:45.214843    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4" podUID="27a9b368-f0fb-44b5-ab0c-cb72509654c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Sep 07 13:19:45.318672 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:45.318637    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:45.492512 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:45.492424    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:46.261133 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:46.261102    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:46.261558 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:46.261425    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:46.262184 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:46.262165    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:19:46.722535 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:46.722495    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:48.200494 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:48.200461    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:19:49.753535 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:49.753488    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:19:59.293987 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:59.293940    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 07 13:19:59.294482 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:19:59.294031    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj" podUID="05774f6d-335d-4493-8bd0-7ffa9afe5485" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 07 13:20:00.351375 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:00.351345    2576 generic.go:356] "Generic (PLEG): container finished" podID="05774f6d-335d-4493-8bd0-7ffa9afe5485" containerID="f8c023a82d327a79f8a71d4708294e0b9e7cdb66ef484d48d757aa4d6a207206" exitCode=0
Sep 07 13:20:00.351820 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:00.351427    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj" event={"ID":"05774f6d-335d-4493-8bd0-7ffa9afe5485","Type":"ContainerDied","Data":"f8c023a82d327a79f8a71d4708294e0b9e7cdb66ef484d48d757aa4d6a207206"}
Sep 07 13:20:00.351875 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:00.351834    2576 scope.go:117] "RemoveContainer" containerID="f8c023a82d327a79f8a71d4708294e0b9e7cdb66ef484d48d757aa4d6a207206"
Sep 07 13:20:00.352845 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:00.352817    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:20:00.352918 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:00.352905    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:20:00.352960 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:00.352946    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:20:01.359316 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:01.359285    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj" event={"ID":"05774f6d-335d-4493-8bd0-7ffa9afe5485","Type":"ContainerStarted","Data":"8f5289cc7e26e50c3f3e5eee5963a05db54a11715ea27666e4a088c06090b767"}
Sep 07 13:20:02.307362 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:02.307326    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:20:02.307547 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:02.307530    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 07 13:20:02.307595 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:02.307579    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj" podUID="05774f6d-335d-4493-8bd0-7ffa9afe5485" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 07 13:20:02.602745 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:02.602653    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:20:03.308026 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:03.307990    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 07 13:20:03.308200 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:03.308047    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj" podUID="05774f6d-335d-4493-8bd0-7ffa9afe5485" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 07 13:20:04.307338 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:04.307302    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 07 13:20:04.307717 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:04.307358    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj" podUID="05774f6d-335d-4493-8bd0-7ffa9afe5485" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 07 13:20:05.307238 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:05.307201    2576 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 07 13:20:05.307419 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:05.307254    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj" podUID="05774f6d-335d-4493-8bd0-7ffa9afe5485" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 07 13:20:05.876465 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:05.876432    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:20:06.310462 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:06.310384    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:20:06.310930 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:06.310788    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:20:06.311452 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:06.311433    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:20:07.153692 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:07.153659    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:20:08.291803 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:08.291748    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:20:08.659334 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:08.659301    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:20:09.112201 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.112128    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"]
Sep 07 13:20:09.115674 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.115657    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:09.121230 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.121210    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-8e7ddc-openshift-default-dockercfg-gxbzs\""
Sep 07 13:20:09.138988 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.138963    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"]
Sep 07 13:20:09.225818 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.225787    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-istio-envoy\") pod \"e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") " pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:09.225985 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.225842    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-credential-socket\") pod \"e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") " pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:09.225985 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.225911    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-workload-certs\") pod \"e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") " pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:09.225985 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.225976    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rlxv\" (UniqueName: \"kubernetes.io/projected/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-kube-api-access-4rlxv\") pod \"e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") " pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:09.226087 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.226029    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-istio-podinfo\") pod \"e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") " pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:09.226087 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.226049    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-workload-socket\") pod \"e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") " pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:09.226087 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.226072    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-istio-token\") pod \"e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") " pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:09.226189 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.226173    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-istiod-ca-cert\") pod \"e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") " pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:09.226224 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.226203    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-istio-data\") pod \"e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") " pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:09.295143 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.295108    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:20:09.327263 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.327237    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rlxv\" (UniqueName: \"kubernetes.io/projected/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-kube-api-access-4rlxv\") pod \"e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") " pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:09.327377 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.327275    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-istio-podinfo\") pod \"e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") " pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:09.327377 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.327294    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-workload-socket\") pod \"e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") " pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:09.327377 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.327320    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-istio-token\") pod \"e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") " pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:09.327377 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.327360    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-istiod-ca-cert\") pod \"e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") " pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:09.327557 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.327390    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-istio-data\") pod \"e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") " pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:09.327557 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.327420    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-istio-envoy\") pod \"e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") " pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:09.327557 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.327453    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-credential-socket\") pod \"e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") " pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:09.327557 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.327507    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-workload-certs\") pod \"e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") " pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:09.327717 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.327678    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-workload-socket\") pod \"e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") " pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:09.327851 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.327828    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-istio-data\") pod \"e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") " pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:09.327929 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.327838    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-credential-socket\") pod \"e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") " pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:09.327929 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.327895    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-workload-certs\") pod \"e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") " pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:09.328229 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.328209    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-istiod-ca-cert\") pod \"e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") " pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:09.329689 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.329673    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-istio-envoy\") pod \"e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") " pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:09.329943 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.329927    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-istio-podinfo\") pod \"e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") " pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:09.335684 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.335658    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-istio-token\") pod \"e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") " pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:09.335936 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.335920    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rlxv\" (UniqueName: \"kubernetes.io/projected/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-kube-api-access-4rlxv\") pod \"e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") " pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:09.396303 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.396275    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:20:09.425448 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.425425    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:09.715988 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.715914    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"]
Sep 07 13:20:09.719267 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:20:09.719240    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b03c29c_6bb7_4c0e_9453_ec6b9e9ced67.slice/crio-fc847934b55c0672003307a18957d2147aea68f80fc0796673becdade0844c19 WatchSource:0}: Error finding container fc847934b55c0672003307a18957d2147aea68f80fc0796673becdade0844c19: Status 404 returned error can't find the container with id fc847934b55c0672003307a18957d2147aea68f80fc0796673becdade0844c19
Sep 07 13:20:09.721903 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.721872    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:20:09.721980 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.721944    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:20:09.721980 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:09.721971    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:20:10.416049 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:10.416017    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x" event={"ID":"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67","Type":"ContainerStarted","Data":"4ed17ad73f1ef85026a59493c64274d771e537eba2806c321f247fd051dc16da"}
Sep 07 13:20:10.416434 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:10.416070    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x" event={"ID":"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67","Type":"ContainerStarted","Data":"fc847934b55c0672003307a18957d2147aea68f80fc0796673becdade0844c19"}
Sep 07 13:20:10.426231 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:10.426208    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:10.431088 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:10.431068    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:10.441817 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:10.441778    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x" podStartSLOduration=1.4417497209999999 podStartE2EDuration="1.441749721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:20:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:20:10.439735941 +0000 UTC m=+1237.496617595" watchObservedRunningTime="2026-09-07 13:20:10.441749721 +0000 UTC m=+1237.498631378"
Sep 07 13:20:11.424800 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:11.424396    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:11.428265 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:11.428236    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:12.554146 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:12.554109    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:20:12.655297 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:12.655250    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:20:13.614071 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:13.614027    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:20:13.736559 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:13.736527    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:20:13.957735 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:13.957689    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:20:14.461646 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:14.461613    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:20:14.581006 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:14.580963    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:20:19.960644 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:19.960612    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:20:21.250296 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:21.250267    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:20:30.602863 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:30.602822    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:20:31.536913 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:31.536861    2576 generic.go:356] "Generic (PLEG): container finished" podID="6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67" containerID="4ed17ad73f1ef85026a59493c64274d771e537eba2806c321f247fd051dc16da" exitCode=0
Sep 07 13:20:31.537041 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:31.536928    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x" event={"ID":"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67","Type":"ContainerDied","Data":"4ed17ad73f1ef85026a59493c64274d771e537eba2806c321f247fd051dc16da"}
Sep 07 13:20:31.537253 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:31.537239    2576 scope.go:117] "RemoveContainer" containerID="4ed17ad73f1ef85026a59493c64274d771e537eba2806c321f247fd051dc16da"
Sep 07 13:20:31.538233 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:31.538208    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:20:31.538289 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:31.538273    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:20:31.538322 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:31.538306    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:20:32.544689 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:32.544657    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x" event={"ID":"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67","Type":"ContainerStarted","Data":"734b6964c493c29520eb42b5daab25d0b4d0f44ea097df910554753477e56dee"}
Sep 07 13:20:33.426260 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:33.426228    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:33.426426 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:33.426409    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 07 13:20:33.426484 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:33.426464    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x" podUID="6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 07 13:20:33.507038 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:33.507010    2576 scope.go:117] "RemoveContainer" containerID="918a5a921b18f942c05f17bc03d2183f7c1a68017f0d2ebc9a571a2e784719e9"
Sep 07 13:20:33.515251 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:33.515230    2576 scope.go:117] "RemoveContainer" containerID="4f3033e9f32d08a38857914512899b6bc7a7aaed083a88f147693c85bf14ac3c"
Sep 07 13:20:34.425714 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:34.425682    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 07 13:20:34.426115 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:34.425733    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x" podUID="6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 07 13:20:34.476570 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:34.476523    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:20:35.426375 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:35.426342    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 07 13:20:35.426727 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:35.426392    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x" podUID="6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 07 13:20:36.426271 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:36.426233    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 07 13:20:36.426441 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:36.426299    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x" podUID="6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 07 13:20:37.426442 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:37.426408    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Sep 07 13:20:37.426829 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:37.426471    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x" podUID="6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Sep 07 13:20:38.430188 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:38.430162    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:38.430538 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:38.430460    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:38.431062 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:38.431038    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:20:43.176977 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:43.176939    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:20:43.296878 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:43.296851    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7253-139960387749760"]
Sep 07 13:20:43.301430 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:43.301416    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7253-139960387749760"
Sep 07 13:20:43.304286 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:43.304265    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-wb64r\""
Sep 07 13:20:43.308136 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:43.308115    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7253-139960387749760"]
Sep 07 13:20:43.325585 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:43.325556    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljrff\" (UniqueName: \"kubernetes.io/projected/84cdbd1f-c204-437d-9504-356c83fbb95c-kube-api-access-ljrff\") pod \"test-curl-7253-139960387749760\" (UID: \"84cdbd1f-c204-437d-9504-356c83fbb95c\") " pod="opendatahub/test-curl-7253-139960387749760"
Sep 07 13:20:43.426475 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:43.426446    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljrff\" (UniqueName: \"kubernetes.io/projected/84cdbd1f-c204-437d-9504-356c83fbb95c-kube-api-access-ljrff\") pod \"test-curl-7253-139960387749760\" (UID: \"84cdbd1f-c204-437d-9504-356c83fbb95c\") " pod="opendatahub/test-curl-7253-139960387749760"
Sep 07 13:20:43.435716 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:43.435671    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljrff\" (UniqueName: \"kubernetes.io/projected/84cdbd1f-c204-437d-9504-356c83fbb95c-kube-api-access-ljrff\") pod \"test-curl-7253-139960387749760\" (UID: \"84cdbd1f-c204-437d-9504-356c83fbb95c\") " pod="opendatahub/test-curl-7253-139960387749760"
Sep 07 13:20:43.611173 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:43.611154    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7253-139960387749760"
Sep 07 13:20:43.879133 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:43.879110    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7253-139960387749760"]
Sep 07 13:20:43.881023 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:20:43.880997    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84cdbd1f_c204_437d_9504_356c83fbb95c.slice/crio-8059f0e87995a0a6dd2c2d7ce13732da0fb4c0539d7ef9fec05512fd7d28d695 WatchSource:0}: Error finding container 8059f0e87995a0a6dd2c2d7ce13732da0fb4c0539d7ef9fec05512fd7d28d695: Status 404 returned error can't find the container with id 8059f0e87995a0a6dd2c2d7ce13732da0fb4c0539d7ef9fec05512fd7d28d695
Sep 07 13:20:43.882354 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:43.882337    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 13:20:44.617494 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:44.617456    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7253-139960387749760" event={"ID":"84cdbd1f-c204-437d-9504-356c83fbb95c","Type":"ContainerStarted","Data":"8059f0e87995a0a6dd2c2d7ce13732da0fb4c0539d7ef9fec05512fd7d28d695"}
Sep 07 13:20:45.623644 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:45.623615    2576 generic.go:356] "Generic (PLEG): container finished" podID="84cdbd1f-c204-437d-9504-356c83fbb95c" containerID="e01e9df6ee7c7a84af89ec1332f754a0265e577d9cdd9c56ffa549bd0950a982" exitCode=0
Sep 07 13:20:45.624007 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:45.623686    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7253-139960387749760" event={"ID":"84cdbd1f-c204-437d-9504-356c83fbb95c","Type":"ContainerDied","Data":"e01e9df6ee7c7a84af89ec1332f754a0265e577d9cdd9c56ffa549bd0950a982"}
Sep 07 13:20:46.760007 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:46.759984    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7253-139960387749760"
Sep 07 13:20:46.786804 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:46.786762    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7253-139960387749760_84cdbd1f-c204-437d-9504-356c83fbb95c/test-curl-7253-139960387749760/0.log"
Sep 07 13:20:46.816879 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:46.816854    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7253-139960387749760"]
Sep 07 13:20:46.819936 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:46.819918    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7253-139960387749760"]
Sep 07 13:20:46.854078 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:46.854023    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljrff\" (UniqueName: \"kubernetes.io/projected/84cdbd1f-c204-437d-9504-356c83fbb95c-kube-api-access-ljrff\") pod \"84cdbd1f-c204-437d-9504-356c83fbb95c\" (UID: \"84cdbd1f-c204-437d-9504-356c83fbb95c\") "
Sep 07 13:20:46.855997 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:46.855975    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84cdbd1f-c204-437d-9504-356c83fbb95c-kube-api-access-ljrff" (OuterVolumeSpecName: "kube-api-access-ljrff") pod "84cdbd1f-c204-437d-9504-356c83fbb95c" (UID: "84cdbd1f-c204-437d-9504-356c83fbb95c"). InnerVolumeSpecName "kube-api-access-ljrff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:20:46.943894 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:46.943870    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7253-139960387749760"]
Sep 07 13:20:46.944255 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:46.944243    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84cdbd1f-c204-437d-9504-356c83fbb95c" containerName="test-curl-7253-139960387749760"
Sep 07 13:20:46.944350 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:46.944256    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="84cdbd1f-c204-437d-9504-356c83fbb95c" containerName="test-curl-7253-139960387749760"
Sep 07 13:20:46.944350 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:46.944332    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="84cdbd1f-c204-437d-9504-356c83fbb95c" containerName="test-curl-7253-139960387749760"
Sep 07 13:20:46.947320 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:46.947307    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7253-139960387749760"
Sep 07 13:20:46.952940 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:46.952923    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7253-139960387749760"]
Sep 07 13:20:46.954747 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:46.954726    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljrff\" (UniqueName: \"kubernetes.io/projected/84cdbd1f-c204-437d-9504-356c83fbb95c-kube-api-access-ljrff\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:20:47.055295 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:47.055276    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mx4h\" (UniqueName: \"kubernetes.io/projected/52daa7f6-03b0-47dd-8e55-6e26503de21c-kube-api-access-2mx4h\") pod \"test-curl-7253-139960387749760\" (UID: \"52daa7f6-03b0-47dd-8e55-6e26503de21c\") " pod="opendatahub/test-curl-7253-139960387749760"
Sep 07 13:20:47.156482 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:47.156453    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mx4h\" (UniqueName: \"kubernetes.io/projected/52daa7f6-03b0-47dd-8e55-6e26503de21c-kube-api-access-2mx4h\") pod \"test-curl-7253-139960387749760\" (UID: \"52daa7f6-03b0-47dd-8e55-6e26503de21c\") " pod="opendatahub/test-curl-7253-139960387749760"
Sep 07 13:20:47.167418 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:47.167397    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mx4h\" (UniqueName: \"kubernetes.io/projected/52daa7f6-03b0-47dd-8e55-6e26503de21c-kube-api-access-2mx4h\") pod \"test-curl-7253-139960387749760\" (UID: \"52daa7f6-03b0-47dd-8e55-6e26503de21c\") " pod="opendatahub/test-curl-7253-139960387749760"
Sep 07 13:20:47.256671 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:47.256648    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7253-139960387749760"
Sep 07 13:20:47.366712 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:47.366673    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84cdbd1f-c204-437d-9504-356c83fbb95c" path="/var/lib/kubelet/pods/84cdbd1f-c204-437d-9504-356c83fbb95c/volumes"
Sep 07 13:20:47.535395 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:47.535338    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7253-139960387749760"]
Sep 07 13:20:47.538322 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:20:47.538295    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod52daa7f6_03b0_47dd_8e55_6e26503de21c.slice/crio-dea5e3b4974aea0dd099994ab19db63bd7c1f4686bc65ab31d502a00f16ef84d WatchSource:0}: Error finding container dea5e3b4974aea0dd099994ab19db63bd7c1f4686bc65ab31d502a00f16ef84d: Status 404 returned error can't find the container with id dea5e3b4974aea0dd099994ab19db63bd7c1f4686bc65ab31d502a00f16ef84d
Sep 07 13:20:47.638220 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:47.638187    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7253-139960387749760" event={"ID":"52daa7f6-03b0-47dd-8e55-6e26503de21c","Type":"ContainerStarted","Data":"dea5e3b4974aea0dd099994ab19db63bd7c1f4686bc65ab31d502a00f16ef84d"}
Sep 07 13:20:47.639535 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:47.639516    2576 scope.go:117] "RemoveContainer" containerID="e01e9df6ee7c7a84af89ec1332f754a0265e577d9cdd9c56ffa549bd0950a982"
Sep 07 13:20:47.639648 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:47.639543    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7253-139960387749760"
Sep 07 13:20:48.646098 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:48.646060    2576 generic.go:356] "Generic (PLEG): container finished" podID="52daa7f6-03b0-47dd-8e55-6e26503de21c" containerID="d87ae150156eb60f7ba1cccd240c6d5112fd2bcf1d3f244538377256ce4801fb" exitCode=0
Sep 07 13:20:48.646409 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:48.646148    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7253-139960387749760" event={"ID":"52daa7f6-03b0-47dd-8e55-6e26503de21c","Type":"ContainerDied","Data":"d87ae150156eb60f7ba1cccd240c6d5112fd2bcf1d3f244538377256ce4801fb"}
Sep 07 13:20:49.776961 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:49.776934    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7253-139960387749760"
Sep 07 13:20:49.825838 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:49.825814    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7253-139960387749760_52daa7f6-03b0-47dd-8e55-6e26503de21c/test-curl-7253-139960387749760/0.log"
Sep 07 13:20:49.857915 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:49.857887    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7253-139960387749760"]
Sep 07 13:20:49.867525 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:49.867504    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7253-139960387749760"]
Sep 07 13:20:49.877860 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:49.877845    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mx4h\" (UniqueName: \"kubernetes.io/projected/52daa7f6-03b0-47dd-8e55-6e26503de21c-kube-api-access-2mx4h\") pod \"52daa7f6-03b0-47dd-8e55-6e26503de21c\" (UID: \"52daa7f6-03b0-47dd-8e55-6e26503de21c\") "
Sep 07 13:20:49.879888 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:49.879862    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52daa7f6-03b0-47dd-8e55-6e26503de21c-kube-api-access-2mx4h" (OuterVolumeSpecName: "kube-api-access-2mx4h") pod "52daa7f6-03b0-47dd-8e55-6e26503de21c" (UID: "52daa7f6-03b0-47dd-8e55-6e26503de21c"). InnerVolumeSpecName "kube-api-access-2mx4h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:20:49.979354 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:49.979285    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mx4h\" (UniqueName: \"kubernetes.io/projected/52daa7f6-03b0-47dd-8e55-6e26503de21c-kube-api-access-2mx4h\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:20:49.988741 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:49.988715    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7253-139960387750768"]
Sep 07 13:20:49.989137 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:49.989124    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52daa7f6-03b0-47dd-8e55-6e26503de21c" containerName="test-curl-7253-139960387749760"
Sep 07 13:20:49.989180 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:49.989139    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="52daa7f6-03b0-47dd-8e55-6e26503de21c" containerName="test-curl-7253-139960387749760"
Sep 07 13:20:49.989221 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:49.989212    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="52daa7f6-03b0-47dd-8e55-6e26503de21c" containerName="test-curl-7253-139960387749760"
Sep 07 13:20:49.992208 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:49.992194    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7253-139960387750768"
Sep 07 13:20:49.997296 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:49.997264    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7253-139960387750768"]
Sep 07 13:20:50.080692 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:50.080668    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw5h8\" (UniqueName: \"kubernetes.io/projected/e38ab090-73f4-40ce-afa1-93098172bf34-kube-api-access-pw5h8\") pod \"test-curl-7253-139960387750768\" (UID: \"e38ab090-73f4-40ce-afa1-93098172bf34\") " pod="opendatahub/test-curl-7253-139960387750768"
Sep 07 13:20:50.181961 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:50.181944    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw5h8\" (UniqueName: \"kubernetes.io/projected/e38ab090-73f4-40ce-afa1-93098172bf34-kube-api-access-pw5h8\") pod \"test-curl-7253-139960387750768\" (UID: \"e38ab090-73f4-40ce-afa1-93098172bf34\") " pod="opendatahub/test-curl-7253-139960387750768"
Sep 07 13:20:50.192633 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:50.192617    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw5h8\" (UniqueName: \"kubernetes.io/projected/e38ab090-73f4-40ce-afa1-93098172bf34-kube-api-access-pw5h8\") pod \"test-curl-7253-139960387750768\" (UID: \"e38ab090-73f4-40ce-afa1-93098172bf34\") " pod="opendatahub/test-curl-7253-139960387750768"
Sep 07 13:20:50.301909 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:50.301856    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7253-139960387750768"
Sep 07 13:20:50.572157 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:50.572136    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7253-139960387750768"]
Sep 07 13:20:50.574031 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:20:50.574001    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode38ab090_73f4_40ce_afa1_93098172bf34.slice/crio-59351dcf89ce72a968ce3ec5ccc7dc16830ac8e5cddd9e3e4b6380244c81ee1e WatchSource:0}: Error finding container 59351dcf89ce72a968ce3ec5ccc7dc16830ac8e5cddd9e3e4b6380244c81ee1e: Status 404 returned error can't find the container with id 59351dcf89ce72a968ce3ec5ccc7dc16830ac8e5cddd9e3e4b6380244c81ee1e
Sep 07 13:20:50.658233 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:50.658202    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7253-139960387749760"
Sep 07 13:20:50.658334 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:50.658252    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dea5e3b4974aea0dd099994ab19db63bd7c1f4686bc65ab31d502a00f16ef84d"
Sep 07 13:20:50.659467 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:50.659440    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7253-139960387750768" event={"ID":"e38ab090-73f4-40ce-afa1-93098172bf34","Type":"ContainerStarted","Data":"59351dcf89ce72a968ce3ec5ccc7dc16830ac8e5cddd9e3e4b6380244c81ee1e"}
Sep 07 13:20:50.674045 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:20:50.668480    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7253-139960387749760\" is forbidden: User \"system:node:ip-10-0-142-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-74.ec2.internal' and this object" podUID="52daa7f6-03b0-47dd-8e55-6e26503de21c" pod="opendatahub/test-curl-7253-139960387749760"
Sep 07 13:20:51.055501 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:51.055471    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:20:51.367002 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:51.366975    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52daa7f6-03b0-47dd-8e55-6e26503de21c" path="/var/lib/kubelet/pods/52daa7f6-03b0-47dd-8e55-6e26503de21c/volumes"
Sep 07 13:20:51.667310 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:51.667276    2576 generic.go:356] "Generic (PLEG): container finished" podID="e38ab090-73f4-40ce-afa1-93098172bf34" containerID="add06aae731e1197c30c167ca87bc1a59e6fcf0c970a95758b52abb0c0d948a2" exitCode=0
Sep 07 13:20:51.667471 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:51.667357    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7253-139960387750768" event={"ID":"e38ab090-73f4-40ce-afa1-93098172bf34","Type":"ContainerDied","Data":"add06aae731e1197c30c167ca87bc1a59e6fcf0c970a95758b52abb0c0d948a2"}
Sep 07 13:20:52.808475 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:52.808447    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7253-139960387750768"
Sep 07 13:20:52.830394 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:52.830343    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7253-139960387750768_e38ab090-73f4-40ce-afa1-93098172bf34/test-curl-7253-139960387750768/0.log"
Sep 07 13:20:52.854728 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:52.854700    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7253-139960387750768"]
Sep 07 13:20:52.858694 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:52.858672    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7253-139960387750768"]
Sep 07 13:20:52.902807 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:52.902760    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pw5h8\" (UniqueName: \"kubernetes.io/projected/e38ab090-73f4-40ce-afa1-93098172bf34-kube-api-access-pw5h8\") pod \"e38ab090-73f4-40ce-afa1-93098172bf34\" (UID: \"e38ab090-73f4-40ce-afa1-93098172bf34\") "
Sep 07 13:20:52.904795 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:52.904757    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e38ab090-73f4-40ce-afa1-93098172bf34-kube-api-access-pw5h8" (OuterVolumeSpecName: "kube-api-access-pw5h8") pod "e38ab090-73f4-40ce-afa1-93098172bf34" (UID: "e38ab090-73f4-40ce-afa1-93098172bf34"). InnerVolumeSpecName "kube-api-access-pw5h8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:20:52.991463 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:52.991414    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7253-139960387750768"]
Sep 07 13:20:52.991839 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:52.991826    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e38ab090-73f4-40ce-afa1-93098172bf34" containerName="test-curl-7253-139960387750768"
Sep 07 13:20:52.991890 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:52.991841    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e38ab090-73f4-40ce-afa1-93098172bf34" containerName="test-curl-7253-139960387750768"
Sep 07 13:20:52.991922 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:52.991912    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e38ab090-73f4-40ce-afa1-93098172bf34" containerName="test-curl-7253-139960387750768"
Sep 07 13:20:52.994998 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:52.994983    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7253-139960387750768"
Sep 07 13:20:53.002902 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:53.002883    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7253-139960387750768"]
Sep 07 13:20:53.003857 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:53.003824    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pw5h8\" (UniqueName: \"kubernetes.io/projected/e38ab090-73f4-40ce-afa1-93098172bf34-kube-api-access-pw5h8\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:20:53.104672 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:53.104649    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x97tc\" (UniqueName: \"kubernetes.io/projected/e1b9c93a-aaa0-40ce-a35b-0aa5b08bb80f-kube-api-access-x97tc\") pod \"test-curl-7253-139960387750768\" (UID: \"e1b9c93a-aaa0-40ce-a35b-0aa5b08bb80f\") " pod="opendatahub/test-curl-7253-139960387750768"
Sep 07 13:20:53.205710 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:53.205679    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x97tc\" (UniqueName: \"kubernetes.io/projected/e1b9c93a-aaa0-40ce-a35b-0aa5b08bb80f-kube-api-access-x97tc\") pod \"test-curl-7253-139960387750768\" (UID: \"e1b9c93a-aaa0-40ce-a35b-0aa5b08bb80f\") " pod="opendatahub/test-curl-7253-139960387750768"
Sep 07 13:20:53.214368 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:53.214345    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x97tc\" (UniqueName: \"kubernetes.io/projected/e1b9c93a-aaa0-40ce-a35b-0aa5b08bb80f-kube-api-access-x97tc\") pod \"test-curl-7253-139960387750768\" (UID: \"e1b9c93a-aaa0-40ce-a35b-0aa5b08bb80f\") " pod="opendatahub/test-curl-7253-139960387750768"
Sep 07 13:20:53.304519 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:53.304465    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7253-139960387750768"
Sep 07 13:20:53.372803 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:53.372754    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e38ab090-73f4-40ce-afa1-93098172bf34" path="/var/lib/kubelet/pods/e38ab090-73f4-40ce-afa1-93098172bf34/volumes"
Sep 07 13:20:53.576236 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:53.576174    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7253-139960387750768"]
Sep 07 13:20:53.578349 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:20:53.578327    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode1b9c93a_aaa0_40ce_a35b_0aa5b08bb80f.slice/crio-c68543967ac1cef502b34da127e6ce1491254637c185b89883ae2656c62a96ab WatchSource:0}: Error finding container c68543967ac1cef502b34da127e6ce1491254637c185b89883ae2656c62a96ab: Status 404 returned error can't find the container with id c68543967ac1cef502b34da127e6ce1491254637c185b89883ae2656c62a96ab
Sep 07 13:20:53.680000 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:53.679981    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7253-139960387750768"
Sep 07 13:20:53.680107 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:53.680008    2576 scope.go:117] "RemoveContainer" containerID="add06aae731e1197c30c167ca87bc1a59e6fcf0c970a95758b52abb0c0d948a2"
Sep 07 13:20:53.681259 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:53.681192    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7253-139960387750768" event={"ID":"e1b9c93a-aaa0-40ce-a35b-0aa5b08bb80f","Type":"ContainerStarted","Data":"c68543967ac1cef502b34da127e6ce1491254637c185b89883ae2656c62a96ab"}
Sep 07 13:20:54.688899 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:54.688870    2576 generic.go:356] "Generic (PLEG): container finished" podID="e1b9c93a-aaa0-40ce-a35b-0aa5b08bb80f" containerID="b7b9d0ad552771aef365836bba4c8e8fd47439228c3b6ec1af3acda8f11f4a37" exitCode=0
Sep 07 13:20:54.689248 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:54.688962    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7253-139960387750768" event={"ID":"e1b9c93a-aaa0-40ce-a35b-0aa5b08bb80f","Type":"ContainerDied","Data":"b7b9d0ad552771aef365836bba4c8e8fd47439228c3b6ec1af3acda8f11f4a37"}
Sep 07 13:20:55.820840 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:55.820817    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7253-139960387750768"
Sep 07 13:20:55.848802 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:55.848758    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7253-139960387750768_e1b9c93a-aaa0-40ce-a35b-0aa5b08bb80f/test-curl-7253-139960387750768/0.log"
Sep 07 13:20:55.875784 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:55.875745    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7253-139960387750768"]
Sep 07 13:20:55.879639 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:55.879613    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7253-139960387750768"]
Sep 07 13:20:55.930131 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:55.930109    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x97tc\" (UniqueName: \"kubernetes.io/projected/e1b9c93a-aaa0-40ce-a35b-0aa5b08bb80f-kube-api-access-x97tc\") pod \"e1b9c93a-aaa0-40ce-a35b-0aa5b08bb80f\" (UID: \"e1b9c93a-aaa0-40ce-a35b-0aa5b08bb80f\") "
Sep 07 13:20:55.932107 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:55.932078    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1b9c93a-aaa0-40ce-a35b-0aa5b08bb80f-kube-api-access-x97tc" (OuterVolumeSpecName: "kube-api-access-x97tc") pod "e1b9c93a-aaa0-40ce-a35b-0aa5b08bb80f" (UID: "e1b9c93a-aaa0-40ce-a35b-0aa5b08bb80f"). InnerVolumeSpecName "kube-api-access-x97tc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:20:56.030834 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:56.030788    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x97tc\" (UniqueName: \"kubernetes.io/projected/e1b9c93a-aaa0-40ce-a35b-0aa5b08bb80f-kube-api-access-x97tc\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:20:56.555712 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:56.555686    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:20:56.701667 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:56.701646    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c68543967ac1cef502b34da127e6ce1491254637c185b89883ae2656c62a96ab"
Sep 07 13:20:56.701667 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:56.701659    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7253-139960387750768"
Sep 07 13:20:56.710617 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:20:56.710592    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7253-139960387750768\" is forbidden: User \"system:node:ip-10-0-142-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-74.ec2.internal' and this object" podUID="e1b9c93a-aaa0-40ce-a35b-0aa5b08bb80f" pod="opendatahub/test-curl-7253-139960387750768"
Sep 07 13:20:56.833815 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:56.833724    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"]
Sep 07 13:20:56.834318 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:56.834298    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1b9c93a-aaa0-40ce-a35b-0aa5b08bb80f" containerName="test-curl-7253-139960387750768"
Sep 07 13:20:56.834400 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:56.834321    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1b9c93a-aaa0-40ce-a35b-0aa5b08bb80f" containerName="test-curl-7253-139960387750768"
Sep 07 13:20:56.834448 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:56.834409    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1b9c93a-aaa0-40ce-a35b-0aa5b08bb80f" containerName="test-curl-7253-139960387750768"
Sep 07 13:20:56.837420 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:56.837400    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:20:56.839836 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:56.839818    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-ede2050e-openshift-default-dockercfg-zflfs\""
Sep 07 13:20:56.856004 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:56.855978    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"]
Sep 07 13:20:56.867988 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:56.867964    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:20:56.878411 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:20:56.878387    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7253-139960387750768\" is forbidden: User \"system:node:ip-10-0-142-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-74.ec2.internal' and this object" podUID="e1b9c93a-aaa0-40ce-a35b-0aa5b08bb80f" pod="opendatahub/test-curl-7253-139960387750768"
Sep 07 13:20:56.940743 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:56.940722    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-istio-podinfo\") pod \"e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") " pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:20:56.940845 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:56.940749    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-istio-data\") pod \"e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") " pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:20:56.940845 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:56.940788    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-workload-socket\") pod \"e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") " pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:20:56.940929 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:56.940853    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-istio-token\") pod \"e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") " pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:20:56.940929 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:56.940875    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-istiod-ca-cert\") pod \"e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") " pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:20:56.940929 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:56.940892    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg6lg\" (UniqueName: \"kubernetes.io/projected/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-kube-api-access-gg6lg\") pod \"e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") " pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:20:56.941039 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:56.940940    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-credential-socket\") pod \"e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") " pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:20:56.941039 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:56.940957    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-workload-certs\") pod \"e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") " pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:20:56.941039 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:56.940976    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-istio-envoy\") pod \"e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") " pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:20:57.041706 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:57.041675    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-istio-podinfo\") pod \"e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") " pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:20:57.041893 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:57.041713    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-istio-data\") pod \"e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") " pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:20:57.041893 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:57.041733    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-workload-socket\") pod \"e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") " pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:20:57.041893 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:57.041790    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-istio-token\") pod \"e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") " pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:20:57.041893 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:57.041818    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-istiod-ca-cert\") pod \"e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") " pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:20:57.041893 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:57.041843    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg6lg\" (UniqueName: \"kubernetes.io/projected/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-kube-api-access-gg6lg\") pod \"e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") " pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:20:57.042146 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:57.041911    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-credential-socket\") pod \"e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") " pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:20:57.042146 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:57.041935    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-workload-certs\") pod \"e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") " pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:20:57.042146 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:57.041965    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-istio-envoy\") pod \"e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") " pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:20:57.042146 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:57.042110    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-istio-data\") pod \"e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") " pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:20:57.042359 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:57.042155    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-workload-socket\") pod \"e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") " pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:20:57.042359 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:57.042214    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-credential-socket\") pod \"e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") " pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:20:57.042442 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:57.042371    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-workload-certs\") pod \"e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") " pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:20:57.042759 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:57.042740    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-istiod-ca-cert\") pod \"e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") " pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:20:57.044185 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:57.044168    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-istio-envoy\") pod \"e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") " pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:20:57.044404 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:57.044387    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-istio-podinfo\") pod \"e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") " pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:20:57.052811 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:57.052788    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-istio-token\") pod \"e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") " pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:20:57.072535 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:57.072511    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg6lg\" (UniqueName: \"kubernetes.io/projected/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-kube-api-access-gg6lg\") pod \"e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") " pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:20:57.147246 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:57.147228    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:20:57.366821 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:57.366780    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1b9c93a-aaa0-40ce-a35b-0aa5b08bb80f" path="/var/lib/kubelet/pods/e1b9c93a-aaa0-40ce-a35b-0aa5b08bb80f/volumes"
Sep 07 13:20:57.426589 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:57.426545    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"]
Sep 07 13:20:57.428617 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:20:57.428596    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda73cd840_56f9_4ffb_bd0f_f20c6ba5069b.slice/crio-29a208491534bc85ddf16b6eb67d459593b86eb5e0a1e75f4cc37d59e6bfe24e WatchSource:0}: Error finding container 29a208491534bc85ddf16b6eb67d459593b86eb5e0a1e75f4cc37d59e6bfe24e: Status 404 returned error can't find the container with id 29a208491534bc85ddf16b6eb67d459593b86eb5e0a1e75f4cc37d59e6bfe24e
Sep 07 13:20:57.430710 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:57.430683    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:20:57.430780 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:57.430744    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:20:57.430823 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:57.430789    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:20:57.710414 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:57.710316    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq" event={"ID":"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b","Type":"ContainerStarted","Data":"eb76d519be75ae3bacd5f59c106bf6ea3d56ebf3f922af6a5715a4fcd44fb0aa"}
Sep 07 13:20:57.710414 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:57.710386    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq" event={"ID":"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b","Type":"ContainerStarted","Data":"29a208491534bc85ddf16b6eb67d459593b86eb5e0a1e75f4cc37d59e6bfe24e"}
Sep 07 13:20:57.734866 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:57.734807    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq" podStartSLOduration=1.734757581 podStartE2EDuration="1.734757581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:20:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:20:57.733514086 +0000 UTC m=+1284.790395744" watchObservedRunningTime="2026-09-07 13:20:57.734757581 +0000 UTC m=+1284.791639233"
Sep 07 13:20:58.148355 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:58.148328    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:20:58.153433 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:58.153407    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:20:58.718037 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:58.718007    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:20:58.718859 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:58.718843    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:20:59.356479 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:59.356451    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:20:59.763919 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:59.763891    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:20:59.876162 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:20:59.876126    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:21:00.959255 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:00.959214    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:21:01.062824 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:01.062790    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:21:01.196149 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:01.196120    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:21:01.547954 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:01.547922    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:21:01.637408 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:01.637383    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:21:05.004978 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:05.004945    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:21:10.258202 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:10.258160    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:21:20.847627 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:20.847558    2576 generic.go:356] "Generic (PLEG): container finished" podID="a73cd840-56f9-4ffb-bd0f-f20c6ba5069b" containerID="eb76d519be75ae3bacd5f59c106bf6ea3d56ebf3f922af6a5715a4fcd44fb0aa" exitCode=0
Sep 07 13:21:20.848006 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:20.847632    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq" event={"ID":"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b","Type":"ContainerDied","Data":"eb76d519be75ae3bacd5f59c106bf6ea3d56ebf3f922af6a5715a4fcd44fb0aa"}
Sep 07 13:21:20.854237 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:20.848486    2576 scope.go:117] "RemoveContainer" containerID="eb76d519be75ae3bacd5f59c106bf6ea3d56ebf3f922af6a5715a4fcd44fb0aa"
Sep 07 13:21:20.855261 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:20.855228    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:21:20.855341 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:20.855300    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:21:20.855341 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:20.855330    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:21:21.855584 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:21.855547    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq" event={"ID":"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b","Type":"ContainerStarted","Data":"eb2ea4027f88db3d4e89ef398af3e03e2b0d09b8f2df80c17fd2246ddb21a028"}
Sep 07 13:21:22.147927 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:22.147892    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:21:22.148125 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:22.148101    2576 patch_prober.go:28] interesting pod/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 07 13:21:22.148175 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:22.148151    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq" podUID="a73cd840-56f9-4ffb-bd0f-f20c6ba5069b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 07 13:21:23.147753 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:23.147714    2576 patch_prober.go:28] interesting pod/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 07 13:21:23.148126 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:23.147794    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq" podUID="a73cd840-56f9-4ffb-bd0f-f20c6ba5069b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 07 13:21:23.933839 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:23.933796    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:21:24.148505 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:24.148471    2576 patch_prober.go:28] interesting pod/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 07 13:21:24.148883 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:24.148522    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq" podUID="a73cd840-56f9-4ffb-bd0f-f20c6ba5069b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 07 13:21:25.148144 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:25.148106    2576 patch_prober.go:28] interesting pod/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 07 13:21:25.148315 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:25.148160    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq" podUID="a73cd840-56f9-4ffb-bd0f-f20c6ba5069b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 07 13:21:26.147660 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:26.147631    2576 patch_prober.go:28] interesting pod/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Sep 07 13:21:26.148036 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:26.147688    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq" podUID="a73cd840-56f9-4ffb-bd0f-f20c6ba5069b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Sep 07 13:21:27.151593 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:27.151562    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:21:27.151967 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:27.151937    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:21:27.152600 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:27.152583    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:21:27.761026 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:27.760999    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:21:29.880030 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:29.880000    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:21:33.537945 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:33.537913    2576 scope.go:117] "RemoveContainer" containerID="50d88c1b1cb0624fb145280455b25f5a9480319c1e3a7cd4dfebec8cec3f7631"
Sep 07 13:21:33.546147 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:33.546128    2576 scope.go:117] "RemoveContainer" containerID="b54f416e9f1fd66c194e9aa38a81708be2a37a6943c84d2b07bd004c514727f2"
Sep 07 13:21:33.553801 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:33.553759    2576 scope.go:117] "RemoveContainer" containerID="f5764d27da598502f7a1f8128cefaeec5d6858c2c91479ae9f0e803dc3e3b7ec"
Sep 07 13:21:35.870110 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:35.870075    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:21:43.651888 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:21:43.651854    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:22:01.678870 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:01.678803    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:22:06.996104 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:06.996069    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:22:09.318074 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:09.318043    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ede2050e-wrvbs"]
Sep 07 13:22:09.321494 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:09.321476    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ede2050e-wrvbs"
Sep 07 13:22:09.324062 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:09.324044    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jlvcf\""
Sep 07 13:22:09.324439 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:09.324423    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 13:22:09.329581 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:09.329562    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ede2050e-wrvbs"]
Sep 07 13:22:09.464056 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:09.464030    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a38a6fd-6dd2-4343-911d-5b1cbe4789aa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ede2050e-wrvbs\" (UID: \"9a38a6fd-6dd2-4343-911d-5b1cbe4789aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ede2050e-wrvbs"
Sep 07 13:22:09.564690 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:09.564656    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a38a6fd-6dd2-4343-911d-5b1cbe4789aa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ede2050e-wrvbs\" (UID: \"9a38a6fd-6dd2-4343-911d-5b1cbe4789aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ede2050e-wrvbs"
Sep 07 13:22:09.565481 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:09.565456    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a38a6fd-6dd2-4343-911d-5b1cbe4789aa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ede2050e-wrvbs\" (UID: \"9a38a6fd-6dd2-4343-911d-5b1cbe4789aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ede2050e-wrvbs"
Sep 07 13:22:09.632684 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:09.632653    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ede2050e-wrvbs"
Sep 07 13:22:09.941407 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:09.941381    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ede2050e-wrvbs"]
Sep 07 13:22:09.942890 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:22:09.942863    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a38a6fd_6dd2_4343_911d_5b1cbe4789aa.slice/crio-55d62e3216ce33b303b612e4ddafe167992ed584ddd719a8818a00881d9f8911 WatchSource:0}: Error finding container 55d62e3216ce33b303b612e4ddafe167992ed584ddd719a8818a00881d9f8911: Status 404 returned error can't find the container with id 55d62e3216ce33b303b612e4ddafe167992ed584ddd719a8818a00881d9f8911
Sep 07 13:22:10.124686 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:10.124660    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ede2050e-wrvbs" event={"ID":"9a38a6fd-6dd2-4343-911d-5b1cbe4789aa","Type":"ContainerStarted","Data":"55d62e3216ce33b303b612e4ddafe167992ed584ddd719a8818a00881d9f8911"}
Sep 07 13:22:11.131687 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:11.131658    2576 generic.go:356] "Generic (PLEG): container finished" podID="9a38a6fd-6dd2-4343-911d-5b1cbe4789aa" containerID="2ad87c6e382b21b51385d54b2588f7894f6ae542e5793972d35b8e50090329ca" exitCode=0
Sep 07 13:22:11.132030 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:11.131737    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ede2050e-wrvbs" event={"ID":"9a38a6fd-6dd2-4343-911d-5b1cbe4789aa","Type":"ContainerDied","Data":"2ad87c6e382b21b51385d54b2588f7894f6ae542e5793972d35b8e50090329ca"}
Sep 07 13:22:12.263729 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:12.263708    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ede2050e-wrvbs"
Sep 07 13:22:12.393067 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:12.393012    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a38a6fd-6dd2-4343-911d-5b1cbe4789aa-maas-api-service-ca\") pod \"9a38a6fd-6dd2-4343-911d-5b1cbe4789aa\" (UID: \"9a38a6fd-6dd2-4343-911d-5b1cbe4789aa\") "
Sep 07 13:22:12.393375 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:12.393355    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a38a6fd-6dd2-4343-911d-5b1cbe4789aa-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9a38a6fd-6dd2-4343-911d-5b1cbe4789aa" (UID: "9a38a6fd-6dd2-4343-911d-5b1cbe4789aa"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:22:12.493648 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:12.493623    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9a38a6fd-6dd2-4343-911d-5b1cbe4789aa-maas-api-service-ca\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:22:13.143056 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:13.143029    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ede2050e-wrvbs"
Sep 07 13:22:13.143168 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:13.143077    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ede2050e-wrvbs" event={"ID":"9a38a6fd-6dd2-4343-911d-5b1cbe4789aa","Type":"ContainerDied","Data":"55d62e3216ce33b303b612e4ddafe167992ed584ddd719a8818a00881d9f8911"}
Sep 07 13:22:13.143168 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:13.143142    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="55d62e3216ce33b303b612e4ddafe167992ed584ddd719a8818a00881d9f8911"
Sep 07 13:22:19.391006 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:19.390977    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:22:25.153400 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:25.153357    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:22:25.240549 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:25.240516    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:22:25.343234 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:25.343203    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:22:25.500999 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:25.500925    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ede2050e-wrvbs"]
Sep 07 13:22:25.506579 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:25.506512    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:22:25.510571 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:25.510543    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ede2050e-wrvbs"]
Sep 07 13:22:25.689706 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:25.689674    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:22:26.606026 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:26.605988    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:22:27.366212 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:27.366183    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a38a6fd-6dd2-4343-911d-5b1cbe4789aa" path="/var/lib/kubelet/pods/9a38a6fd-6dd2-4343-911d-5b1cbe4789aa/volumes"
Sep 07 13:22:28.749381 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:28.749349    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:22:28.860793 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:28.860756    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7256-eb6b30"]
Sep 07 13:22:28.861153 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:28.861141    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a38a6fd-6dd2-4343-911d-5b1cbe4789aa" containerName="revoke-keys"
Sep 07 13:22:28.861196 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:28.861154    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a38a6fd-6dd2-4343-911d-5b1cbe4789aa" containerName="revoke-keys"
Sep 07 13:22:28.861242 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:28.861233    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a38a6fd-6dd2-4343-911d-5b1cbe4789aa" containerName="revoke-keys"
Sep 07 13:22:28.864419 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:28.864404    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7256-eb6b30"
Sep 07 13:22:28.866939 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:28.866916    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-wb64r\""
Sep 07 13:22:28.876053 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:28.876030    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7256-eb6b30"]
Sep 07 13:22:28.925640 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:28.925620    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c88nn\" (UniqueName: \"kubernetes.io/projected/d4a34fbc-3d77-478a-9171-6749be1f04c7-kube-api-access-c88nn\") pod \"mt-curl-7256-eb6b30\" (UID: \"d4a34fbc-3d77-478a-9171-6749be1f04c7\") " pod="opendatahub/mt-curl-7256-eb6b30"
Sep 07 13:22:29.026216 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:29.026152    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c88nn\" (UniqueName: \"kubernetes.io/projected/d4a34fbc-3d77-478a-9171-6749be1f04c7-kube-api-access-c88nn\") pod \"mt-curl-7256-eb6b30\" (UID: \"d4a34fbc-3d77-478a-9171-6749be1f04c7\") " pod="opendatahub/mt-curl-7256-eb6b30"
Sep 07 13:22:29.035785 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:29.035750    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c88nn\" (UniqueName: \"kubernetes.io/projected/d4a34fbc-3d77-478a-9171-6749be1f04c7-kube-api-access-c88nn\") pod \"mt-curl-7256-eb6b30\" (UID: \"d4a34fbc-3d77-478a-9171-6749be1f04c7\") " pod="opendatahub/mt-curl-7256-eb6b30"
Sep 07 13:22:29.173977 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:29.173945    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7256-eb6b30"
Sep 07 13:22:29.445008 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:29.444986    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7256-eb6b30"]
Sep 07 13:22:29.447816 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:22:29.447789    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4a34fbc_3d77_478a_9171_6749be1f04c7.slice/crio-9eef18f2247554c6133aa6b7071a070d69946a0f337d7ccd765ca4ae86ed03e6 WatchSource:0}: Error finding container 9eef18f2247554c6133aa6b7071a070d69946a0f337d7ccd765ca4ae86ed03e6: Status 404 returned error can't find the container with id 9eef18f2247554c6133aa6b7071a070d69946a0f337d7ccd765ca4ae86ed03e6
Sep 07 13:22:30.239605 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:30.239580    2576 generic.go:356] "Generic (PLEG): container finished" podID="d4a34fbc-3d77-478a-9171-6749be1f04c7" containerID="6171b17936b11d4aa519b24a1cc219c2a70cc16bdf15cd8c626c5473b5198670" exitCode=0
Sep 07 13:22:30.239990 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:30.239647    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7256-eb6b30" event={"ID":"d4a34fbc-3d77-478a-9171-6749be1f04c7","Type":"ContainerDied","Data":"6171b17936b11d4aa519b24a1cc219c2a70cc16bdf15cd8c626c5473b5198670"}
Sep 07 13:22:30.239990 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:30.239672    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7256-eb6b30" event={"ID":"d4a34fbc-3d77-478a-9171-6749be1f04c7","Type":"ContainerStarted","Data":"9eef18f2247554c6133aa6b7071a070d69946a0f337d7ccd765ca4ae86ed03e6"}
Sep 07 13:22:31.376394 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:31.376366    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7256-eb6b30"
Sep 07 13:22:31.411018 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:31.410998    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7256-eb6b30_d4a34fbc-3d77-478a-9171-6749be1f04c7/mt-curl-7256-eb6b30/0.log"
Sep 07 13:22:31.437964 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:31.437936    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7256-eb6b30"]
Sep 07 13:22:31.443703 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:31.443682    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7256-eb6b30"]
Sep 07 13:22:31.447061 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:31.447043    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c88nn\" (UniqueName: \"kubernetes.io/projected/d4a34fbc-3d77-478a-9171-6749be1f04c7-kube-api-access-c88nn\") pod \"d4a34fbc-3d77-478a-9171-6749be1f04c7\" (UID: \"d4a34fbc-3d77-478a-9171-6749be1f04c7\") "
Sep 07 13:22:31.449118 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:31.449097    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4a34fbc-3d77-478a-9171-6749be1f04c7-kube-api-access-c88nn" (OuterVolumeSpecName: "kube-api-access-c88nn") pod "d4a34fbc-3d77-478a-9171-6749be1f04c7" (UID: "d4a34fbc-3d77-478a-9171-6749be1f04c7"). InnerVolumeSpecName "kube-api-access-c88nn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:22:31.548710 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:31.548662    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c88nn\" (UniqueName: \"kubernetes.io/projected/d4a34fbc-3d77-478a-9171-6749be1f04c7-kube-api-access-c88nn\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:22:32.251354 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:32.251334    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7256-eb6b30"
Sep 07 13:22:32.251497 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:32.251361    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9eef18f2247554c6133aa6b7071a070d69946a0f337d7ccd765ca4ae86ed03e6"
Sep 07 13:22:32.270138 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:22:32.270113    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7256-eb6b30\" is forbidden: User \"system:node:ip-10-0-142-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-74.ec2.internal' and this object" podUID="d4a34fbc-3d77-478a-9171-6749be1f04c7" pod="opendatahub/mt-curl-7256-eb6b30"
Sep 07 13:22:32.906376 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:32.906345    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:22:33.364760 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:22:33.364668    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7256-eb6b30\" is forbidden: User \"system:node:ip-10-0-142-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-74.ec2.internal' and this object" podUID="d4a34fbc-3d77-478a-9171-6749be1f04c7" pod="opendatahub/mt-curl-7256-eb6b30"
Sep 07 13:22:33.366642 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:33.366616    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4a34fbc-3d77-478a-9171-6749be1f04c7" path="/var/lib/kubelet/pods/d4a34fbc-3d77-478a-9171-6749be1f04c7/volumes"
Sep 07 13:22:33.587739 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:33.587716    2576 scope.go:117] "RemoveContainer" containerID="ff5d28ec2bda1bf0ecfaae21afb4f7226ba4d1be79ed6fec5cf0c9868e027e6d"
Sep 07 13:22:33.596108 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:33.596091    2576 scope.go:117] "RemoveContainer" containerID="1768b74a2893314b82614de7bd605b4113295be10e3ad99e497ee8b8bd8fb1d9"
Sep 07 13:22:33.603886 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:33.603855    2576 scope.go:117] "RemoveContainer" containerID="44460a24c2ebfbe197f2702a949b5108d10089f38160e449e7f2dfcaada3f91c"
Sep 07 13:22:33.797515 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:33.797480    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:22:33.884824 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:33.884794    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:22:38.373154 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:38.373126    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:22:38.797649 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:38.797618    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr"]
Sep 07 13:22:38.798034 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:38.798020    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4a34fbc-3d77-478a-9171-6749be1f04c7" containerName="mt-curl-7256-eb6b30"
Sep 07 13:22:38.798272 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:38.798036    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4a34fbc-3d77-478a-9171-6749be1f04c7" containerName="mt-curl-7256-eb6b30"
Sep 07 13:22:38.798272 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:38.798111    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4a34fbc-3d77-478a-9171-6749be1f04c7" containerName="mt-curl-7256-eb6b30"
Sep 07 13:22:38.802805 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:38.802790    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr"
Sep 07 13:22:38.806735 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:38.806715    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-5910bb\"/\"kube-root-ca.crt\""
Sep 07 13:22:38.807652 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:38.807637    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-5910bb\"/\"sub-test-model-5910bb-kserve-self-signed-certs\""
Sep 07 13:22:38.807722 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:38.807655    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-5910bb\"/\"openshift-service-ca.crt\""
Sep 07 13:22:38.807722 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:38.807657    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-5910bb\"/\"default-dockercfg-984gj\""
Sep 07 13:22:38.827195 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:38.827173    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr"]
Sep 07 13:22:38.892529 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:38.892500    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:22:38.903584 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:38.903560    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/033828b6-50f8-456f-9f48-1a84d8383b0c-dshm\") pod \"sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr\" (UID: \"033828b6-50f8-456f-9f48-1a84d8383b0c\") " pod="ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr"
Sep 07 13:22:38.903678 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:38.903595    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvz4x\" (UniqueName: \"kubernetes.io/projected/033828b6-50f8-456f-9f48-1a84d8383b0c-kube-api-access-qvz4x\") pod \"sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr\" (UID: \"033828b6-50f8-456f-9f48-1a84d8383b0c\") " pod="ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr"
Sep 07 13:22:38.903678 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:38.903632    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/033828b6-50f8-456f-9f48-1a84d8383b0c-model-cache\") pod \"sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr\" (UID: \"033828b6-50f8-456f-9f48-1a84d8383b0c\") " pod="ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr"
Sep 07 13:22:38.903797 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:38.903699    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/033828b6-50f8-456f-9f48-1a84d8383b0c-tls-certs\") pod \"sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr\" (UID: \"033828b6-50f8-456f-9f48-1a84d8383b0c\") " pod="ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr"
Sep 07 13:22:38.903855 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:38.903801    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/033828b6-50f8-456f-9f48-1a84d8383b0c-home\") pod \"sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr\" (UID: \"033828b6-50f8-456f-9f48-1a84d8383b0c\") " pod="ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr"
Sep 07 13:22:38.903913 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:38.903880    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/033828b6-50f8-456f-9f48-1a84d8383b0c-tmp-dir\") pod \"sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr\" (UID: \"033828b6-50f8-456f-9f48-1a84d8383b0c\") " pod="ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr"
Sep 07 13:22:39.004561 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:39.004538    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/033828b6-50f8-456f-9f48-1a84d8383b0c-tmp-dir\") pod \"sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr\" (UID: \"033828b6-50f8-456f-9f48-1a84d8383b0c\") " pod="ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr"
Sep 07 13:22:39.004662 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:39.004575    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/033828b6-50f8-456f-9f48-1a84d8383b0c-dshm\") pod \"sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr\" (UID: \"033828b6-50f8-456f-9f48-1a84d8383b0c\") " pod="ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr"
Sep 07 13:22:39.004662 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:39.004596    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvz4x\" (UniqueName: \"kubernetes.io/projected/033828b6-50f8-456f-9f48-1a84d8383b0c-kube-api-access-qvz4x\") pod \"sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr\" (UID: \"033828b6-50f8-456f-9f48-1a84d8383b0c\") " pod="ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr"
Sep 07 13:22:39.004662 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:39.004635    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/033828b6-50f8-456f-9f48-1a84d8383b0c-model-cache\") pod \"sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr\" (UID: \"033828b6-50f8-456f-9f48-1a84d8383b0c\") " pod="ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr"
Sep 07 13:22:39.004662 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:39.004660    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/033828b6-50f8-456f-9f48-1a84d8383b0c-tls-certs\") pod \"sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr\" (UID: \"033828b6-50f8-456f-9f48-1a84d8383b0c\") " pod="ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr"
Sep 07 13:22:39.004894 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:39.004709    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/033828b6-50f8-456f-9f48-1a84d8383b0c-home\") pod \"sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr\" (UID: \"033828b6-50f8-456f-9f48-1a84d8383b0c\") " pod="ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr"
Sep 07 13:22:39.005034 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:39.005015    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/033828b6-50f8-456f-9f48-1a84d8383b0c-tmp-dir\") pod \"sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr\" (UID: \"033828b6-50f8-456f-9f48-1a84d8383b0c\") " pod="ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr"
Sep 07 13:22:39.005088 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:39.005073    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/033828b6-50f8-456f-9f48-1a84d8383b0c-home\") pod \"sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr\" (UID: \"033828b6-50f8-456f-9f48-1a84d8383b0c\") " pod="ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr"
Sep 07 13:22:39.005121 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:39.005096    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/033828b6-50f8-456f-9f48-1a84d8383b0c-model-cache\") pod \"sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr\" (UID: \"033828b6-50f8-456f-9f48-1a84d8383b0c\") " pod="ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr"
Sep 07 13:22:39.006877 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:39.006859    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/033828b6-50f8-456f-9f48-1a84d8383b0c-dshm\") pod \"sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr\" (UID: \"033828b6-50f8-456f-9f48-1a84d8383b0c\") " pod="ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr"
Sep 07 13:22:39.007016 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:39.007000    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/033828b6-50f8-456f-9f48-1a84d8383b0c-tls-certs\") pod \"sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr\" (UID: \"033828b6-50f8-456f-9f48-1a84d8383b0c\") " pod="ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr"
Sep 07 13:22:39.016148 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:39.016131    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvz4x\" (UniqueName: \"kubernetes.io/projected/033828b6-50f8-456f-9f48-1a84d8383b0c-kube-api-access-qvz4x\") pod \"sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr\" (UID: \"033828b6-50f8-456f-9f48-1a84d8383b0c\") " pod="ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr"
Sep 07 13:22:39.111438 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:39.111360    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr"
Sep 07 13:22:39.391937 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:39.391914    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr"]
Sep 07 13:22:39.393979 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:22:39.393956    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod033828b6_50f8_456f_9f48_1a84d8383b0c.slice/crio-0bbd994fdd253bf1e317b769405064bea3890f11f9ae929f33049f74d2dbea88 WatchSource:0}: Error finding container 0bbd994fdd253bf1e317b769405064bea3890f11f9ae929f33049f74d2dbea88: Status 404 returned error can't find the container with id 0bbd994fdd253bf1e317b769405064bea3890f11f9ae929f33049f74d2dbea88
Sep 07 13:22:40.293475 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:40.293442    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr" event={"ID":"033828b6-50f8-456f-9f48-1a84d8383b0c","Type":"ContainerStarted","Data":"e6b3b485280b1e1ffc43f8c3c56154c0db270e09ef8d471a0643e859ff05a34b"}
Sep 07 13:22:40.293649 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:40.293485    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr" event={"ID":"033828b6-50f8-456f-9f48-1a84d8383b0c","Type":"ContainerStarted","Data":"0bbd994fdd253bf1e317b769405064bea3890f11f9ae929f33049f74d2dbea88"}
Sep 07 13:22:40.316936 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:40.316894    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr" podStartSLOduration=2.316877892 podStartE2EDuration="2.316877892s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:22:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:22:40.314572674 +0000 UTC m=+1387.371454330" watchObservedRunningTime="2026-09-07 13:22:40.316877892 +0000 UTC m=+1387.373759548"
Sep 07 13:22:49.111799 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:49.111752    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr"
Sep 07 13:22:49.112145 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:49.111819    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr"
Sep 07 13:22:49.123564 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:49.123542    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr"
Sep 07 13:22:49.353448 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:49.353417    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr"
Sep 07 13:22:52.654205 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:22:52.654176    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:23:02.287518 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:02.287481    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:23:08.863624 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:08.863594    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:23:11.564394 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:11.564361    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:23:12.062570 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:12.062525    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:23:18.328871 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:18.328838    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:23:24.677880 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:24.677804    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:23:24.779533 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:24.779491    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:23:24.936845 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:24.933876    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"]
Sep 07 13:23:24.936845 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:24.934216    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq" podUID="a73cd840-56f9-4ffb-bd0f-f20c6ba5069b" containerName="istio-proxy" containerID="cri-o://eb2ea4027f88db3d4e89ef398af3e03e2b0d09b8f2df80c17fd2246ddb21a028" gracePeriod=30
Sep 07 13:23:24.965397 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:24.965362    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:23:26.231243 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:26.231217    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:23:26.360615 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:26.360581    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:23:26.621434 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:26.621364    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:23:27.154370 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:27.154343    2576 patch_prober.go:28] interesting pod/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 07 13:23:27.154492 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:27.154399    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq" podUID="a73cd840-56f9-4ffb-bd0f-f20c6ba5069b" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 07 13:23:27.256147 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:27.256118    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:23:27.469389 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:27.469332    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:23:28.729449 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:28.729421    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:23:28.886749 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:28.886716    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:23:30.192383 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.192361    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:23:30.227195 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.227144    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-istio-token\") pod \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") "
Sep 07 13:23:30.227300 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.227198    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-credential-socket\") pod \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") "
Sep 07 13:23:30.227300 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.227227    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-workload-certs\") pod \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") "
Sep 07 13:23:30.227300 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.227266    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-workload-socket\") pod \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") "
Sep 07 13:23:30.227300 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.227295    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-istiod-ca-cert\") pod \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") "
Sep 07 13:23:30.227501 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.227339    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-istio-envoy\") pod \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") "
Sep 07 13:23:30.227501 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.227364    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-istio-data\") pod \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") "
Sep 07 13:23:30.227501 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.227465    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-istio-podinfo\") pod \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") "
Sep 07 13:23:30.227652 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.227517    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gg6lg\" (UniqueName: \"kubernetes.io/projected/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-kube-api-access-gg6lg\") pod \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\" (UID: \"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b\") "
Sep 07 13:23:30.227652 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.227521    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a73cd840-56f9-4ffb-bd0f-f20c6ba5069b" (UID: "a73cd840-56f9-4ffb-bd0f-f20c6ba5069b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:23:30.227652 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.227594    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a73cd840-56f9-4ffb-bd0f-f20c6ba5069b" (UID: "a73cd840-56f9-4ffb-bd0f-f20c6ba5069b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:23:30.227856 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.227666    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a73cd840-56f9-4ffb-bd0f-f20c6ba5069b" (UID: "a73cd840-56f9-4ffb-bd0f-f20c6ba5069b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:23:30.227911 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.227867    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-istio-data" (OuterVolumeSpecName: "istio-data") pod "a73cd840-56f9-4ffb-bd0f-f20c6ba5069b" (UID: "a73cd840-56f9-4ffb-bd0f-f20c6ba5069b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:23:30.227982 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.227964    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-credential-socket\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:23:30.228037 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.227988    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-workload-certs\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:23:30.228037 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.228003    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-workload-socket\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:23:30.228037 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.228016    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-istio-data\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:23:30.228191 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.228164    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a73cd840-56f9-4ffb-bd0f-f20c6ba5069b" (UID: "a73cd840-56f9-4ffb-bd0f-f20c6ba5069b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:23:30.230548 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.230491    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a73cd840-56f9-4ffb-bd0f-f20c6ba5069b" (UID: "a73cd840-56f9-4ffb-bd0f-f20c6ba5069b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 13:23:30.230548 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.230493    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a73cd840-56f9-4ffb-bd0f-f20c6ba5069b" (UID: "a73cd840-56f9-4ffb-bd0f-f20c6ba5069b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:23:30.230703 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.230587    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-kube-api-access-gg6lg" (OuterVolumeSpecName: "kube-api-access-gg6lg") pod "a73cd840-56f9-4ffb-bd0f-f20c6ba5069b" (UID: "a73cd840-56f9-4ffb-bd0f-f20c6ba5069b"). InnerVolumeSpecName "kube-api-access-gg6lg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:23:30.239274 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.231553    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-istio-token" (OuterVolumeSpecName: "istio-token") pod "a73cd840-56f9-4ffb-bd0f-f20c6ba5069b" (UID: "a73cd840-56f9-4ffb-bd0f-f20c6ba5069b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:23:30.329005 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.328980    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-istio-token\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:23:30.329005 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.329005    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-istiod-ca-cert\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:23:30.329180 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.329017    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-istio-envoy\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:23:30.329180 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.329028    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-istio-podinfo\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:23:30.329180 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.329063    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gg6lg\" (UniqueName: \"kubernetes.io/projected/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b-kube-api-access-gg6lg\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:23:30.554189 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.554112    2576 generic.go:356] "Generic (PLEG): container finished" podID="a73cd840-56f9-4ffb-bd0f-f20c6ba5069b" containerID="eb2ea4027f88db3d4e89ef398af3e03e2b0d09b8f2df80c17fd2246ddb21a028" exitCode=0
Sep 07 13:23:30.554189 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.554180    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"
Sep 07 13:23:30.554376 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.554192    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq" event={"ID":"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b","Type":"ContainerDied","Data":"eb2ea4027f88db3d4e89ef398af3e03e2b0d09b8f2df80c17fd2246ddb21a028"}
Sep 07 13:23:30.554376 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.554245    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq" event={"ID":"a73cd840-56f9-4ffb-bd0f-f20c6ba5069b","Type":"ContainerDied","Data":"29a208491534bc85ddf16b6eb67d459593b86eb5e0a1e75f4cc37d59e6bfe24e"}
Sep 07 13:23:30.554376 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.554267    2576 scope.go:117] "RemoveContainer" containerID="eb2ea4027f88db3d4e89ef398af3e03e2b0d09b8f2df80c17fd2246ddb21a028"
Sep 07 13:23:30.563707 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.563691    2576 scope.go:117] "RemoveContainer" containerID="eb76d519be75ae3bacd5f59c106bf6ea3d56ebf3f922af6a5715a4fcd44fb0aa"
Sep 07 13:23:30.573073 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.573050    2576 scope.go:117] "RemoveContainer" containerID="eb2ea4027f88db3d4e89ef398af3e03e2b0d09b8f2df80c17fd2246ddb21a028"
Sep 07 13:23:30.573374 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:23:30.573352    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb2ea4027f88db3d4e89ef398af3e03e2b0d09b8f2df80c17fd2246ddb21a028\": container with ID starting with eb2ea4027f88db3d4e89ef398af3e03e2b0d09b8f2df80c17fd2246ddb21a028 not found: ID does not exist" containerID="eb2ea4027f88db3d4e89ef398af3e03e2b0d09b8f2df80c17fd2246ddb21a028"
Sep 07 13:23:30.573445 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.573386    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb2ea4027f88db3d4e89ef398af3e03e2b0d09b8f2df80c17fd2246ddb21a028"} err="failed to get container status \"eb2ea4027f88db3d4e89ef398af3e03e2b0d09b8f2df80c17fd2246ddb21a028\": rpc error: code = NotFound desc = could not find container \"eb2ea4027f88db3d4e89ef398af3e03e2b0d09b8f2df80c17fd2246ddb21a028\": container with ID starting with eb2ea4027f88db3d4e89ef398af3e03e2b0d09b8f2df80c17fd2246ddb21a028 not found: ID does not exist"
Sep 07 13:23:30.573445 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.573408    2576 scope.go:117] "RemoveContainer" containerID="eb76d519be75ae3bacd5f59c106bf6ea3d56ebf3f922af6a5715a4fcd44fb0aa"
Sep 07 13:23:30.573671 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:23:30.573652    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb76d519be75ae3bacd5f59c106bf6ea3d56ebf3f922af6a5715a4fcd44fb0aa\": container with ID starting with eb76d519be75ae3bacd5f59c106bf6ea3d56ebf3f922af6a5715a4fcd44fb0aa not found: ID does not exist" containerID="eb76d519be75ae3bacd5f59c106bf6ea3d56ebf3f922af6a5715a4fcd44fb0aa"
Sep 07 13:23:30.573721 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.573676    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb76d519be75ae3bacd5f59c106bf6ea3d56ebf3f922af6a5715a4fcd44fb0aa"} err="failed to get container status \"eb76d519be75ae3bacd5f59c106bf6ea3d56ebf3f922af6a5715a4fcd44fb0aa\": rpc error: code = NotFound desc = could not find container \"eb76d519be75ae3bacd5f59c106bf6ea3d56ebf3f922af6a5715a4fcd44fb0aa\": container with ID starting with eb76d519be75ae3bacd5f59c106bf6ea3d56ebf3f922af6a5715a4fcd44fb0aa not found: ID does not exist"
Sep 07 13:23:30.582340 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.582314    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"]
Sep 07 13:23:30.588350 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:30.588329    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-ede2050e-openshift-default-5fd477f964-z48pq"]
Sep 07 13:23:31.366739 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:31.366707    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a73cd840-56f9-4ffb-bd0f-f20c6ba5069b" path="/var/lib/kubelet/pods/a73cd840-56f9-4ffb-bd0f-f20c6ba5069b/volumes"
Sep 07 13:23:36.305685 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:36.305655    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:23:36.441417 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:36.441387    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:23:37.098442 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:37.098407    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:23:43.131847 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:43.131813    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7256-6f4317"]
Sep 07 13:23:43.132249 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:43.132228    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a73cd840-56f9-4ffb-bd0f-f20c6ba5069b" containerName="istio-proxy"
Sep 07 13:23:43.132249 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:43.132241    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a73cd840-56f9-4ffb-bd0f-f20c6ba5069b" containerName="istio-proxy"
Sep 07 13:23:43.132335 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:43.132322    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a73cd840-56f9-4ffb-bd0f-f20c6ba5069b" containerName="istio-proxy"
Sep 07 13:23:43.132369 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:43.132338    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a73cd840-56f9-4ffb-bd0f-f20c6ba5069b" containerName="istio-proxy"
Sep 07 13:23:43.136571 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:43.136556    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7256-6f4317"
Sep 07 13:23:43.139260 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:43.139242    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-wb64r\""
Sep 07 13:23:43.145484 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:43.145463    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7256-6f4317"]
Sep 07 13:23:43.232761 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:43.232731    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x7gj\" (UniqueName: \"kubernetes.io/projected/0fbe9796-9c70-475f-b59c-05ca7f6abc72-kube-api-access-4x7gj\") pod \"mt-curl-7256-6f4317\" (UID: \"0fbe9796-9c70-475f-b59c-05ca7f6abc72\") " pod="opendatahub/mt-curl-7256-6f4317"
Sep 07 13:23:43.334113 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:43.334084    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x7gj\" (UniqueName: \"kubernetes.io/projected/0fbe9796-9c70-475f-b59c-05ca7f6abc72-kube-api-access-4x7gj\") pod \"mt-curl-7256-6f4317\" (UID: \"0fbe9796-9c70-475f-b59c-05ca7f6abc72\") " pod="opendatahub/mt-curl-7256-6f4317"
Sep 07 13:23:43.348523 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:43.348501    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x7gj\" (UniqueName: \"kubernetes.io/projected/0fbe9796-9c70-475f-b59c-05ca7f6abc72-kube-api-access-4x7gj\") pod \"mt-curl-7256-6f4317\" (UID: \"0fbe9796-9c70-475f-b59c-05ca7f6abc72\") " pod="opendatahub/mt-curl-7256-6f4317"
Sep 07 13:23:43.446139 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:43.446085    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7256-6f4317"
Sep 07 13:23:43.730511 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:43.730489    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7256-6f4317"]
Sep 07 13:23:43.732092 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:23:43.732066    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0fbe9796_9c70_475f_b59c_05ca7f6abc72.slice/crio-9d87c2a73629b57e19d9d909db58f01ab12de1efab2e7da3b64da815bbfe9003 WatchSource:0}: Error finding container 9d87c2a73629b57e19d9d909db58f01ab12de1efab2e7da3b64da815bbfe9003: Status 404 returned error can't find the container with id 9d87c2a73629b57e19d9d909db58f01ab12de1efab2e7da3b64da815bbfe9003
Sep 07 13:23:43.997698 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:43.997641    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:23:44.117506 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:44.117468    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:23:44.236780 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:44.236743    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:23:44.624005 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:44.623983    2576 generic.go:356] "Generic (PLEG): container finished" podID="0fbe9796-9c70-475f-b59c-05ca7f6abc72" containerID="e75af9491bda8c0e990a3c23db3fecea270ee16fad9560cabb8ede1ff21b1716" exitCode=0
Sep 07 13:23:44.624118 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:44.624071    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7256-6f4317" event={"ID":"0fbe9796-9c70-475f-b59c-05ca7f6abc72","Type":"ContainerDied","Data":"e75af9491bda8c0e990a3c23db3fecea270ee16fad9560cabb8ede1ff21b1716"}
Sep 07 13:23:44.624118 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:44.624108    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7256-6f4317" event={"ID":"0fbe9796-9c70-475f-b59c-05ca7f6abc72","Type":"ContainerStarted","Data":"9d87c2a73629b57e19d9d909db58f01ab12de1efab2e7da3b64da815bbfe9003"}
Sep 07 13:23:45.757278 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:45.757259    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7256-6f4317"
Sep 07 13:23:45.778990 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:45.778953    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7256-6f4317_0fbe9796-9c70-475f-b59c-05ca7f6abc72/mt-curl-7256-6f4317/0.log"
Sep 07 13:23:45.802681 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:45.802652    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7256-6f4317"]
Sep 07 13:23:45.806239 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:45.806218    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7256-6f4317"]
Sep 07 13:23:45.857727 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:45.857704    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4x7gj\" (UniqueName: \"kubernetes.io/projected/0fbe9796-9c70-475f-b59c-05ca7f6abc72-kube-api-access-4x7gj\") pod \"0fbe9796-9c70-475f-b59c-05ca7f6abc72\" (UID: \"0fbe9796-9c70-475f-b59c-05ca7f6abc72\") "
Sep 07 13:23:45.859734 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:45.859712    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fbe9796-9c70-475f-b59c-05ca7f6abc72-kube-api-access-4x7gj" (OuterVolumeSpecName: "kube-api-access-4x7gj") pod "0fbe9796-9c70-475f-b59c-05ca7f6abc72" (UID: "0fbe9796-9c70-475f-b59c-05ca7f6abc72"). InnerVolumeSpecName "kube-api-access-4x7gj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:23:45.932437 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:45.932385    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7256-64372c"]
Sep 07 13:23:45.932728 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:45.932715    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fbe9796-9c70-475f-b59c-05ca7f6abc72" containerName="mt-curl-7256-6f4317"
Sep 07 13:23:45.932791 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:45.932729    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fbe9796-9c70-475f-b59c-05ca7f6abc72" containerName="mt-curl-7256-6f4317"
Sep 07 13:23:45.932791 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:45.932755    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a73cd840-56f9-4ffb-bd0f-f20c6ba5069b" containerName="istio-proxy"
Sep 07 13:23:45.932791 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:45.932761    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a73cd840-56f9-4ffb-bd0f-f20c6ba5069b" containerName="istio-proxy"
Sep 07 13:23:45.932884 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:45.932837    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fbe9796-9c70-475f-b59c-05ca7f6abc72" containerName="mt-curl-7256-6f4317"
Sep 07 13:23:45.935694 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:45.935679    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7256-64372c"
Sep 07 13:23:45.942170 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:45.942151    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7256-64372c"]
Sep 07 13:23:45.959284 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:45.959259    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4x7gj\" (UniqueName: \"kubernetes.io/projected/0fbe9796-9c70-475f-b59c-05ca7f6abc72-kube-api-access-4x7gj\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:23:46.060065 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:46.060042    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xd22g\" (UniqueName: \"kubernetes.io/projected/cc5636be-0afd-4d89-89fb-300845821215-kube-api-access-xd22g\") pod \"mt-curl-7256-64372c\" (UID: \"cc5636be-0afd-4d89-89fb-300845821215\") " pod="opendatahub/mt-curl-7256-64372c"
Sep 07 13:23:46.161109 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:46.161087    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xd22g\" (UniqueName: \"kubernetes.io/projected/cc5636be-0afd-4d89-89fb-300845821215-kube-api-access-xd22g\") pod \"mt-curl-7256-64372c\" (UID: \"cc5636be-0afd-4d89-89fb-300845821215\") " pod="opendatahub/mt-curl-7256-64372c"
Sep 07 13:23:46.169996 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:46.169973    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xd22g\" (UniqueName: \"kubernetes.io/projected/cc5636be-0afd-4d89-89fb-300845821215-kube-api-access-xd22g\") pod \"mt-curl-7256-64372c\" (UID: \"cc5636be-0afd-4d89-89fb-300845821215\") " pod="opendatahub/mt-curl-7256-64372c"
Sep 07 13:23:46.245634 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:46.245584    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7256-64372c"
Sep 07 13:23:46.513919 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:46.513896    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7256-64372c"]
Sep 07 13:23:46.515777 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:23:46.515742    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc5636be_0afd_4d89_89fb_300845821215.slice/crio-3ac355917df7f2b9b0d7d314fb0f50b9164ae5474949cd0d652d25ae6dc63a87 WatchSource:0}: Error finding container 3ac355917df7f2b9b0d7d314fb0f50b9164ae5474949cd0d652d25ae6dc63a87: Status 404 returned error can't find the container with id 3ac355917df7f2b9b0d7d314fb0f50b9164ae5474949cd0d652d25ae6dc63a87
Sep 07 13:23:46.636683 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:46.636659    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7256-64372c" event={"ID":"cc5636be-0afd-4d89-89fb-300845821215","Type":"ContainerStarted","Data":"3ac355917df7f2b9b0d7d314fb0f50b9164ae5474949cd0d652d25ae6dc63a87"}
Sep 07 13:23:46.637850 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:46.637833    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d87c2a73629b57e19d9d909db58f01ab12de1efab2e7da3b64da815bbfe9003"
Sep 07 13:23:46.637932 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:46.637870    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7256-6f4317"
Sep 07 13:23:46.647213 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:23:46.647190    2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7256-6f4317\" is forbidden: User \"system:node:ip-10-0-142-74.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-142-74.ec2.internal' and this object" podUID="0fbe9796-9c70-475f-b59c-05ca7f6abc72" pod="opendatahub/mt-curl-7256-6f4317"
Sep 07 13:23:47.366520 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:47.366493    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fbe9796-9c70-475f-b59c-05ca7f6abc72" path="/var/lib/kubelet/pods/0fbe9796-9c70-475f-b59c-05ca7f6abc72/volumes"
Sep 07 13:23:47.643900 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:47.643879    2576 generic.go:356] "Generic (PLEG): container finished" podID="cc5636be-0afd-4d89-89fb-300845821215" containerID="d69190a53f513d004100ec969cad2712e41c9084429bf3547e7094050dca21a3" exitCode=0
Sep 07 13:23:47.644009 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:47.643950    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7256-64372c" event={"ID":"cc5636be-0afd-4d89-89fb-300845821215","Type":"ContainerDied","Data":"d69190a53f513d004100ec969cad2712e41c9084429bf3547e7094050dca21a3"}
Sep 07 13:23:48.775709 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:48.775686    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7256-64372c"
Sep 07 13:23:48.805221 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:48.805144    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7256-64372c_cc5636be-0afd-4d89-89fb-300845821215/mt-curl-7256-64372c/0.log"
Sep 07 13:23:48.835296 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:48.835275    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7256-64372c"]
Sep 07 13:23:48.840814 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:48.840794    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7256-64372c"]
Sep 07 13:23:48.861176 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:48.861151    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:23:48.883808 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:48.883786    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xd22g\" (UniqueName: \"kubernetes.io/projected/cc5636be-0afd-4d89-89fb-300845821215-kube-api-access-xd22g\") pod \"cc5636be-0afd-4d89-89fb-300845821215\" (UID: \"cc5636be-0afd-4d89-89fb-300845821215\") "
Sep 07 13:23:48.885740 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:48.885720    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc5636be-0afd-4d89-89fb-300845821215-kube-api-access-xd22g" (OuterVolumeSpecName: "kube-api-access-xd22g") pod "cc5636be-0afd-4d89-89fb-300845821215" (UID: "cc5636be-0afd-4d89-89fb-300845821215"). InnerVolumeSpecName "kube-api-access-xd22g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:23:48.985334 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:48.985287    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xd22g\" (UniqueName: \"kubernetes.io/projected/cc5636be-0afd-4d89-89fb-300845821215-kube-api-access-xd22g\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:23:49.368295 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:49.368188    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc5636be-0afd-4d89-89fb-300845821215" path="/var/lib/kubelet/pods/cc5636be-0afd-4d89-89fb-300845821215/volumes"
Sep 07 13:23:49.655462 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:49.655439    2576 scope.go:117] "RemoveContainer" containerID="d69190a53f513d004100ec969cad2712e41c9084429bf3547e7094050dca21a3"
Sep 07 13:23:49.655598 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:49.655476    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7256-64372c"
Sep 07 13:23:50.950136 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:50.950110    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr"]
Sep 07 13:23:50.976852 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:50.976824    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:23:51.778033 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:51.777993    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:23:54.674482 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:54.674450    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:23:54.908576 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:23:54.908548    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:24:01.575149 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:01.575115    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:24:02.914832 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:02.914797    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:24:05.968761 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:05.968721    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr" podUID="033828b6-50f8-456f-9f48-1a84d8383b0c" containerName="main" containerID="cri-o://e6b3b485280b1e1ffc43f8c3c56154c0db270e09ef8d471a0643e859ff05a34b" gracePeriod=45
Sep 07 13:24:06.223559 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:06.223506    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr"
Sep 07 13:24:06.326674 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:06.326651    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvz4x\" (UniqueName: \"kubernetes.io/projected/033828b6-50f8-456f-9f48-1a84d8383b0c-kube-api-access-qvz4x\") pod \"033828b6-50f8-456f-9f48-1a84d8383b0c\" (UID: \"033828b6-50f8-456f-9f48-1a84d8383b0c\") "
Sep 07 13:24:06.326674 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:06.326677    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/033828b6-50f8-456f-9f48-1a84d8383b0c-home\") pod \"033828b6-50f8-456f-9f48-1a84d8383b0c\" (UID: \"033828b6-50f8-456f-9f48-1a84d8383b0c\") "
Sep 07 13:24:06.326896 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:06.326707    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/033828b6-50f8-456f-9f48-1a84d8383b0c-tls-certs\") pod \"033828b6-50f8-456f-9f48-1a84d8383b0c\" (UID: \"033828b6-50f8-456f-9f48-1a84d8383b0c\") "
Sep 07 13:24:06.326896 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:06.326725    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/033828b6-50f8-456f-9f48-1a84d8383b0c-tmp-dir\") pod \"033828b6-50f8-456f-9f48-1a84d8383b0c\" (UID: \"033828b6-50f8-456f-9f48-1a84d8383b0c\") "
Sep 07 13:24:06.326896 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:06.326751    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/033828b6-50f8-456f-9f48-1a84d8383b0c-model-cache\") pod \"033828b6-50f8-456f-9f48-1a84d8383b0c\" (UID: \"033828b6-50f8-456f-9f48-1a84d8383b0c\") "
Sep 07 13:24:06.326896 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:06.326801    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/033828b6-50f8-456f-9f48-1a84d8383b0c-dshm\") pod \"033828b6-50f8-456f-9f48-1a84d8383b0c\" (UID: \"033828b6-50f8-456f-9f48-1a84d8383b0c\") "
Sep 07 13:24:06.327094 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:06.326973    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/033828b6-50f8-456f-9f48-1a84d8383b0c-home" (OuterVolumeSpecName: "home") pod "033828b6-50f8-456f-9f48-1a84d8383b0c" (UID: "033828b6-50f8-456f-9f48-1a84d8383b0c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:24:06.327094 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:06.326967    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/033828b6-50f8-456f-9f48-1a84d8383b0c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "033828b6-50f8-456f-9f48-1a84d8383b0c" (UID: "033828b6-50f8-456f-9f48-1a84d8383b0c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:24:06.327094 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:06.327052    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/033828b6-50f8-456f-9f48-1a84d8383b0c-model-cache" (OuterVolumeSpecName: "model-cache") pod "033828b6-50f8-456f-9f48-1a84d8383b0c" (UID: "033828b6-50f8-456f-9f48-1a84d8383b0c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:24:06.327197 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:06.327114    2576 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/033828b6-50f8-456f-9f48-1a84d8383b0c-home\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:24:06.327197 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:06.327128    2576 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/033828b6-50f8-456f-9f48-1a84d8383b0c-tmp-dir\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:24:06.327197 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:06.327142    2576 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/033828b6-50f8-456f-9f48-1a84d8383b0c-model-cache\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:24:06.329011 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:06.328991    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/033828b6-50f8-456f-9f48-1a84d8383b0c-dshm" (OuterVolumeSpecName: "dshm") pod "033828b6-50f8-456f-9f48-1a84d8383b0c" (UID: "033828b6-50f8-456f-9f48-1a84d8383b0c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:24:06.329206 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:06.329191    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/033828b6-50f8-456f-9f48-1a84d8383b0c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "033828b6-50f8-456f-9f48-1a84d8383b0c" (UID: "033828b6-50f8-456f-9f48-1a84d8383b0c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:24:06.329272 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:06.329212    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/033828b6-50f8-456f-9f48-1a84d8383b0c-kube-api-access-qvz4x" (OuterVolumeSpecName: "kube-api-access-qvz4x") pod "033828b6-50f8-456f-9f48-1a84d8383b0c" (UID: "033828b6-50f8-456f-9f48-1a84d8383b0c"). InnerVolumeSpecName "kube-api-access-qvz4x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:24:06.428172 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:06.428153    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvz4x\" (UniqueName: \"kubernetes.io/projected/033828b6-50f8-456f-9f48-1a84d8383b0c-kube-api-access-qvz4x\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:24:06.428172 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:06.428172    2576 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/033828b6-50f8-456f-9f48-1a84d8383b0c-tls-certs\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:24:06.428292 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:06.428181    2576 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/033828b6-50f8-456f-9f48-1a84d8383b0c-dshm\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:24:06.745153 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:06.745126    2576 generic.go:356] "Generic (PLEG): container finished" podID="033828b6-50f8-456f-9f48-1a84d8383b0c" containerID="e6b3b485280b1e1ffc43f8c3c56154c0db270e09ef8d471a0643e859ff05a34b" exitCode=0
Sep 07 13:24:06.745240 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:06.745166    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr"
Sep 07 13:24:06.745240 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:06.745213    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr" event={"ID":"033828b6-50f8-456f-9f48-1a84d8383b0c","Type":"ContainerDied","Data":"e6b3b485280b1e1ffc43f8c3c56154c0db270e09ef8d471a0643e859ff05a34b"}
Sep 07 13:24:06.745319 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:06.745252    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr" event={"ID":"033828b6-50f8-456f-9f48-1a84d8383b0c","Type":"ContainerDied","Data":"0bbd994fdd253bf1e317b769405064bea3890f11f9ae929f33049f74d2dbea88"}
Sep 07 13:24:06.745319 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:06.745270    2576 scope.go:117] "RemoveContainer" containerID="e6b3b485280b1e1ffc43f8c3c56154c0db270e09ef8d471a0643e859ff05a34b"
Sep 07 13:24:06.753762 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:06.753746    2576 scope.go:117] "RemoveContainer" containerID="e6b3b485280b1e1ffc43f8c3c56154c0db270e09ef8d471a0643e859ff05a34b"
Sep 07 13:24:06.754041 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:24:06.754025    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6b3b485280b1e1ffc43f8c3c56154c0db270e09ef8d471a0643e859ff05a34b\": container with ID starting with e6b3b485280b1e1ffc43f8c3c56154c0db270e09ef8d471a0643e859ff05a34b not found: ID does not exist" containerID="e6b3b485280b1e1ffc43f8c3c56154c0db270e09ef8d471a0643e859ff05a34b"
Sep 07 13:24:06.754105 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:06.754052    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6b3b485280b1e1ffc43f8c3c56154c0db270e09ef8d471a0643e859ff05a34b"} err="failed to get container status \"e6b3b485280b1e1ffc43f8c3c56154c0db270e09ef8d471a0643e859ff05a34b\": rpc error: code = NotFound desc = could not find container \"e6b3b485280b1e1ffc43f8c3c56154c0db270e09ef8d471a0643e859ff05a34b\": container with ID starting with e6b3b485280b1e1ffc43f8c3c56154c0db270e09ef8d471a0643e859ff05a34b not found: ID does not exist"
Sep 07 13:24:06.774220 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:06.774202    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr"]
Sep 07 13:24:06.777249 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:06.777231    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-5910bb/sub-test-model-5910bb-kserve-7b88d8f6d9-vwxtr"]
Sep 07 13:24:07.372923 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:07.372882    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="033828b6-50f8-456f-9f48-1a84d8383b0c" path="/var/lib/kubelet/pods/033828b6-50f8-456f-9f48-1a84d8383b0c/volumes"
Sep 07 13:24:07.861879 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:07.861829    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:24:10.293229 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:10.293193    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:24:11.848166 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:11.848134    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:24:15.852888 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:15.852855    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:24:15.956602 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:15.956571    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:24:20.640377 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:20.640317    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:24:22.575201 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:22.575169    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:24:22.741221 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:22.741187    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:24:22.887819 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:22.887791    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:24:23.207795 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.207693    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"]
Sep 07 13:24:23.208112 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.208096    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc5636be-0afd-4d89-89fb-300845821215" containerName="mt-curl-7256-64372c"
Sep 07 13:24:23.208152 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.208118    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc5636be-0afd-4d89-89fb-300845821215" containerName="mt-curl-7256-64372c"
Sep 07 13:24:23.208152 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.208131    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="033828b6-50f8-456f-9f48-1a84d8383b0c" containerName="main"
Sep 07 13:24:23.208152 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.208137    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="033828b6-50f8-456f-9f48-1a84d8383b0c" containerName="main"
Sep 07 13:24:23.208243 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.208208    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc5636be-0afd-4d89-89fb-300845821215" containerName="mt-curl-7256-64372c"
Sep 07 13:24:23.208243 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.208219    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="033828b6-50f8-456f-9f48-1a84d8383b0c" containerName="main"
Sep 07 13:24:23.212633 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.212618    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:23.216459 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.216440    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-00fbc4-openshift-default-dockercfg-rmnmx\""
Sep 07 13:24:23.226645 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.226622    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"]
Sep 07 13:24:23.230080 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.230038    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:24:23.262394 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.262375    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-workload-socket\") pod \"e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") " pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:23.262507 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.262400    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-istio-data\") pod \"e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") " pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:23.262507 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.262424    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-istio-podinfo\") pod \"e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") " pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:23.262507 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.262489    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-istio-envoy\") pod \"e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") " pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:23.262699 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.262511    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-workload-certs\") pod \"e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") " pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:23.262699 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.262555    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppz2q\" (UniqueName: \"kubernetes.io/projected/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-kube-api-access-ppz2q\") pod \"e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") " pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:23.262699 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.262595    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-istio-token\") pod \"e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") " pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:23.262699 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.262640    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-credential-socket\") pod \"e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") " pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:23.262699 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.262691    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-istiod-ca-cert\") pod \"e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") " pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:23.363188 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.363162    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-istio-envoy\") pod \"e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") " pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:23.363372 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.363195    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-workload-certs\") pod \"e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") " pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:23.363372 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.363224    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppz2q\" (UniqueName: \"kubernetes.io/projected/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-kube-api-access-ppz2q\") pod \"e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") " pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:23.363372 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.363252    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-istio-token\") pod \"e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") " pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:23.363372 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.363267    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-credential-socket\") pod \"e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") " pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:23.363372 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.363291    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-istiod-ca-cert\") pod \"e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") " pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:23.363372 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.363310    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-workload-socket\") pod \"e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") " pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:23.363372 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.363329    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-istio-data\") pod \"e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") " pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:23.363372 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.363366    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-istio-podinfo\") pod \"e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") " pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:23.363798 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.363731    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-credential-socket\") pod \"e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") " pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:23.363989 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.363964    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-workload-socket\") pod \"e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") " pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:23.364145 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.364121    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-istio-data\") pod \"e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") " pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:23.364227 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.364209    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-istiod-ca-cert\") pod \"e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") " pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:23.364282 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.364259    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-workload-certs\") pod \"e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") " pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:23.365674 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.365651    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-istio-envoy\") pod \"e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") " pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:23.365799 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.365752    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-istio-podinfo\") pod \"e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") " pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:23.371524 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.371504    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppz2q\" (UniqueName: \"kubernetes.io/projected/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-kube-api-access-ppz2q\") pod \"e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") " pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:23.372987 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.372964    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-istio-token\") pod \"e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") " pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:23.522279 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.522224    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:23.677963 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.677931    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:24:23.801535 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.801462    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"]
Sep 07 13:24:23.804861 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:24:23.804834    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ac9b63c_0726_42cc_b361_1a5b4e5ac920.slice/crio-a743c145d9f7ed525950ba57b7a51799a5b861f73ea76edfe75fc4cdfb479006 WatchSource:0}: Error finding container a743c145d9f7ed525950ba57b7a51799a5b861f73ea76edfe75fc4cdfb479006: Status 404 returned error can't find the container with id a743c145d9f7ed525950ba57b7a51799a5b861f73ea76edfe75fc4cdfb479006
Sep 07 13:24:23.807006 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.806970    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:24:23.807083 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.807043    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:24:23.807083 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.807073    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:24:23.830374 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:23.830352    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9" event={"ID":"5ac9b63c-0726-42cc-b361-1a5b4e5ac920","Type":"ContainerStarted","Data":"a743c145d9f7ed525950ba57b7a51799a5b861f73ea76edfe75fc4cdfb479006"}
Sep 07 13:24:24.837585 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:24.837552    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9" event={"ID":"5ac9b63c-0726-42cc-b361-1a5b4e5ac920","Type":"ContainerStarted","Data":"6114eba70d05227287cc4eaa70163a02a0c0d3d18a2c3cc8209adc22ab2d4eff"}
Sep 07 13:24:24.875677 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:24.875634    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9" podStartSLOduration=1.875621007 podStartE2EDuration="1.875621007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:24:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:24:24.874412106 +0000 UTC m=+1491.931293756" watchObservedRunningTime="2026-09-07 13:24:24.875621007 +0000 UTC m=+1491.932502660"
Sep 07 13:24:24.878705 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:24.878686    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:24:25.522661 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:25.522623    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:25.528090 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:25.528068    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:25.843184 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:25.843106    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:25.844085 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:25.844068    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:26.973537 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:26.973505    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:24:27.066048 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:27.066010    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:24:28.159370 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:28.159337    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:24:28.272843 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:28.272815    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:24:28.418472 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:28.418390    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:24:28.929449 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:28.929422    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:24:29.028593 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:29.028555    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:24:33.452134 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:33.452106    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-v9pd8_d2bb2527-1a29-4b7e-b6fb-9be32693a5cd/console-operator/1.log"
Sep 07 13:24:33.452551 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:33.452168    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-v9pd8_d2bb2527-1a29-4b7e-b6fb-9be32693a5cd/console-operator/1.log"
Sep 07 13:24:33.640071 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:33.640045    2576 scope.go:117] "RemoveContainer" containerID="a06e56a93d44f83d20de9eb805d4234b2f9229d98070b22c3430b0ce4b634a1d"
Sep 07 13:24:33.648397 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:33.648384    2576 scope.go:117] "RemoveContainer" containerID="733bfc9a0e505303eeb8cf31b0a5fc2a3371ad2efabfdd7e13b9e351702d8e04"
Sep 07 13:24:33.655673 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:33.655655    2576 scope.go:117] "RemoveContainer" containerID="16b68de59e563d8d6a3fd9c0829474c225aae1184f9daba67f2cff68eb83145b"
Sep 07 13:24:41.672901 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:41.672871    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:24:41.755257 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:41.755226    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:24:41.966948 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:41.966868    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:24:45.945178 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:45.945149    2576 generic.go:356] "Generic (PLEG): container finished" podID="5ac9b63c-0726-42cc-b361-1a5b4e5ac920" containerID="6114eba70d05227287cc4eaa70163a02a0c0d3d18a2c3cc8209adc22ab2d4eff" exitCode=0
Sep 07 13:24:45.945572 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:45.945191    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9" event={"ID":"5ac9b63c-0726-42cc-b361-1a5b4e5ac920","Type":"ContainerDied","Data":"6114eba70d05227287cc4eaa70163a02a0c0d3d18a2c3cc8209adc22ab2d4eff"}
Sep 07 13:24:45.945572 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:45.945480    2576 scope.go:117] "RemoveContainer" containerID="6114eba70d05227287cc4eaa70163a02a0c0d3d18a2c3cc8209adc22ab2d4eff"
Sep 07 13:24:45.946447 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:45.946419    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:24:45.946530 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:45.946490    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:24:45.946530 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:45.946523    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:24:46.952420 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:46.952389    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9" event={"ID":"5ac9b63c-0726-42cc-b361-1a5b4e5ac920","Type":"ContainerStarted","Data":"efa78b6aaf546c9f582fca819f9761053c84dc90a6392eea156365ce5d18efb7"}
Sep 07 13:24:47.523111 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:47.523076    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:47.523307 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:47.523249    2576 patch_prober.go:28] interesting pod/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 07 13:24:47.523381 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:47.523303    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9" podUID="5ac9b63c-0726-42cc-b361-1a5b4e5ac920" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 07 13:24:47.800217 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:47.800134    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:24:48.523514 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:48.523483    2576 patch_prober.go:28] interesting pod/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 07 13:24:48.523891 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:48.523543    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9" podUID="5ac9b63c-0726-42cc-b361-1a5b4e5ac920" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 07 13:24:49.397349 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:49.397314    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:24:49.523111 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:49.523076    2576 patch_prober.go:28] interesting pod/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 07 13:24:49.523272 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:49.523121    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9" podUID="5ac9b63c-0726-42cc-b361-1a5b4e5ac920" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 07 13:24:50.522587 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:50.522556    2576 patch_prober.go:28] interesting pod/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 07 13:24:50.523038 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:50.522612    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9" podUID="5ac9b63c-0726-42cc-b361-1a5b4e5ac920" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 07 13:24:51.523389 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:51.523350    2576 patch_prober.go:28] interesting pod/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Sep 07 13:24:51.523751 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:51.523410    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9" podUID="5ac9b63c-0726-42cc-b361-1a5b4e5ac920" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Sep 07 13:24:51.969658 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:51.969604    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:24:52.460553 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.460506    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:24:52.526953 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.526932    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:52.527315 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.527145    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:52.527695 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.527682    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:24:52.771152 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.771075    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"]
Sep 07 13:24:52.775276 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.775257    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:24:52.778034 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.778016    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-a768a0-openshift-default-dockercfg-6vcwj\""
Sep 07 13:24:52.790621 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.790604    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"]
Sep 07 13:24:52.817520 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.817501    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:24:52.840922 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.840897    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-workload-certs\") pod \"e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") " pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:24:52.841004 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.840935    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-istio-envoy\") pod \"e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") " pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:24:52.841004 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.840973    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crpl5\" (UniqueName: \"kubernetes.io/projected/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-kube-api-access-crpl5\") pod \"e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") " pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:24:52.841076 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.841009    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-istio-token\") pod \"e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") " pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:24:52.841076 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.841037    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-workload-socket\") pod \"e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") " pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:24:52.841076 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.841052    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-istio-podinfo\") pod \"e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") " pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:24:52.841076 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.841070    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-istio-data\") pod \"e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") " pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:24:52.841200 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.841091    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-istiod-ca-cert\") pod \"e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") " pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:24:52.841200 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.841112    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-credential-socket\") pod \"e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") " pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:24:52.942371 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.942339    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-istio-envoy\") pod \"e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") " pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:24:52.942538 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.942396    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crpl5\" (UniqueName: \"kubernetes.io/projected/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-kube-api-access-crpl5\") pod \"e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") " pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:24:52.942538 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.942442    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-istio-token\") pod \"e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") " pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:24:52.942538 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.942473    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-workload-socket\") pod \"e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") " pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:24:52.942538 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.942487    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-istio-podinfo\") pod \"e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") " pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:24:52.942802 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.942541    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-istio-data\") pod \"e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") " pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:24:52.942802 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.942600    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-istiod-ca-cert\") pod \"e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") " pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:24:52.942802 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.942642    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-credential-socket\") pod \"e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") " pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:24:52.942802 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.942675    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-workload-certs\") pod \"e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") " pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:24:52.943058 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.942920    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-workload-socket\") pod \"e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") " pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:24:52.943270 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.943050    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-credential-socket\") pod \"e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") " pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:24:52.943270 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.943075    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-istio-data\") pod \"e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") " pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:24:52.943270 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.943150    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-workload-certs\") pod \"e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") " pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:24:52.943270 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.943249    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-istiod-ca-cert\") pod \"e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") " pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:24:52.944890 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.944867    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-istio-envoy\") pod \"e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") " pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:24:52.945027 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.945011    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-istio-podinfo\") pod \"e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") " pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:24:52.952248 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.952222    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crpl5\" (UniqueName: \"kubernetes.io/projected/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-kube-api-access-crpl5\") pod \"e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") " pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:24:52.953221 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:52.953204    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-istio-token\") pod \"e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") " pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:24:53.034115 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:53.034036    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:24:53.085783 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:53.085740    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:24:53.399808 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:53.399787    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"]
Sep 07 13:24:53.400740 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:24:53.400719    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9d0d453_1fdf_40ea_aa7a_7c5c35803509.slice/crio-df5a0098a9f36df72f5f5f15965eee157724f18bc95b8b216b83c43fe77f1068 WatchSource:0}: Error finding container df5a0098a9f36df72f5f5f15965eee157724f18bc95b8b216b83c43fe77f1068: Status 404 returned error can't find the container with id df5a0098a9f36df72f5f5f15965eee157724f18bc95b8b216b83c43fe77f1068
Sep 07 13:24:53.402809 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:53.402749    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:24:53.402896 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:53.402852    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:24:53.402896 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:53.402880    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:24:53.994649 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:53.994616    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp" event={"ID":"a9d0d453-1fdf-40ea-aa7a-7c5c35803509","Type":"ContainerStarted","Data":"f94bb761c90b5a733a36a199b6a2e69e75ddc92fa5e2e6774f2c50fde8aaab84"}
Sep 07 13:24:53.995025 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:53.994671    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp" event={"ID":"a9d0d453-1fdf-40ea-aa7a-7c5c35803509","Type":"ContainerStarted","Data":"df5a0098a9f36df72f5f5f15965eee157724f18bc95b8b216b83c43fe77f1068"}
Sep 07 13:24:54.023309 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:54.023266    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp" podStartSLOduration=2.023253217 podStartE2EDuration="2.023253217s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:24:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:24:54.023170049 +0000 UTC m=+1521.080051716" watchObservedRunningTime="2026-09-07 13:24:54.023253217 +0000 UTC m=+1521.080134873"
Sep 07 13:24:54.086364 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:54.086341    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:24:54.091454 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:54.091436    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:24:54.999404 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:54.999319    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:24:55.000157 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:55.000138    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:24:56.022035 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:56.021992    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:24:56.123806 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:56.123779    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:24:57.135502 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:57.135475    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp"]
Sep 07 13:24:57.140137 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:57.140113    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp"
Sep 07 13:24:57.143230 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:57.143205    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 13:24:57.143230 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:57.143212    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-a768a0-serving-cert\""
Sep 07 13:24:57.143414 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:57.143263    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 07 13:24:57.143414 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:57.143282    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-fswx9\""
Sep 07 13:24:57.143599 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:57.143571    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 07 13:24:57.152147 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:57.152130    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp"]
Sep 07 13:24:57.186545 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:57.186521    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:24:57.267928 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:57.267904    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:24:57.285750 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:57.285728    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15cd788c-a781-4529-8687-c48d3b115337-maas-api-tls\") pod \"maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp\" (UID: \"15cd788c-a781-4529-8687-c48d3b115337\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp"
Sep 07 13:24:57.285867 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:57.285758    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15cd788c-a781-4529-8687-c48d3b115337-openshift-service-ca\") pod \"maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp\" (UID: \"15cd788c-a781-4529-8687-c48d3b115337\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp"
Sep 07 13:24:57.285867 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:57.285820    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb4mz\" (UniqueName: \"kubernetes.io/projected/15cd788c-a781-4529-8687-c48d3b115337-kube-api-access-mb4mz\") pod \"maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp\" (UID: \"15cd788c-a781-4529-8687-c48d3b115337\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp"
Sep 07 13:24:57.285940 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:57.285866    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15cd788c-a781-4529-8687-c48d3b115337-metrics-certs\") pod \"maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp\" (UID: \"15cd788c-a781-4529-8687-c48d3b115337\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp"
Sep 07 13:24:57.386878 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:57.386801    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15cd788c-a781-4529-8687-c48d3b115337-maas-api-tls\") pod \"maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp\" (UID: \"15cd788c-a781-4529-8687-c48d3b115337\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp"
Sep 07 13:24:57.386878 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:57.386841    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15cd788c-a781-4529-8687-c48d3b115337-openshift-service-ca\") pod \"maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp\" (UID: \"15cd788c-a781-4529-8687-c48d3b115337\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp"
Sep 07 13:24:57.387080 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:57.386885    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb4mz\" (UniqueName: \"kubernetes.io/projected/15cd788c-a781-4529-8687-c48d3b115337-kube-api-access-mb4mz\") pod \"maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp\" (UID: \"15cd788c-a781-4529-8687-c48d3b115337\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp"
Sep 07 13:24:57.387080 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:57.386941    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15cd788c-a781-4529-8687-c48d3b115337-metrics-certs\") pod \"maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp\" (UID: \"15cd788c-a781-4529-8687-c48d3b115337\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp"
Sep 07 13:24:57.387560 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:57.387539    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15cd788c-a781-4529-8687-c48d3b115337-openshift-service-ca\") pod \"maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp\" (UID: \"15cd788c-a781-4529-8687-c48d3b115337\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp"
Sep 07 13:24:57.389317 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:57.389280    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15cd788c-a781-4529-8687-c48d3b115337-metrics-certs\") pod \"maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp\" (UID: \"15cd788c-a781-4529-8687-c48d3b115337\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp"
Sep 07 13:24:57.389421 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:57.389372    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15cd788c-a781-4529-8687-c48d3b115337-maas-api-tls\") pod \"maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp\" (UID: \"15cd788c-a781-4529-8687-c48d3b115337\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp"
Sep 07 13:24:57.395635 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:57.395617    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb4mz\" (UniqueName: \"kubernetes.io/projected/15cd788c-a781-4529-8687-c48d3b115337-kube-api-access-mb4mz\") pod \"maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp\" (UID: \"15cd788c-a781-4529-8687-c48d3b115337\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp"
Sep 07 13:24:57.435165 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:57.435141    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:24:57.453013 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:57.452991    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp"
Sep 07 13:24:57.734985 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:57.734943    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp"]
Sep 07 13:24:57.736826 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:24:57.736798    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15cd788c_a781_4529_8687_c48d3b115337.slice/crio-fb6b129474ea169da2d3a1e80ab5fc96eca493e709c6d71117d31c70a26fac3b WatchSource:0}: Error finding container fb6b129474ea169da2d3a1e80ab5fc96eca493e709c6d71117d31c70a26fac3b: Status 404 returned error can't find the container with id fb6b129474ea169da2d3a1e80ab5fc96eca493e709c6d71117d31c70a26fac3b
Sep 07 13:24:57.805399 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:57.805373    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:24:57.896438 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:57.896408    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:24:58.015442 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:24:58.015379    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp" event={"ID":"15cd788c-a781-4529-8687-c48d3b115337","Type":"ContainerStarted","Data":"fb6b129474ea169da2d3a1e80ab5fc96eca493e709c6d71117d31c70a26fac3b"}
Sep 07 13:25:00.027985 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:00.027953    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp" event={"ID":"15cd788c-a781-4529-8687-c48d3b115337","Type":"ContainerStarted","Data":"8121161c3b806d855d50ca444bc0ab6ed85eff708662bef466ccda46c53ddb87"}
Sep 07 13:25:00.028320 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:00.028016    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp"
Sep 07 13:25:00.051447 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:00.051394    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp" podStartSLOduration=1.520978723 podStartE2EDuration="3.051379418s" totalImagesPullingTime="1.530400695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:24:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:25:00.04952157 +0000 UTC m=+1527.106403226" watchObservedRunningTime="2026-09-07 13:25:00.051379418 +0000 UTC m=+1527.108261074"
Sep 07 13:25:02.971587 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:02.971560    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:25:06.037451 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:06.037424    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp"
Sep 07 13:25:06.718708 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:06.718655    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:25:11.041902 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:11.041863    2576 patch_prober.go:28] interesting pod/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 07 13:25:11.042358 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:11.041919    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp" podUID="a9d0d453-1fdf-40ea-aa7a-7c5c35803509" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 07 13:25:12.098456 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:12.098424    2576 generic.go:356] "Generic (PLEG): container finished" podID="a9d0d453-1fdf-40ea-aa7a-7c5c35803509" containerID="f94bb761c90b5a733a36a199b6a2e69e75ddc92fa5e2e6774f2c50fde8aaab84" exitCode=0
Sep 07 13:25:12.098754 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:12.098495    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp" event={"ID":"a9d0d453-1fdf-40ea-aa7a-7c5c35803509","Type":"ContainerDied","Data":"f94bb761c90b5a733a36a199b6a2e69e75ddc92fa5e2e6774f2c50fde8aaab84"}
Sep 07 13:25:12.098911 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:12.098896    2576 scope.go:117] "RemoveContainer" containerID="f94bb761c90b5a733a36a199b6a2e69e75ddc92fa5e2e6774f2c50fde8aaab84"
Sep 07 13:25:12.099963 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:12.099934    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:25:12.100058 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:12.100013    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:25:12.100117 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:12.100062    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:25:13.106050 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:13.106010    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp" event={"ID":"a9d0d453-1fdf-40ea-aa7a-7c5c35803509","Type":"ContainerStarted","Data":"ec338f79b9dddf24b0b64e92be28deda2c8e45969795e71a7a79fe6a97f50e4f"}
Sep 07 13:25:14.086671 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:14.086634    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:25:14.086890 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:14.086747    2576 patch_prober.go:28] interesting pod/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 07 13:25:14.086890 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:14.086815    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp" podUID="a9d0d453-1fdf-40ea-aa7a-7c5c35803509" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 07 13:25:15.086876 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:15.086841    2576 patch_prober.go:28] interesting pod/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 07 13:25:15.087439 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:15.087408    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp" podUID="a9d0d453-1fdf-40ea-aa7a-7c5c35803509" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 07 13:25:16.010560 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:16.010524    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:25:16.086828 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:16.086791    2576 patch_prober.go:28] interesting pod/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 07 13:25:16.087004 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:16.086850    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp" podUID="a9d0d453-1fdf-40ea-aa7a-7c5c35803509" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 07 13:25:17.086640 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:17.086600    2576 patch_prober.go:28] interesting pod/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Sep 07 13:25:17.086965 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:17.086934    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp" podUID="a9d0d453-1fdf-40ea-aa7a-7c5c35803509" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Sep 07 13:25:18.089691 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:18.089666    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:25:18.090160 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:18.090047    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:25:18.090631 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:18.090614    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:25:18.401980 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:18.401949    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:25:20.944956 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:20.944912    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:25:24.232520 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:24.232489    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:25:26.065960 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:26.065928    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:25:30.288719 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:30.288684    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:25:31.066373 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:31.066330    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:25:31.492238 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:31.492210    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:25:31.810005 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:31.809934    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"]
Sep 07 13:25:31.815250 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:31.815235    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:25:31.819114 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:31.819097    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-219f63-openshift-default-dockercfg-57g8x\""
Sep 07 13:25:31.830489 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:31.830468    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"]
Sep 07 13:25:31.841306 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:31.841274    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:25:31.903120 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:31.903084    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0372fe3-be1b-4769-bc17-9f41e2d1d630-istio-podinfo\") pod \"e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") " pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:25:31.903120 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:31.903132    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0372fe3-be1b-4769-bc17-9f41e2d1d630-istio-envoy\") pod \"e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") " pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:25:31.903381 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:31.903220    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0372fe3-be1b-4769-bc17-9f41e2d1d630-credential-socket\") pod \"e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") " pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:25:31.903381 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:31.903246    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0372fe3-be1b-4769-bc17-9f41e2d1d630-istio-data\") pod \"e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") " pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:25:31.903381 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:31.903274    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0372fe3-be1b-4769-bc17-9f41e2d1d630-workload-socket\") pod \"e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") " pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:25:31.903531 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:31.903379    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0372fe3-be1b-4769-bc17-9f41e2d1d630-istiod-ca-cert\") pod \"e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") " pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:25:31.903531 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:31.903446    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0372fe3-be1b-4769-bc17-9f41e2d1d630-workload-certs\") pod \"e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") " pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:25:31.903639 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:31.903564    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0372fe3-be1b-4769-bc17-9f41e2d1d630-istio-token\") pod \"e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") " pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:25:31.903639 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:31.903601    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh827\" (UniqueName: \"kubernetes.io/projected/d0372fe3-be1b-4769-bc17-9f41e2d1d630-kube-api-access-nh827\") pod \"e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") " pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:25:32.004373 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:32.004342    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0372fe3-be1b-4769-bc17-9f41e2d1d630-istio-token\") pod \"e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") " pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:25:32.004373 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:32.004378    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh827\" (UniqueName: \"kubernetes.io/projected/d0372fe3-be1b-4769-bc17-9f41e2d1d630-kube-api-access-nh827\") pod \"e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") " pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:25:32.004611 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:32.004421    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0372fe3-be1b-4769-bc17-9f41e2d1d630-istio-podinfo\") pod \"e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") " pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:25:32.004611 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:32.004445    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0372fe3-be1b-4769-bc17-9f41e2d1d630-istio-envoy\") pod \"e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") " pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:25:32.004611 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:32.004495    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0372fe3-be1b-4769-bc17-9f41e2d1d630-credential-socket\") pod \"e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") " pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:25:32.004611 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:32.004514    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0372fe3-be1b-4769-bc17-9f41e2d1d630-istio-data\") pod \"e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") " pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:25:32.004854 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:32.004675    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0372fe3-be1b-4769-bc17-9f41e2d1d630-workload-socket\") pod \"e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") " pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:25:32.004854 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:32.004720    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0372fe3-be1b-4769-bc17-9f41e2d1d630-istiod-ca-cert\") pod \"e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") " pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:25:32.004854 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:32.004801    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0372fe3-be1b-4769-bc17-9f41e2d1d630-workload-certs\") pod \"e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") " pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:25:32.005010 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:32.004929    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0372fe3-be1b-4769-bc17-9f41e2d1d630-credential-socket\") pod \"e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") " pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:25:32.005010 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:32.004968    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0372fe3-be1b-4769-bc17-9f41e2d1d630-istio-data\") pod \"e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") " pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:25:32.005107 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:32.005044    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0372fe3-be1b-4769-bc17-9f41e2d1d630-workload-socket\") pod \"e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") " pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:25:32.005166 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:32.005103    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0372fe3-be1b-4769-bc17-9f41e2d1d630-workload-certs\") pod \"e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") " pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:25:32.005505 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:32.005479    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0372fe3-be1b-4769-bc17-9f41e2d1d630-istiod-ca-cert\") pod \"e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") " pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:25:32.007022 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:32.007000    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0372fe3-be1b-4769-bc17-9f41e2d1d630-istio-podinfo\") pod \"e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") " pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:25:32.007293 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:32.007268    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0372fe3-be1b-4769-bc17-9f41e2d1d630-istio-envoy\") pod \"e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") " pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:25:32.014610 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:32.014590    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh827\" (UniqueName: \"kubernetes.io/projected/d0372fe3-be1b-4769-bc17-9f41e2d1d630-kube-api-access-nh827\") pod \"e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") " pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:25:32.015397 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:32.015381    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0372fe3-be1b-4769-bc17-9f41e2d1d630-istio-token\") pod \"e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") " pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:25:32.125567 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:32.125546    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:25:32.216022 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:32.215992    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:25:32.407663 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:32.407638    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"]
Sep 07 13:25:32.409661 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:25:32.409635    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0372fe3_be1b_4769_bc17_9f41e2d1d630.slice/crio-8d0b1a2f29ebd26b268ca2a0a80026645ff147d0fc037f1aaad8a7d7fb290ac2 WatchSource:0}: Error finding container 8d0b1a2f29ebd26b268ca2a0a80026645ff147d0fc037f1aaad8a7d7fb290ac2: Status 404 returned error can't find the container with id 8d0b1a2f29ebd26b268ca2a0a80026645ff147d0fc037f1aaad8a7d7fb290ac2
Sep 07 13:25:32.411833 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:32.411800    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:25:32.411946 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:32.411871    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:25:32.411946 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:32.411916    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:25:33.212499 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:33.212469    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9" event={"ID":"d0372fe3-be1b-4769-bc17-9f41e2d1d630","Type":"ContainerStarted","Data":"dc7a64c86323da5c3733b09d1a0a277d12d08020b2773de5b32120d05ce88ac3"}
Sep 07 13:25:33.212849 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:33.212523    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9" event={"ID":"d0372fe3-be1b-4769-bc17-9f41e2d1d630","Type":"ContainerStarted","Data":"8d0b1a2f29ebd26b268ca2a0a80026645ff147d0fc037f1aaad8a7d7fb290ac2"}
Sep 07 13:25:33.251168 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:33.251129    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9" podStartSLOduration=2.2511144339999998 podStartE2EDuration="2.251114434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:25:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:25:33.251012452 +0000 UTC m=+1560.307894109" watchObservedRunningTime="2026-09-07 13:25:33.251114434 +0000 UTC m=+1560.307996115"
Sep 07 13:25:33.687302 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:33.687271    2576 scope.go:117] "RemoveContainer" containerID="0ae09bf55c23d536286bb690b1cd807df2ddffba2a5e3bcc9ce040db1ce6f014"
Sep 07 13:25:34.125965 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:34.125936    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:25:34.130835 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:34.130813    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:25:34.217972 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:34.217947    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:25:34.218593 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:34.218578    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:25:35.204164 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:35.204133    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:25:35.459373 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:35.459289    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:25:36.552086 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:36.552054    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp"]
Sep 07 13:25:36.557709 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:36.557683    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp"
Sep 07 13:25:36.559872 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:36.559849    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-219f63-serving-cert\""
Sep 07 13:25:36.572396 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:36.572374    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp"]
Sep 07 13:25:36.608006 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:36.607972    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:25:36.647136 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:36.647113    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2d700c7-e0bc-4b3f-a562-4df1fb667ef9-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp\" (UID: \"f2d700c7-e0bc-4b3f-a562-4df1fb667ef9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp"
Sep 07 13:25:36.647244 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:36.647145    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2d700c7-e0bc-4b3f-a562-4df1fb667ef9-maas-api-tls\") pod \"maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp\" (UID: \"f2d700c7-e0bc-4b3f-a562-4df1fb667ef9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp"
Sep 07 13:25:36.647244 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:36.647163    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2d700c7-e0bc-4b3f-a562-4df1fb667ef9-metrics-certs\") pod \"maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp\" (UID: \"f2d700c7-e0bc-4b3f-a562-4df1fb667ef9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp"
Sep 07 13:25:36.647244 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:36.647196    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7npc\" (UniqueName: \"kubernetes.io/projected/f2d700c7-e0bc-4b3f-a562-4df1fb667ef9-kube-api-access-b7npc\") pod \"maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp\" (UID: \"f2d700c7-e0bc-4b3f-a562-4df1fb667ef9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp"
Sep 07 13:25:36.705379 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:36.705359    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:25:36.748324 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:36.748294    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2d700c7-e0bc-4b3f-a562-4df1fb667ef9-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp\" (UID: \"f2d700c7-e0bc-4b3f-a562-4df1fb667ef9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp"
Sep 07 13:25:36.748489 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:36.748328    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2d700c7-e0bc-4b3f-a562-4df1fb667ef9-maas-api-tls\") pod \"maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp\" (UID: \"f2d700c7-e0bc-4b3f-a562-4df1fb667ef9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp"
Sep 07 13:25:36.748489 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:36.748346    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2d700c7-e0bc-4b3f-a562-4df1fb667ef9-metrics-certs\") pod \"maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp\" (UID: \"f2d700c7-e0bc-4b3f-a562-4df1fb667ef9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp"
Sep 07 13:25:36.748489 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:36.748380    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7npc\" (UniqueName: \"kubernetes.io/projected/f2d700c7-e0bc-4b3f-a562-4df1fb667ef9-kube-api-access-b7npc\") pod \"maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp\" (UID: \"f2d700c7-e0bc-4b3f-a562-4df1fb667ef9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp"
Sep 07 13:25:36.749076 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:36.749051    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2d700c7-e0bc-4b3f-a562-4df1fb667ef9-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp\" (UID: \"f2d700c7-e0bc-4b3f-a562-4df1fb667ef9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp"
Sep 07 13:25:36.751005 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:36.750982    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2d700c7-e0bc-4b3f-a562-4df1fb667ef9-maas-api-tls\") pod \"maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp\" (UID: \"f2d700c7-e0bc-4b3f-a562-4df1fb667ef9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp"
Sep 07 13:25:36.751120 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:36.751040    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2d700c7-e0bc-4b3f-a562-4df1fb667ef9-metrics-certs\") pod \"maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp\" (UID: \"f2d700c7-e0bc-4b3f-a562-4df1fb667ef9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp"
Sep 07 13:25:36.761037 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:36.761016    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7npc\" (UniqueName: \"kubernetes.io/projected/f2d700c7-e0bc-4b3f-a562-4df1fb667ef9-kube-api-access-b7npc\") pod \"maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp\" (UID: \"f2d700c7-e0bc-4b3f-a562-4df1fb667ef9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp"
Sep 07 13:25:36.868288 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:36.868238    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp"
Sep 07 13:25:37.160038 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:37.160010    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp"]
Sep 07 13:25:37.161052 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:25:37.161025    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2d700c7_e0bc_4b3f_a562_4df1fb667ef9.slice/crio-24c484f8b39ab7a308d2a0628d4dbca535a59cc86a26fd18291eea6e0388c3fe WatchSource:0}: Error finding container 24c484f8b39ab7a308d2a0628d4dbca535a59cc86a26fd18291eea6e0388c3fe: Status 404 returned error can't find the container with id 24c484f8b39ab7a308d2a0628d4dbca535a59cc86a26fd18291eea6e0388c3fe
Sep 07 13:25:37.240235 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:37.240201    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp" event={"ID":"f2d700c7-e0bc-4b3f-a562-4df1fb667ef9","Type":"ContainerStarted","Data":"24c484f8b39ab7a308d2a0628d4dbca535a59cc86a26fd18291eea6e0388c3fe"}
Sep 07 13:25:37.496461 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:37.496375    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:25:37.668202 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:37.668165    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:25:38.211415 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:38.211370    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:25:38.249660 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:38.249627    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp" event={"ID":"f2d700c7-e0bc-4b3f-a562-4df1fb667ef9","Type":"ContainerStarted","Data":"7c92311dc54b3f841b88ad302005edf754e1fd00177d13e3e7210d5bdbd0c2df"}
Sep 07 13:25:38.249853 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:38.249747    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp"
Sep 07 13:25:38.304020 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:38.303976    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp" podStartSLOduration=1.745712564 podStartE2EDuration="2.303959813s" totalImagesPullingTime="558.247249ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:25:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:25:38.301589205 +0000 UTC m=+1565.358470873" watchObservedRunningTime="2026-09-07 13:25:38.303959813 +0000 UTC m=+1565.360841470"
Sep 07 13:25:39.426386 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:39.426358    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:25:40.303122 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:40.303080    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:25:40.401754 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:40.401712    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:25:40.482749 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:40.482715    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:25:40.602572 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:40.602485    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:25:40.688212 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:40.688178    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:25:40.990589 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:40.990562    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:25:44.259073 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:44.259049    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp"
Sep 07 13:25:44.461949 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:44.461912    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:25:47.874963 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:47.874921    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:25:47.978759 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:47.978720    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:25:48.143295 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:48.143224    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"]
Sep 07 13:25:48.143501 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:48.143479    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9" podUID="5ac9b63c-0726-42cc-b361-1a5b4e5ac920" containerName="istio-proxy" containerID="cri-o://efa78b6aaf546c9f582fca819f9761053c84dc90a6392eea156365ce5d18efb7" gracePeriod=30
Sep 07 13:25:48.185617 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:48.185578    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:25:48.736904 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:48.736873    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:25:52.529845 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:52.529804    2576 patch_prober.go:28] interesting pod/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 07 13:25:52.530203 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:52.529868    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9" podUID="5ac9b63c-0726-42cc-b361-1a5b4e5ac920" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 07 13:25:53.335100 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:53.335065    2576 generic.go:356] "Generic (PLEG): container finished" podID="5ac9b63c-0726-42cc-b361-1a5b4e5ac920" containerID="efa78b6aaf546c9f582fca819f9761053c84dc90a6392eea156365ce5d18efb7" exitCode=0
Sep 07 13:25:53.335270 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:53.335250    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9" event={"ID":"5ac9b63c-0726-42cc-b361-1a5b4e5ac920","Type":"ContainerDied","Data":"efa78b6aaf546c9f582fca819f9761053c84dc90a6392eea156365ce5d18efb7"}
Sep 07 13:25:53.335349 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:53.335313    2576 scope.go:117] "RemoveContainer" containerID="6114eba70d05227287cc4eaa70163a02a0c0d3d18a2c3cc8209adc22ab2d4eff"
Sep 07 13:25:53.399971 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:53.399950    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:25:53.502783 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:53.502698    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppz2q\" (UniqueName: \"kubernetes.io/projected/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-kube-api-access-ppz2q\") pod \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") "
Sep 07 13:25:53.502783 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:53.502749    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-credential-socket\") pod \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") "
Sep 07 13:25:53.502970 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:53.502822    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-istio-podinfo\") pod \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") "
Sep 07 13:25:53.502970 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:53.502855    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-istio-token\") pod \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") "
Sep 07 13:25:53.502970 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:53.502904    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-workload-certs\") pod \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") "
Sep 07 13:25:53.502970 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:53.502958    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-istiod-ca-cert\") pod \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") "
Sep 07 13:25:53.503181 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:53.503002    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-istio-envoy\") pod \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") "
Sep 07 13:25:53.503181 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:53.503041    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-workload-socket\") pod \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") "
Sep 07 13:25:53.503181 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:53.503055    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5ac9b63c-0726-42cc-b361-1a5b4e5ac920" (UID: "5ac9b63c-0726-42cc-b361-1a5b4e5ac920"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:25:53.503181 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:53.503084    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-istio-data\") pod \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\" (UID: \"5ac9b63c-0726-42cc-b361-1a5b4e5ac920\") "
Sep 07 13:25:53.503468 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:53.503207    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5ac9b63c-0726-42cc-b361-1a5b4e5ac920" (UID: "5ac9b63c-0726-42cc-b361-1a5b4e5ac920"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:25:53.503468 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:53.503296    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5ac9b63c-0726-42cc-b361-1a5b4e5ac920" (UID: "5ac9b63c-0726-42cc-b361-1a5b4e5ac920"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:25:53.503468 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:53.503442    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-istio-data" (OuterVolumeSpecName: "istio-data") pod "5ac9b63c-0726-42cc-b361-1a5b4e5ac920" (UID: "5ac9b63c-0726-42cc-b361-1a5b4e5ac920"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:25:53.503468 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:53.503457    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-workload-certs\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:25:53.503844 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:53.503473    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5ac9b63c-0726-42cc-b361-1a5b4e5ac920" (UID: "5ac9b63c-0726-42cc-b361-1a5b4e5ac920"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:25:53.503844 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:53.503476    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-workload-socket\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:25:53.503844 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:53.503499    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-credential-socket\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:25:53.505178 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:53.505153    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-istio-token" (OuterVolumeSpecName: "istio-token") pod "5ac9b63c-0726-42cc-b361-1a5b4e5ac920" (UID: "5ac9b63c-0726-42cc-b361-1a5b4e5ac920"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:25:53.505329 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:53.505182    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-kube-api-access-ppz2q" (OuterVolumeSpecName: "kube-api-access-ppz2q") pod "5ac9b63c-0726-42cc-b361-1a5b4e5ac920" (UID: "5ac9b63c-0726-42cc-b361-1a5b4e5ac920"). InnerVolumeSpecName "kube-api-access-ppz2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:25:53.505329 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:53.505273    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5ac9b63c-0726-42cc-b361-1a5b4e5ac920" (UID: "5ac9b63c-0726-42cc-b361-1a5b4e5ac920"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 13:25:53.505604 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:53.505589    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5ac9b63c-0726-42cc-b361-1a5b4e5ac920" (UID: "5ac9b63c-0726-42cc-b361-1a5b4e5ac920"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:25:53.604492 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:53.604462    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-istio-data\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:25:53.604492 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:53.604488    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppz2q\" (UniqueName: \"kubernetes.io/projected/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-kube-api-access-ppz2q\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:25:53.604858 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:53.604501    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-istio-podinfo\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:25:53.604858 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:53.604512    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-istio-token\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:25:53.604858 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:53.604524    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-istiod-ca-cert\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:25:53.604858 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:53.604535    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ac9b63c-0726-42cc-b361-1a5b4e5ac920-istio-envoy\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:25:54.342599 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:54.342566    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"
Sep 07 13:25:54.342845 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:54.342597    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9" event={"ID":"5ac9b63c-0726-42cc-b361-1a5b4e5ac920","Type":"ContainerDied","Data":"a743c145d9f7ed525950ba57b7a51799a5b861f73ea76edfe75fc4cdfb479006"}
Sep 07 13:25:54.342845 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:54.342656    2576 scope.go:117] "RemoveContainer" containerID="efa78b6aaf546c9f582fca819f9761053c84dc90a6392eea156365ce5d18efb7"
Sep 07 13:25:54.344448 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:54.344415    2576 generic.go:356] "Generic (PLEG): container finished" podID="d0372fe3-be1b-4769-bc17-9f41e2d1d630" containerID="dc7a64c86323da5c3733b09d1a0a277d12d08020b2773de5b32120d05ce88ac3" exitCode=0
Sep 07 13:25:54.344532 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:54.344477    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9" event={"ID":"d0372fe3-be1b-4769-bc17-9f41e2d1d630","Type":"ContainerDied","Data":"dc7a64c86323da5c3733b09d1a0a277d12d08020b2773de5b32120d05ce88ac3"}
Sep 07 13:25:54.344956 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:54.344938    2576 scope.go:117] "RemoveContainer" containerID="dc7a64c86323da5c3733b09d1a0a277d12d08020b2773de5b32120d05ce88ac3"
Sep 07 13:25:54.346286 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:54.346252    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:25:54.346371 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:54.346346    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:25:54.346423 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:54.346397    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:25:54.392249 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:54.392222    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"]
Sep 07 13:25:54.396056 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:54.396037    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-00fbc4-openshift-default-6766ccc766-zm6f9"]
Sep 07 13:25:55.355100 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:55.355062    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9" event={"ID":"d0372fe3-be1b-4769-bc17-9f41e2d1d630","Type":"ContainerStarted","Data":"08fb5eb09b65f71b7bc921e070afb7ebf5ad3f81d2d3600dc934659552ab9739"}
Sep 07 13:25:55.365714 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:55.365679    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ac9b63c-0726-42cc-b361-1a5b4e5ac920" path="/var/lib/kubelet/pods/5ac9b63c-0726-42cc-b361-1a5b4e5ac920/volumes"
Sep 07 13:25:56.126049 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:56.126019    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:25:56.126218 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:56.126171    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 07 13:25:56.126266 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:56.126213    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9" podUID="d0372fe3-be1b-4769-bc17-9f41e2d1d630" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 07 13:25:57.125840 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:57.125809    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 07 13:25:57.126196 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:57.125857    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9" podUID="d0372fe3-be1b-4769-bc17-9f41e2d1d630" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 07 13:25:58.076788 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:58.076730    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:25:58.126385 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:58.126353    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 07 13:25:58.126742 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:58.126414    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9" podUID="d0372fe3-be1b-4769-bc17-9f41e2d1d630" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 07 13:25:59.126653 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:59.126619    2576 patch_prober.go:28] interesting pod/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused" start-of-body=
Sep 07 13:25:59.127029 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:25:59.126671    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9" podUID="d0372fe3-be1b-4769-bc17-9f41e2d1d630" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.79:15021/healthz/ready\": dial tcp 10.133.0.79:15021: connect: connection refused"
Sep 07 13:26:00.196575 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:00.196542    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:26:00.197040 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:00.197020    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:26:00.198505 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:00.198472    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:00.199704 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:00.199688    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:26:02.100365 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:02.100333    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:03.858511 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:03.858479    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp"]
Sep 07 13:26:03.858980 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:03.858681    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp" podUID="15cd788c-a781-4529-8687-c48d3b115337" containerName="maas-api" containerID="cri-o://8121161c3b806d855d50ca444bc0ab6ed85eff708662bef466ccda46c53ddb87" gracePeriod=30
Sep 07 13:26:03.894515 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:03.894473    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:03.999456 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:03.999408    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:04.088438 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:04.088408    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:04.105047 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:04.105030    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp"
Sep 07 13:26:04.189998 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:04.189966    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:04.200070 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:04.200045    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15cd788c-a781-4529-8687-c48d3b115337-metrics-certs\") pod \"15cd788c-a781-4529-8687-c48d3b115337\" (UID: \"15cd788c-a781-4529-8687-c48d3b115337\") "
Sep 07 13:26:04.200171 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:04.200159    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mb4mz\" (UniqueName: \"kubernetes.io/projected/15cd788c-a781-4529-8687-c48d3b115337-kube-api-access-mb4mz\") pod \"15cd788c-a781-4529-8687-c48d3b115337\" (UID: \"15cd788c-a781-4529-8687-c48d3b115337\") "
Sep 07 13:26:04.200236 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:04.200222    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15cd788c-a781-4529-8687-c48d3b115337-maas-api-tls\") pod \"15cd788c-a781-4529-8687-c48d3b115337\" (UID: \"15cd788c-a781-4529-8687-c48d3b115337\") "
Sep 07 13:26:04.200308 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:04.200288    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15cd788c-a781-4529-8687-c48d3b115337-openshift-service-ca\") pod \"15cd788c-a781-4529-8687-c48d3b115337\" (UID: \"15cd788c-a781-4529-8687-c48d3b115337\") "
Sep 07 13:26:04.200650 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:04.200623    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15cd788c-a781-4529-8687-c48d3b115337-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "15cd788c-a781-4529-8687-c48d3b115337" (UID: "15cd788c-a781-4529-8687-c48d3b115337"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:26:04.202555 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:04.202534    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15cd788c-a781-4529-8687-c48d3b115337-kube-api-access-mb4mz" (OuterVolumeSpecName: "kube-api-access-mb4mz") pod "15cd788c-a781-4529-8687-c48d3b115337" (UID: "15cd788c-a781-4529-8687-c48d3b115337"). InnerVolumeSpecName "kube-api-access-mb4mz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:26:04.202718 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:04.202697    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15cd788c-a781-4529-8687-c48d3b115337-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "15cd788c-a781-4529-8687-c48d3b115337" (UID: "15cd788c-a781-4529-8687-c48d3b115337"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:26:04.202762 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:04.202716    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15cd788c-a781-4529-8687-c48d3b115337-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "15cd788c-a781-4529-8687-c48d3b115337" (UID: "15cd788c-a781-4529-8687-c48d3b115337"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:26:04.297021 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:04.296982    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:04.302084 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:04.302065    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/15cd788c-a781-4529-8687-c48d3b115337-metrics-certs\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:26:04.302084 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:04.302085    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mb4mz\" (UniqueName: \"kubernetes.io/projected/15cd788c-a781-4529-8687-c48d3b115337-kube-api-access-mb4mz\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:26:04.302220 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:04.302094    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/15cd788c-a781-4529-8687-c48d3b115337-maas-api-tls\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:26:04.302220 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:04.302102    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/15cd788c-a781-4529-8687-c48d3b115337-openshift-service-ca\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:26:04.411814 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:04.411789    2576 generic.go:356] "Generic (PLEG): container finished" podID="15cd788c-a781-4529-8687-c48d3b115337" containerID="8121161c3b806d855d50ca444bc0ab6ed85eff708662bef466ccda46c53ddb87" exitCode=0
Sep 07 13:26:04.411924 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:04.411834    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp"
Sep 07 13:26:04.411975 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:04.411855    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp" event={"ID":"15cd788c-a781-4529-8687-c48d3b115337","Type":"ContainerDied","Data":"8121161c3b806d855d50ca444bc0ab6ed85eff708662bef466ccda46c53ddb87"}
Sep 07 13:26:04.411975 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:04.411962    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp" event={"ID":"15cd788c-a781-4529-8687-c48d3b115337","Type":"ContainerDied","Data":"fb6b129474ea169da2d3a1e80ab5fc96eca493e709c6d71117d31c70a26fac3b"}
Sep 07 13:26:04.412047 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:04.411981    2576 scope.go:117] "RemoveContainer" containerID="8121161c3b806d855d50ca444bc0ab6ed85eff708662bef466ccda46c53ddb87"
Sep 07 13:26:04.421590 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:04.421572    2576 scope.go:117] "RemoveContainer" containerID="8121161c3b806d855d50ca444bc0ab6ed85eff708662bef466ccda46c53ddb87"
Sep 07 13:26:04.421883 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:26:04.421859    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8121161c3b806d855d50ca444bc0ab6ed85eff708662bef466ccda46c53ddb87\": container with ID starting with 8121161c3b806d855d50ca444bc0ab6ed85eff708662bef466ccda46c53ddb87 not found: ID does not exist" containerID="8121161c3b806d855d50ca444bc0ab6ed85eff708662bef466ccda46c53ddb87"
Sep 07 13:26:04.421927 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:04.421892    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8121161c3b806d855d50ca444bc0ab6ed85eff708662bef466ccda46c53ddb87"} err="failed to get container status \"8121161c3b806d855d50ca444bc0ab6ed85eff708662bef466ccda46c53ddb87\": rpc error: code = NotFound desc = could not find container \"8121161c3b806d855d50ca444bc0ab6ed85eff708662bef466ccda46c53ddb87\": container with ID starting with 8121161c3b806d855d50ca444bc0ab6ed85eff708662bef466ccda46c53ddb87 not found: ID does not exist"
Sep 07 13:26:04.433890 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:04.433871    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp"]
Sep 07 13:26:04.440050 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:04.440002    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-a768a0-76bddb9bb5-fvthp"]
Sep 07 13:26:04.575886 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:04.575860    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:04.761714 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:04.761648    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:04.860267 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:04.860236    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:05.367430 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:05.367398    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15cd788c-a781-4529-8687-c48d3b115337" path="/var/lib/kubelet/pods/15cd788c-a781-4529-8687-c48d3b115337/volumes"
Sep 07 13:26:05.809889 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:05.809859    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:06.559262 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:06.559235    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:26:06.653860 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:06.653829    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22"]
Sep 07 13:26:06.654247 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:06.654236    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15cd788c-a781-4529-8687-c48d3b115337" containerName="maas-api"
Sep 07 13:26:06.654288 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:06.654250    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="15cd788c-a781-4529-8687-c48d3b115337" containerName="maas-api"
Sep 07 13:26:06.654288 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:06.654258    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ac9b63c-0726-42cc-b361-1a5b4e5ac920" containerName="istio-proxy"
Sep 07 13:26:06.654288 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:06.654263    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ac9b63c-0726-42cc-b361-1a5b4e5ac920" containerName="istio-proxy"
Sep 07 13:26:06.654288 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:06.654269    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ac9b63c-0726-42cc-b361-1a5b4e5ac920" containerName="istio-proxy"
Sep 07 13:26:06.654288 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:06.654274    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ac9b63c-0726-42cc-b361-1a5b4e5ac920" containerName="istio-proxy"
Sep 07 13:26:06.654434 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:06.654354    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ac9b63c-0726-42cc-b361-1a5b4e5ac920" containerName="istio-proxy"
Sep 07 13:26:06.654434 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:06.654363    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ac9b63c-0726-42cc-b361-1a5b4e5ac920" containerName="istio-proxy"
Sep 07 13:26:06.654434 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:06.654372    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="15cd788c-a781-4529-8687-c48d3b115337" containerName="maas-api"
Sep 07 13:26:06.658715 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:06.658699    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22"
Sep 07 13:26:06.661011 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:06.660995    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-8dc72a-serving-cert\""
Sep 07 13:26:06.669276 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:06.669252    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22"]
Sep 07 13:26:06.724298 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:06.724275    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed7c9509-464c-4e3b-83d6-b8db392ffdc2-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22\" (UID: \"ed7c9509-464c-4e3b-83d6-b8db392ffdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22"
Sep 07 13:26:06.724430 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:06.724320    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7c9509-464c-4e3b-83d6-b8db392ffdc2-metrics-certs\") pod \"maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22\" (UID: \"ed7c9509-464c-4e3b-83d6-b8db392ffdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22"
Sep 07 13:26:06.724430 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:06.724376    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed7c9509-464c-4e3b-83d6-b8db392ffdc2-maas-api-tls\") pod \"maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22\" (UID: \"ed7c9509-464c-4e3b-83d6-b8db392ffdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22"
Sep 07 13:26:06.724430 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:06.724419    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kk55\" (UniqueName: \"kubernetes.io/projected/ed7c9509-464c-4e3b-83d6-b8db392ffdc2-kube-api-access-4kk55\") pod \"maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22\" (UID: \"ed7c9509-464c-4e3b-83d6-b8db392ffdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22"
Sep 07 13:26:06.785519 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:06.785498    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:06.825403 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:06.825347    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed7c9509-464c-4e3b-83d6-b8db392ffdc2-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22\" (UID: \"ed7c9509-464c-4e3b-83d6-b8db392ffdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22"
Sep 07 13:26:06.825403 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:06.825397    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7c9509-464c-4e3b-83d6-b8db392ffdc2-metrics-certs\") pod \"maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22\" (UID: \"ed7c9509-464c-4e3b-83d6-b8db392ffdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22"
Sep 07 13:26:06.825518 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:06.825429    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed7c9509-464c-4e3b-83d6-b8db392ffdc2-maas-api-tls\") pod \"maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22\" (UID: \"ed7c9509-464c-4e3b-83d6-b8db392ffdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22"
Sep 07 13:26:06.825518 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:06.825445    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kk55\" (UniqueName: \"kubernetes.io/projected/ed7c9509-464c-4e3b-83d6-b8db392ffdc2-kube-api-access-4kk55\") pod \"maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22\" (UID: \"ed7c9509-464c-4e3b-83d6-b8db392ffdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22"
Sep 07 13:26:06.825583 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:26:06.825571    2576 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-8dc72a-serving-cert: secret "maas-api-e2e-ipp-b-8dc72a-serving-cert" not found
Sep 07 13:26:06.825629 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:26:06.825620    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ed7c9509-464c-4e3b-83d6-b8db392ffdc2-maas-api-tls podName:ed7c9509-464c-4e3b-83d6-b8db392ffdc2 nodeName:}" failed. No retries permitted until 2026-09-07 13:26:07.325606444 +0000 UTC m=+1594.382488080 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ed7c9509-464c-4e3b-83d6-b8db392ffdc2-maas-api-tls") pod "maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22" (UID: "ed7c9509-464c-4e3b-83d6-b8db392ffdc2") : secret "maas-api-e2e-ipp-b-8dc72a-serving-cert" not found
Sep 07 13:26:06.825954 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:06.825935    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed7c9509-464c-4e3b-83d6-b8db392ffdc2-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22\" (UID: \"ed7c9509-464c-4e3b-83d6-b8db392ffdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22"
Sep 07 13:26:06.827841 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:06.827815    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7c9509-464c-4e3b-83d6-b8db392ffdc2-metrics-certs\") pod \"maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22\" (UID: \"ed7c9509-464c-4e3b-83d6-b8db392ffdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22"
Sep 07 13:26:06.842328 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:06.841893    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kk55\" (UniqueName: \"kubernetes.io/projected/ed7c9509-464c-4e3b-83d6-b8db392ffdc2-kube-api-access-4kk55\") pod \"maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22\" (UID: \"ed7c9509-464c-4e3b-83d6-b8db392ffdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22"
Sep 07 13:26:06.877438 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:06.877410    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:07.006065 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:07.006041    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:07.331356 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:07.331330    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed7c9509-464c-4e3b-83d6-b8db392ffdc2-maas-api-tls\") pod \"maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22\" (UID: \"ed7c9509-464c-4e3b-83d6-b8db392ffdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22"
Sep 07 13:26:07.333664 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:07.333634    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed7c9509-464c-4e3b-83d6-b8db392ffdc2-maas-api-tls\") pod \"maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22\" (UID: \"ed7c9509-464c-4e3b-83d6-b8db392ffdc2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22"
Sep 07 13:26:07.565999 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:07.565964    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:07.569812 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:07.569788    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22"
Sep 07 13:26:07.668200 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:07.668167    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:07.853970 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:07.853849    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22"]
Sep 07 13:26:07.858116 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:26:07.858007    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded7c9509_464c_4e3b_83d6_b8db392ffdc2.slice/crio-ac90363e48b1e6c5a140d1363e4f6c5bf8912d6c6da31bfeda1365dd6d67484d WatchSource:0}: Error finding container ac90363e48b1e6c5a140d1363e4f6c5bf8912d6c6da31bfeda1365dd6d67484d: Status 404 returned error can't find the container with id ac90363e48b1e6c5a140d1363e4f6c5bf8912d6c6da31bfeda1365dd6d67484d
Sep 07 13:26:07.860010 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:07.859989    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 13:26:08.437615 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:08.437584    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22" event={"ID":"ed7c9509-464c-4e3b-83d6-b8db392ffdc2","Type":"ContainerStarted","Data":"b0fde163de0bbfa283399767759fc25c6a98978d23bd292de74d9df06a3dac8f"}
Sep 07 13:26:08.437761 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:08.437633    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22" event={"ID":"ed7c9509-464c-4e3b-83d6-b8db392ffdc2","Type":"ContainerStarted","Data":"ac90363e48b1e6c5a140d1363e4f6c5bf8912d6c6da31bfeda1365dd6d67484d"}
Sep 07 13:26:08.437761 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:08.437703    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22"
Sep 07 13:26:08.472004 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:08.471923    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22" podStartSLOduration=2.141270557 podStartE2EDuration="2.471910027s" totalImagesPullingTime="330.63947ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:26:08.470110977 +0000 UTC m=+1595.526992633" watchObservedRunningTime="2026-09-07 13:26:08.471910027 +0000 UTC m=+1595.528791715"
Sep 07 13:26:11.021899 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:11.021868    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:11.126958 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:11.126922    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:11.262307 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:11.262276    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"]
Sep 07 13:26:11.262523 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:11.262499    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp" podUID="a9d0d453-1fdf-40ea-aa7a-7c5c35803509" containerName="istio-proxy" containerID="cri-o://ec338f79b9dddf24b0b64e92be28deda2c8e45969795e71a7a79fe6a97f50e4f" gracePeriod=30
Sep 07 13:26:11.294165 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:11.294089    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:11.753561 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:11.753528    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:14.447503 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:14.447477    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22"
Sep 07 13:26:16.481863 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:16.481830    2576 generic.go:356] "Generic (PLEG): container finished" podID="a9d0d453-1fdf-40ea-aa7a-7c5c35803509" containerID="ec338f79b9dddf24b0b64e92be28deda2c8e45969795e71a7a79fe6a97f50e4f" exitCode=0
Sep 07 13:26:16.482245 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:16.481895    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp" event={"ID":"a9d0d453-1fdf-40ea-aa7a-7c5c35803509","Type":"ContainerDied","Data":"ec338f79b9dddf24b0b64e92be28deda2c8e45969795e71a7a79fe6a97f50e4f"}
Sep 07 13:26:16.482245 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:16.481958    2576 scope.go:117] "RemoveContainer" containerID="f94bb761c90b5a733a36a199b6a2e69e75ddc92fa5e2e6774f2c50fde8aaab84"
Sep 07 13:26:16.516259 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:16.516241    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:26:16.613624 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:16.613565    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-istio-data\") pod \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") "
Sep 07 13:26:16.613624 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:16.613595    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crpl5\" (UniqueName: \"kubernetes.io/projected/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-kube-api-access-crpl5\") pod \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") "
Sep 07 13:26:16.613624 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:16.613623    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-istio-envoy\") pod \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") "
Sep 07 13:26:16.613849 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:16.613645    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-credential-socket\") pod \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") "
Sep 07 13:26:16.613849 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:16.613699    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-istio-podinfo\") pod \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") "
Sep 07 13:26:16.613849 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:16.613725    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-istiod-ca-cert\") pod \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") "
Sep 07 13:26:16.613849 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:16.613749    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-workload-certs\") pod \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") "
Sep 07 13:26:16.613849 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:16.613819    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-istio-token\") pod \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") "
Sep 07 13:26:16.614096 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:16.613872    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-istio-data" (OuterVolumeSpecName: "istio-data") pod "a9d0d453-1fdf-40ea-aa7a-7c5c35803509" (UID: "a9d0d453-1fdf-40ea-aa7a-7c5c35803509"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:26:16.614096 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:16.613896    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-workload-socket\") pod \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\" (UID: \"a9d0d453-1fdf-40ea-aa7a-7c5c35803509\") "
Sep 07 13:26:16.614096 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:16.614039    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a9d0d453-1fdf-40ea-aa7a-7c5c35803509" (UID: "a9d0d453-1fdf-40ea-aa7a-7c5c35803509"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:26:16.614096 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:16.614055    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a9d0d453-1fdf-40ea-aa7a-7c5c35803509" (UID: "a9d0d453-1fdf-40ea-aa7a-7c5c35803509"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:26:16.614352 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:16.614220    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a9d0d453-1fdf-40ea-aa7a-7c5c35803509" (UID: "a9d0d453-1fdf-40ea-aa7a-7c5c35803509"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:26:16.614352 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:16.614291    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-credential-socket\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:26:16.614352 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:16.614306    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-workload-certs\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:26:16.614352 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:16.614319    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-workload-socket\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:26:16.614352 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:16.614329    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-istio-data\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:26:16.614757 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:16.614370    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a9d0d453-1fdf-40ea-aa7a-7c5c35803509" (UID: "a9d0d453-1fdf-40ea-aa7a-7c5c35803509"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:26:16.615990 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:16.615962    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a9d0d453-1fdf-40ea-aa7a-7c5c35803509" (UID: "a9d0d453-1fdf-40ea-aa7a-7c5c35803509"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 13:26:16.616086 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:16.616039    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-istio-token" (OuterVolumeSpecName: "istio-token") pod "a9d0d453-1fdf-40ea-aa7a-7c5c35803509" (UID: "a9d0d453-1fdf-40ea-aa7a-7c5c35803509"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:26:16.616178 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:16.616159    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-kube-api-access-crpl5" (OuterVolumeSpecName: "kube-api-access-crpl5") pod "a9d0d453-1fdf-40ea-aa7a-7c5c35803509" (UID: "a9d0d453-1fdf-40ea-aa7a-7c5c35803509"). InnerVolumeSpecName "kube-api-access-crpl5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:26:16.616238 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:16.616222    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a9d0d453-1fdf-40ea-aa7a-7c5c35803509" (UID: "a9d0d453-1fdf-40ea-aa7a-7c5c35803509"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:26:16.715499 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:16.715480    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crpl5\" (UniqueName: \"kubernetes.io/projected/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-kube-api-access-crpl5\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:26:16.715499 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:16.715500    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-istio-envoy\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:26:16.715610 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:16.715508    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-istio-podinfo\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:26:16.715610 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:16.715515    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-istiod-ca-cert\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:26:16.715610 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:16.715522    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a9d0d453-1fdf-40ea-aa7a-7c5c35803509-istio-token\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:26:17.487818 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:17.487791    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp" event={"ID":"a9d0d453-1fdf-40ea-aa7a-7c5c35803509","Type":"ContainerDied","Data":"df5a0098a9f36df72f5f5f15965eee157724f18bc95b8b216b83c43fe77f1068"}
Sep 07 13:26:17.487818 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:17.487811    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"
Sep 07 13:26:17.488164 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:17.487842    2576 scope.go:117] "RemoveContainer" containerID="ec338f79b9dddf24b0b64e92be28deda2c8e45969795e71a7a79fe6a97f50e4f"
Sep 07 13:26:17.510926 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:17.510904    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"]
Sep 07 13:26:17.512706 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:17.512688    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-a768a0-openshift-default-76f56f66bd-69pxp"]
Sep 07 13:26:19.365779 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:19.365735    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9d0d453-1fdf-40ea-aa7a-7c5c35803509" path="/var/lib/kubelet/pods/a9d0d453-1fdf-40ea-aa7a-7c5c35803509/volumes"
Sep 07 13:26:22.376464 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:22.376418    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:22.484076 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:22.484035    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:22.581498 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:22.581465    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:22.661089 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:22.660991    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:23.041682 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:23.041598    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:23.156279 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:23.156255    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:26:28.159246 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:28.159161    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:29.670994 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:29.670964    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:30.355831 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:30.355796    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:30.438835 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:30.438807    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:30.655736 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:30.655708    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"]
Sep 07 13:26:30.655971 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:30.655948    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj" podUID="05774f6d-335d-4493-8bd0-7ffa9afe5485" containerName="istio-proxy" containerID="cri-o://8f5289cc7e26e50c3f3e5eee5963a05db54a11715ea27666e4a088c06090b767" gracePeriod=30
Sep 07 13:26:30.677417 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:30.677389    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:31.192676 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:31.192644    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:35.899781 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:35.899750    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:26:35.989967 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:35.989911    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05774f6d-335d-4493-8bd0-7ffa9afe5485-istio-data\") pod \"05774f6d-335d-4493-8bd0-7ffa9afe5485\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") "
Sep 07 13:26:35.989967 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:35.989956    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05774f6d-335d-4493-8bd0-7ffa9afe5485-credential-socket\") pod \"05774f6d-335d-4493-8bd0-7ffa9afe5485\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") "
Sep 07 13:26:35.990102 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:35.989980    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05774f6d-335d-4493-8bd0-7ffa9afe5485-workload-certs\") pod \"05774f6d-335d-4493-8bd0-7ffa9afe5485\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") "
Sep 07 13:26:35.990102 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:35.990024    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05774f6d-335d-4493-8bd0-7ffa9afe5485-istio-envoy\") pod \"05774f6d-335d-4493-8bd0-7ffa9afe5485\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") "
Sep 07 13:26:35.990102 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:35.990053    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05774f6d-335d-4493-8bd0-7ffa9afe5485-workload-socket\") pod \"05774f6d-335d-4493-8bd0-7ffa9afe5485\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") "
Sep 07 13:26:35.990102 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:35.990090    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05774f6d-335d-4493-8bd0-7ffa9afe5485-istiod-ca-cert\") pod \"05774f6d-335d-4493-8bd0-7ffa9afe5485\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") "
Sep 07 13:26:35.990282 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:35.990130    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njrnj\" (UniqueName: \"kubernetes.io/projected/05774f6d-335d-4493-8bd0-7ffa9afe5485-kube-api-access-njrnj\") pod \"05774f6d-335d-4493-8bd0-7ffa9afe5485\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") "
Sep 07 13:26:35.990282 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:35.990176    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05774f6d-335d-4493-8bd0-7ffa9afe5485-istio-token\") pod \"05774f6d-335d-4493-8bd0-7ffa9afe5485\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") "
Sep 07 13:26:35.990282 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:35.990186    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05774f6d-335d-4493-8bd0-7ffa9afe5485-istio-data" (OuterVolumeSpecName: "istio-data") pod "05774f6d-335d-4493-8bd0-7ffa9afe5485" (UID: "05774f6d-335d-4493-8bd0-7ffa9afe5485"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:26:35.990282 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:35.990213    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05774f6d-335d-4493-8bd0-7ffa9afe5485-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "05774f6d-335d-4493-8bd0-7ffa9afe5485" (UID: "05774f6d-335d-4493-8bd0-7ffa9afe5485"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:26:35.990282 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:35.990228    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05774f6d-335d-4493-8bd0-7ffa9afe5485-istio-podinfo\") pod \"05774f6d-335d-4493-8bd0-7ffa9afe5485\" (UID: \"05774f6d-335d-4493-8bd0-7ffa9afe5485\") "
Sep 07 13:26:35.990282 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:35.990269    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05774f6d-335d-4493-8bd0-7ffa9afe5485-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "05774f6d-335d-4493-8bd0-7ffa9afe5485" (UID: "05774f6d-335d-4493-8bd0-7ffa9afe5485"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:26:35.990564 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:35.990302    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05774f6d-335d-4493-8bd0-7ffa9afe5485-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "05774f6d-335d-4493-8bd0-7ffa9afe5485" (UID: "05774f6d-335d-4493-8bd0-7ffa9afe5485"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:26:35.990564 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:35.990497    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05774f6d-335d-4493-8bd0-7ffa9afe5485-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "05774f6d-335d-4493-8bd0-7ffa9afe5485" (UID: "05774f6d-335d-4493-8bd0-7ffa9afe5485"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:26:35.990673 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:35.990575    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05774f6d-335d-4493-8bd0-7ffa9afe5485-istio-data\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:26:35.990673 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:35.990588    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05774f6d-335d-4493-8bd0-7ffa9afe5485-credential-socket\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:26:35.990673 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:35.990597    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05774f6d-335d-4493-8bd0-7ffa9afe5485-workload-certs\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:26:35.990673 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:35.990604    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05774f6d-335d-4493-8bd0-7ffa9afe5485-workload-socket\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:26:35.992334 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:35.992302    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05774f6d-335d-4493-8bd0-7ffa9afe5485-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "05774f6d-335d-4493-8bd0-7ffa9afe5485" (UID: "05774f6d-335d-4493-8bd0-7ffa9afe5485"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:26:35.992334 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:35.992323    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/05774f6d-335d-4493-8bd0-7ffa9afe5485-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "05774f6d-335d-4493-8bd0-7ffa9afe5485" (UID: "05774f6d-335d-4493-8bd0-7ffa9afe5485"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 13:26:35.992546 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:35.992522    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05774f6d-335d-4493-8bd0-7ffa9afe5485-istio-token" (OuterVolumeSpecName: "istio-token") pod "05774f6d-335d-4493-8bd0-7ffa9afe5485" (UID: "05774f6d-335d-4493-8bd0-7ffa9afe5485"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:26:35.992657 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:35.992638    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05774f6d-335d-4493-8bd0-7ffa9afe5485-kube-api-access-njrnj" (OuterVolumeSpecName: "kube-api-access-njrnj") pod "05774f6d-335d-4493-8bd0-7ffa9afe5485" (UID: "05774f6d-335d-4493-8bd0-7ffa9afe5485"). InnerVolumeSpecName "kube-api-access-njrnj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:26:36.091745 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:36.091722    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05774f6d-335d-4493-8bd0-7ffa9afe5485-istiod-ca-cert\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:26:36.091745 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:36.091741    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njrnj\" (UniqueName: \"kubernetes.io/projected/05774f6d-335d-4493-8bd0-7ffa9afe5485-kube-api-access-njrnj\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:26:36.091875 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:36.091750    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05774f6d-335d-4493-8bd0-7ffa9afe5485-istio-token\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:26:36.091875 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:36.091759    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05774f6d-335d-4493-8bd0-7ffa9afe5485-istio-podinfo\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:26:36.091875 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:36.091779    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05774f6d-335d-4493-8bd0-7ffa9afe5485-istio-envoy\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:26:36.346519 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:36.346469    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:26:36.585382 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:36.585364    2576 generic.go:356] "Generic (PLEG): container finished" podID="05774f6d-335d-4493-8bd0-7ffa9afe5485" containerID="8f5289cc7e26e50c3f3e5eee5963a05db54a11715ea27666e4a088c06090b767" exitCode=0
Sep 07 13:26:36.585494 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:36.585389    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj" event={"ID":"05774f6d-335d-4493-8bd0-7ffa9afe5485","Type":"ContainerDied","Data":"8f5289cc7e26e50c3f3e5eee5963a05db54a11715ea27666e4a088c06090b767"}
Sep 07 13:26:36.585494 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:36.585416    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"
Sep 07 13:26:36.585494 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:36.585428    2576 scope.go:117] "RemoveContainer" containerID="8f5289cc7e26e50c3f3e5eee5963a05db54a11715ea27666e4a088c06090b767"
Sep 07 13:26:36.585648 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:36.585419    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj" event={"ID":"05774f6d-335d-4493-8bd0-7ffa9afe5485","Type":"ContainerDied","Data":"832a33a0c454928369a78a57f0d7d2e4bf231dd808242f31195b0258bb42f00c"}
Sep 07 13:26:36.594620 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:36.594607    2576 scope.go:117] "RemoveContainer" containerID="f8c023a82d327a79f8a71d4708294e0b9e7cdb66ef484d48d757aa4d6a207206"
Sep 07 13:26:36.602433 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:36.602419    2576 scope.go:117] "RemoveContainer" containerID="8f5289cc7e26e50c3f3e5eee5963a05db54a11715ea27666e4a088c06090b767"
Sep 07 13:26:36.602684 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:26:36.602664    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f5289cc7e26e50c3f3e5eee5963a05db54a11715ea27666e4a088c06090b767\": container with ID starting with 8f5289cc7e26e50c3f3e5eee5963a05db54a11715ea27666e4a088c06090b767 not found: ID does not exist" containerID="8f5289cc7e26e50c3f3e5eee5963a05db54a11715ea27666e4a088c06090b767"
Sep 07 13:26:36.602737 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:36.602689    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f5289cc7e26e50c3f3e5eee5963a05db54a11715ea27666e4a088c06090b767"} err="failed to get container status \"8f5289cc7e26e50c3f3e5eee5963a05db54a11715ea27666e4a088c06090b767\": rpc error: code = NotFound desc = could not find container \"8f5289cc7e26e50c3f3e5eee5963a05db54a11715ea27666e4a088c06090b767\": container with ID starting with 8f5289cc7e26e50c3f3e5eee5963a05db54a11715ea27666e4a088c06090b767 not found: ID does not exist"
Sep 07 13:26:36.602737 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:36.602706    2576 scope.go:117] "RemoveContainer" containerID="f8c023a82d327a79f8a71d4708294e0b9e7cdb66ef484d48d757aa4d6a207206"
Sep 07 13:26:36.602948 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:26:36.602933    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8c023a82d327a79f8a71d4708294e0b9e7cdb66ef484d48d757aa4d6a207206\": container with ID starting with f8c023a82d327a79f8a71d4708294e0b9e7cdb66ef484d48d757aa4d6a207206 not found: ID does not exist" containerID="f8c023a82d327a79f8a71d4708294e0b9e7cdb66ef484d48d757aa4d6a207206"
Sep 07 13:26:36.602987 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:36.602955    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8c023a82d327a79f8a71d4708294e0b9e7cdb66ef484d48d757aa4d6a207206"} err="failed to get container status \"f8c023a82d327a79f8a71d4708294e0b9e7cdb66ef484d48d757aa4d6a207206\": rpc error: code = NotFound desc = could not find container \"f8c023a82d327a79f8a71d4708294e0b9e7cdb66ef484d48d757aa4d6a207206\": container with ID starting with f8c023a82d327a79f8a71d4708294e0b9e7cdb66ef484d48d757aa4d6a207206 not found: ID does not exist"
Sep 07 13:26:36.608237 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:36.608218    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"]
Sep 07 13:26:36.612888 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:36.612869    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d5da3f-openshift-default-5b6d7cfb6d-r4hrj"]
Sep 07 13:26:37.366026 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:37.365998    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05774f6d-335d-4493-8bd0-7ffa9afe5485" path="/var/lib/kubelet/pods/05774f6d-335d-4493-8bd0-7ffa9afe5485/volumes"
Sep 07 13:26:41.700531 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:41.700502    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:41.794920 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:41.794887    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:41.895064 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:41.895035    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:42.067008 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:42.066925    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:42.235789 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:42.235736    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:42.454486 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:42.454459    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:43.284974 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:43.284944    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:46.260659 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:46.260626    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:26:48.927132 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:48.927097    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:49.031270 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:49.031234    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:49.221890 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:49.221819    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"]
Sep 07 13:26:49.222065 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:49.222042    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x" podUID="6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67" containerName="istio-proxy" containerID="cri-o://734b6964c493c29520eb42b5daab25d0b4d0f44ea097df910554753477e56dee" gracePeriod=30
Sep 07 13:26:49.257307 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:49.257260    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:26:53.432292 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:53.432262    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 07 13:26:53.432730 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:53.432340    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x" podUID="6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 07 13:26:54.466021 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.465996    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:26:54.542607 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.542557    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-istio-envoy\") pod \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") "
Sep 07 13:26:54.542607 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.542588    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4rlxv\" (UniqueName: \"kubernetes.io/projected/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-kube-api-access-4rlxv\") pod \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") "
Sep 07 13:26:54.542868 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.542619    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-workload-certs\") pod \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") "
Sep 07 13:26:54.542868 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.542642    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-istio-podinfo\") pod \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") "
Sep 07 13:26:54.542868 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.542678    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-istio-data\") pod \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") "
Sep 07 13:26:54.542868 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.542752    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-credential-socket\") pod \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") "
Sep 07 13:26:54.542868 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.542821    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-istiod-ca-cert\") pod \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") "
Sep 07 13:26:54.543123 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.542881    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-workload-socket\") pod \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") "
Sep 07 13:26:54.543123 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.542923    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-istio-token\") pod \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\" (UID: \"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67\") "
Sep 07 13:26:54.543123 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.542961    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67" (UID: "6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:26:54.543123 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.543011    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-istio-data" (OuterVolumeSpecName: "istio-data") pod "6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67" (UID: "6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:26:54.543305 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.543170    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67" (UID: "6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:26:54.543305 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.543251    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67" (UID: "6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:26:54.543305 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.543253    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67" (UID: "6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:26:54.543424 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.543321    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-workload-socket\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:26:54.543424 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.543339    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-workload-certs\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:26:54.543424 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.543354    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-istio-data\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:26:54.544740 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.544714    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67" (UID: "6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:26:54.545188 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.545164    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-istio-token" (OuterVolumeSpecName: "istio-token") pod "6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67" (UID: "6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:26:54.545338 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.545319    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67" (UID: "6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 13:26:54.545381 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.545321    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-kube-api-access-4rlxv" (OuterVolumeSpecName: "kube-api-access-4rlxv") pod "6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67" (UID: "6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67"). InnerVolumeSpecName "kube-api-access-4rlxv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:26:54.643732 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.643710    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-istio-token\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:26:54.643732 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.643731    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-istio-envoy\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:26:54.643877 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.643740    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4rlxv\" (UniqueName: \"kubernetes.io/projected/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-kube-api-access-4rlxv\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:26:54.643877 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.643748    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-istio-podinfo\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:26:54.643877 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.643757    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-credential-socket\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:26:54.643877 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.643786    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67-istiod-ca-cert\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:26:54.683660 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.683634    2576 generic.go:356] "Generic (PLEG): container finished" podID="6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67" containerID="734b6964c493c29520eb42b5daab25d0b4d0f44ea097df910554753477e56dee" exitCode=0
Sep 07 13:26:54.683750 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.683682    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"
Sep 07 13:26:54.683750 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.683720    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x" event={"ID":"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67","Type":"ContainerDied","Data":"734b6964c493c29520eb42b5daab25d0b4d0f44ea097df910554753477e56dee"}
Sep 07 13:26:54.683851 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.683781    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x" event={"ID":"6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67","Type":"ContainerDied","Data":"fc847934b55c0672003307a18957d2147aea68f80fc0796673becdade0844c19"}
Sep 07 13:26:54.683851 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.683805    2576 scope.go:117] "RemoveContainer" containerID="734b6964c493c29520eb42b5daab25d0b4d0f44ea097df910554753477e56dee"
Sep 07 13:26:54.692271 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.692249    2576 scope.go:117] "RemoveContainer" containerID="4ed17ad73f1ef85026a59493c64274d771e537eba2806c321f247fd051dc16da"
Sep 07 13:26:54.699699 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.699685    2576 scope.go:117] "RemoveContainer" containerID="734b6964c493c29520eb42b5daab25d0b4d0f44ea097df910554753477e56dee"
Sep 07 13:26:54.699964 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:26:54.699948    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"734b6964c493c29520eb42b5daab25d0b4d0f44ea097df910554753477e56dee\": container with ID starting with 734b6964c493c29520eb42b5daab25d0b4d0f44ea097df910554753477e56dee not found: ID does not exist" containerID="734b6964c493c29520eb42b5daab25d0b4d0f44ea097df910554753477e56dee"
Sep 07 13:26:54.700027 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.699971    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"734b6964c493c29520eb42b5daab25d0b4d0f44ea097df910554753477e56dee"} err="failed to get container status \"734b6964c493c29520eb42b5daab25d0b4d0f44ea097df910554753477e56dee\": rpc error: code = NotFound desc = could not find container \"734b6964c493c29520eb42b5daab25d0b4d0f44ea097df910554753477e56dee\": container with ID starting with 734b6964c493c29520eb42b5daab25d0b4d0f44ea097df910554753477e56dee not found: ID does not exist"
Sep 07 13:26:54.700027 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.699985    2576 scope.go:117] "RemoveContainer" containerID="4ed17ad73f1ef85026a59493c64274d771e537eba2806c321f247fd051dc16da"
Sep 07 13:26:54.700193 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:26:54.700180    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ed17ad73f1ef85026a59493c64274d771e537eba2806c321f247fd051dc16da\": container with ID starting with 4ed17ad73f1ef85026a59493c64274d771e537eba2806c321f247fd051dc16da not found: ID does not exist" containerID="4ed17ad73f1ef85026a59493c64274d771e537eba2806c321f247fd051dc16da"
Sep 07 13:26:54.700228 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.700197    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ed17ad73f1ef85026a59493c64274d771e537eba2806c321f247fd051dc16da"} err="failed to get container status \"4ed17ad73f1ef85026a59493c64274d771e537eba2806c321f247fd051dc16da\": rpc error: code = NotFound desc = could not find container \"4ed17ad73f1ef85026a59493c64274d771e537eba2806c321f247fd051dc16da\": container with ID starting with 4ed17ad73f1ef85026a59493c64274d771e537eba2806c321f247fd051dc16da not found: ID does not exist"
Sep 07 13:26:54.709829 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.709809    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"]
Sep 07 13:26:54.715712 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:54.715693    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-8e7ddc-openshift-default-5cc85896f8-mtl7x"]
Sep 07 13:26:55.366883 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:26:55.366858    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67" path="/var/lib/kubelet/pods/6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67/volumes"
Sep 07 13:27:07.154141 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:07.154111    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:27:08.968375 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:08.968339    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:27:09.076160 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:09.076134    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:27:11.489993 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.489964    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:27:11.762266 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.762198    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"]
Sep 07 13:27:11.762571 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.762559    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67" containerName="istio-proxy"
Sep 07 13:27:11.762612 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.762574    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67" containerName="istio-proxy"
Sep 07 13:27:11.762612 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.762581    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9d0d453-1fdf-40ea-aa7a-7c5c35803509" containerName="istio-proxy"
Sep 07 13:27:11.762612 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.762586    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9d0d453-1fdf-40ea-aa7a-7c5c35803509" containerName="istio-proxy"
Sep 07 13:27:11.762612 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.762594    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9d0d453-1fdf-40ea-aa7a-7c5c35803509" containerName="istio-proxy"
Sep 07 13:27:11.762612 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.762598    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9d0d453-1fdf-40ea-aa7a-7c5c35803509" containerName="istio-proxy"
Sep 07 13:27:11.762612 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.762607    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05774f6d-335d-4493-8bd0-7ffa9afe5485" containerName="istio-proxy"
Sep 07 13:27:11.762612 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.762615    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="05774f6d-335d-4493-8bd0-7ffa9afe5485" containerName="istio-proxy"
Sep 07 13:27:11.762876 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.762630    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05774f6d-335d-4493-8bd0-7ffa9afe5485" containerName="istio-proxy"
Sep 07 13:27:11.762876 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.762636    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="05774f6d-335d-4493-8bd0-7ffa9afe5485" containerName="istio-proxy"
Sep 07 13:27:11.762876 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.762697    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67" containerName="istio-proxy"
Sep 07 13:27:11.762876 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.762705    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="05774f6d-335d-4493-8bd0-7ffa9afe5485" containerName="istio-proxy"
Sep 07 13:27:11.762876 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.762713    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="05774f6d-335d-4493-8bd0-7ffa9afe5485" containerName="istio-proxy"
Sep 07 13:27:11.762876 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.762724    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67" containerName="istio-proxy"
Sep 07 13:27:11.762876 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.762732    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9d0d453-1fdf-40ea-aa7a-7c5c35803509" containerName="istio-proxy"
Sep 07 13:27:11.762876 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.762741    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9d0d453-1fdf-40ea-aa7a-7c5c35803509" containerName="istio-proxy"
Sep 07 13:27:11.768050 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.768024    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:11.772792 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.772741    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-d14aa2-openshift-default-dockercfg-2xrbt\""
Sep 07 13:27:11.802836 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.802814    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"]
Sep 07 13:27:11.812032 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.812013    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:27:11.874549 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.874522    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl6lx\" (UniqueName: \"kubernetes.io/projected/c3ac8100-8321-490f-a8b1-60a9aacbce5c-kube-api-access-zl6lx\") pod \"e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") " pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:11.874729 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.874562    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3ac8100-8321-490f-a8b1-60a9aacbce5c-workload-certs\") pod \"e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") " pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:11.874729 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.874581    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3ac8100-8321-490f-a8b1-60a9aacbce5c-istio-token\") pod \"e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") " pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:11.874729 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.874678    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3ac8100-8321-490f-a8b1-60a9aacbce5c-istio-data\") pod \"e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") " pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:11.874950 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.874742    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3ac8100-8321-490f-a8b1-60a9aacbce5c-istio-podinfo\") pod \"e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") " pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:11.874950 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.874809    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3ac8100-8321-490f-a8b1-60a9aacbce5c-istiod-ca-cert\") pod \"e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") " pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:11.874950 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.874880    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3ac8100-8321-490f-a8b1-60a9aacbce5c-credential-socket\") pod \"e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") " pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:11.875074 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.874948    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3ac8100-8321-490f-a8b1-60a9aacbce5c-workload-socket\") pod \"e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") " pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:11.875074 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.874993    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3ac8100-8321-490f-a8b1-60a9aacbce5c-istio-envoy\") pod \"e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") " pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:11.976131 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.976110    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3ac8100-8321-490f-a8b1-60a9aacbce5c-workload-socket\") pod \"e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") " pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:11.976258 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.976143    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3ac8100-8321-490f-a8b1-60a9aacbce5c-istio-envoy\") pod \"e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") " pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:11.976258 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.976162    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl6lx\" (UniqueName: \"kubernetes.io/projected/c3ac8100-8321-490f-a8b1-60a9aacbce5c-kube-api-access-zl6lx\") pod \"e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") " pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:11.976258 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.976182    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3ac8100-8321-490f-a8b1-60a9aacbce5c-workload-certs\") pod \"e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") " pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:11.976258 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.976227    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3ac8100-8321-490f-a8b1-60a9aacbce5c-istio-token\") pod \"e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") " pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:11.976472 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.976278    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3ac8100-8321-490f-a8b1-60a9aacbce5c-istio-data\") pod \"e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") " pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:11.976472 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.976313    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3ac8100-8321-490f-a8b1-60a9aacbce5c-istio-podinfo\") pod \"e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") " pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:11.976472 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.976343    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3ac8100-8321-490f-a8b1-60a9aacbce5c-istiod-ca-cert\") pod \"e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") " pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:11.976472 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.976397    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3ac8100-8321-490f-a8b1-60a9aacbce5c-credential-socket\") pod \"e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") " pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:11.976676 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.976555    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3ac8100-8321-490f-a8b1-60a9aacbce5c-workload-socket\") pod \"e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") " pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:11.976676 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.976626    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3ac8100-8321-490f-a8b1-60a9aacbce5c-workload-certs\") pod \"e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") " pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:11.976802 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.976708    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3ac8100-8321-490f-a8b1-60a9aacbce5c-istio-data\") pod \"e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") " pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:11.976802 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.976747    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3ac8100-8321-490f-a8b1-60a9aacbce5c-credential-socket\") pod \"e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") " pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:11.977101 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.977049    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3ac8100-8321-490f-a8b1-60a9aacbce5c-istiod-ca-cert\") pod \"e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") " pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:11.978527 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.978508    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3ac8100-8321-490f-a8b1-60a9aacbce5c-istio-envoy\") pod \"e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") " pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:11.978820 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.978801    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3ac8100-8321-490f-a8b1-60a9aacbce5c-istio-podinfo\") pod \"e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") " pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:11.987780 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:11.987749    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl6lx\" (UniqueName: \"kubernetes.io/projected/c3ac8100-8321-490f-a8b1-60a9aacbce5c-kube-api-access-zl6lx\") pod \"e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") " pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:12.005691 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:12.005671    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3ac8100-8321-490f-a8b1-60a9aacbce5c-istio-token\") pod \"e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") " pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:12.065615 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:12.065552    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:27:12.079576 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:12.079553    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:12.366893 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:12.366872    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"]
Sep 07 13:27:12.369969 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:27:12.369941    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3ac8100_8321_490f_a8b1_60a9aacbce5c.slice/crio-3a30fed66f9258d2dce331f755a7b7ac43623934226cd20659aadef03a5a7a74 WatchSource:0}: Error finding container 3a30fed66f9258d2dce331f755a7b7ac43623934226cd20659aadef03a5a7a74: Status 404 returned error can't find the container with id 3a30fed66f9258d2dce331f755a7b7ac43623934226cd20659aadef03a5a7a74
Sep 07 13:27:12.372151 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:12.372119    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:27:12.372211 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:12.372185    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:27:12.372246 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:12.372215    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:27:12.779943 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:12.779905    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd" event={"ID":"c3ac8100-8321-490f-a8b1-60a9aacbce5c","Type":"ContainerStarted","Data":"2e8b163f94cca80c967dd3c2d412847e946dfe8d50c72ca6cb4d58b49233c16a"}
Sep 07 13:27:12.780410 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:12.779956    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd" event={"ID":"c3ac8100-8321-490f-a8b1-60a9aacbce5c","Type":"ContainerStarted","Data":"3a30fed66f9258d2dce331f755a7b7ac43623934226cd20659aadef03a5a7a74"}
Sep 07 13:27:12.821919 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:12.821874    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd" podStartSLOduration=1.8218588100000002 podStartE2EDuration="1.82185881s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:27:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:27:12.818408833 +0000 UTC m=+1659.875290511" watchObservedRunningTime="2026-09-07 13:27:12.82185881 +0000 UTC m=+1659.878740466"
Sep 07 13:27:13.080405 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:13.080334    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:13.085123 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:13.085102    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:13.785952 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:13.785926    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:13.786840 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:13.786821    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:14.838138 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:14.838100    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:27:14.976862 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:14.976828    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:27:15.084584 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:15.084545    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:27:16.007670 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:16.007640    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc"]
Sep 07 13:27:16.008033 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:16.008024    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67" containerName="istio-proxy"
Sep 07 13:27:16.008086 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:16.008035    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b03c29c-6bb7-4c0e-9453-ec6b9e9ced67" containerName="istio-proxy"
Sep 07 13:27:16.011271 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:16.011252    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc"
Sep 07 13:27:16.014284 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:16.014262    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-d14aa2-serving-cert\""
Sep 07 13:27:16.026875 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:16.026855    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc"]
Sep 07 13:27:16.068340 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:16.068310    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:27:16.111610 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:16.111584    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6b009ea-e64b-46a6-9278-390b938f0f33-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc\" (UID: \"f6b009ea-e64b-46a6-9278-390b938f0f33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc"
Sep 07 13:27:16.111728 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:16.111638    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6b009ea-e64b-46a6-9278-390b938f0f33-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc\" (UID: \"f6b009ea-e64b-46a6-9278-390b938f0f33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc"
Sep 07 13:27:16.111728 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:16.111691    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l25vm\" (UniqueName: \"kubernetes.io/projected/f6b009ea-e64b-46a6-9278-390b938f0f33-kube-api-access-l25vm\") pod \"maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc\" (UID: \"f6b009ea-e64b-46a6-9278-390b938f0f33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc"
Sep 07 13:27:16.111841 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:16.111808    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6b009ea-e64b-46a6-9278-390b938f0f33-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc\" (UID: \"f6b009ea-e64b-46a6-9278-390b938f0f33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc"
Sep 07 13:27:16.168753 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:16.168719    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:27:16.212250 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:16.212223    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6b009ea-e64b-46a6-9278-390b938f0f33-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc\" (UID: \"f6b009ea-e64b-46a6-9278-390b938f0f33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc"
Sep 07 13:27:16.212348 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:16.212261    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l25vm\" (UniqueName: \"kubernetes.io/projected/f6b009ea-e64b-46a6-9278-390b938f0f33-kube-api-access-l25vm\") pod \"maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc\" (UID: \"f6b009ea-e64b-46a6-9278-390b938f0f33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc"
Sep 07 13:27:16.212348 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:16.212311    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6b009ea-e64b-46a6-9278-390b938f0f33-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc\" (UID: \"f6b009ea-e64b-46a6-9278-390b938f0f33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc"
Sep 07 13:27:16.212348 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:16.212341    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6b009ea-e64b-46a6-9278-390b938f0f33-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc\" (UID: \"f6b009ea-e64b-46a6-9278-390b938f0f33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc"
Sep 07 13:27:16.212848 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:16.212827    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6b009ea-e64b-46a6-9278-390b938f0f33-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc\" (UID: \"f6b009ea-e64b-46a6-9278-390b938f0f33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc"
Sep 07 13:27:16.214842 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:16.214826    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6b009ea-e64b-46a6-9278-390b938f0f33-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc\" (UID: \"f6b009ea-e64b-46a6-9278-390b938f0f33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc"
Sep 07 13:27:16.214909 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:16.214855    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6b009ea-e64b-46a6-9278-390b938f0f33-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc\" (UID: \"f6b009ea-e64b-46a6-9278-390b938f0f33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc"
Sep 07 13:27:16.220715 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:16.220697    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l25vm\" (UniqueName: \"kubernetes.io/projected/f6b009ea-e64b-46a6-9278-390b938f0f33-kube-api-access-l25vm\") pod \"maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc\" (UID: \"f6b009ea-e64b-46a6-9278-390b938f0f33\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc"
Sep 07 13:27:16.267667 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:16.267612    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:27:16.322226 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:16.322205    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc"
Sep 07 13:27:16.594352 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:16.594332    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc"]
Sep 07 13:27:16.596401 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:27:16.596379    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6b009ea_e64b_46a6_9278_390b938f0f33.slice/crio-9ae72b3d681ca89ab0b47e38f70c4780de2645bfe747df5944ce883b8517333f WatchSource:0}: Error finding container 9ae72b3d681ca89ab0b47e38f70c4780de2645bfe747df5944ce883b8517333f: Status 404 returned error can't find the container with id 9ae72b3d681ca89ab0b47e38f70c4780de2645bfe747df5944ce883b8517333f
Sep 07 13:27:16.761856 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:16.761814    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:27:16.801588 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:16.801560    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc" event={"ID":"f6b009ea-e64b-46a6-9278-390b938f0f33","Type":"ContainerStarted","Data":"9ae72b3d681ca89ab0b47e38f70c4780de2645bfe747df5944ce883b8517333f"}
Sep 07 13:27:16.859163 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:16.859085    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:27:17.808439 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:17.808410    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc" event={"ID":"f6b009ea-e64b-46a6-9278-390b938f0f33","Type":"ContainerStarted","Data":"2c56a0cc5d09aceddda13c551e8ccf72eabab55f80d1d0217e00c500bb3a3cfa"}
Sep 07 13:27:17.808837 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:17.808535    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc"
Sep 07 13:27:17.846340 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:17.846302    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc" podStartSLOduration=2.313977184 podStartE2EDuration="2.846288316s" totalImagesPullingTime="532.311132ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:27:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:27:17.842717586 +0000 UTC m=+1664.899599242" watchObservedRunningTime="2026-09-07 13:27:17.846288316 +0000 UTC m=+1664.903169988"
Sep 07 13:27:23.479978 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:23.479948    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:27:23.818463 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:23.818377    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc"
Sep 07 13:27:33.725388 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:33.725362    2576 scope.go:117] "RemoveContainer" containerID="d87ae150156eb60f7ba1cccd240c6d5112fd2bcf1d3f244538377256ce4801fb"
Sep 07 13:27:33.732852 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:33.732835    2576 scope.go:117] "RemoveContainer" containerID="b7b9d0ad552771aef365836bba4c8e8fd47439228c3b6ec1af3acda8f11f4a37"
Sep 07 13:27:33.905696 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:33.905670    2576 generic.go:356] "Generic (PLEG): container finished" podID="c3ac8100-8321-490f-a8b1-60a9aacbce5c" containerID="2e8b163f94cca80c967dd3c2d412847e946dfe8d50c72ca6cb4d58b49233c16a" exitCode=0
Sep 07 13:27:33.905802 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:33.905706    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd" event={"ID":"c3ac8100-8321-490f-a8b1-60a9aacbce5c","Type":"ContainerDied","Data":"2e8b163f94cca80c967dd3c2d412847e946dfe8d50c72ca6cb4d58b49233c16a"}
Sep 07 13:27:33.906030 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:33.906017    2576 scope.go:117] "RemoveContainer" containerID="2e8b163f94cca80c967dd3c2d412847e946dfe8d50c72ca6cb4d58b49233c16a"
Sep 07 13:27:33.907059 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:33.907028    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:27:33.907120 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:33.907101    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:27:33.907163 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:33.907131    2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892152Ki","pods":"250"}
Sep 07 13:27:34.913124 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:34.913094    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd" event={"ID":"c3ac8100-8321-490f-a8b1-60a9aacbce5c","Type":"ContainerStarted","Data":"01593a466e10bc944c7b72e6cfe4776baa1be97891bebd5be657cc389aa66ea8"}
Sep 07 13:27:35.080261 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:35.080219    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:35.080472 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:35.080341    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 07 13:27:35.080472 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:35.080380    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd" podUID="c3ac8100-8321-490f-a8b1-60a9aacbce5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 07 13:27:36.080619 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:36.080576    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 07 13:27:36.081102 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:36.080639    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd" podUID="c3ac8100-8321-490f-a8b1-60a9aacbce5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 07 13:27:37.080129 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:37.080095    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 07 13:27:37.080415 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:37.080386    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd" podUID="c3ac8100-8321-490f-a8b1-60a9aacbce5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 07 13:27:38.080128 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:38.080093    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 07 13:27:38.080745 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:38.080713    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd" podUID="c3ac8100-8321-490f-a8b1-60a9aacbce5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 07 13:27:39.080179 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:39.080139    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Sep 07 13:27:39.080706 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:39.080201    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd" podUID="c3ac8100-8321-490f-a8b1-60a9aacbce5c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Sep 07 13:27:39.867275 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:39.867221    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:27:40.083888 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:40.083861    2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:40.084275 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:40.084116    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:40.084741 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:40.084727    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:46.882272 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:46.882242    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc"]
Sep 07 13:27:46.882695 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:46.882478    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc" podUID="f6b009ea-e64b-46a6-9278-390b938f0f33" containerName="maas-api" containerID="cri-o://2c56a0cc5d09aceddda13c551e8ccf72eabab55f80d1d0217e00c500bb3a3cfa" gracePeriod=30
Sep 07 13:27:46.903250 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:46.903222    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:27:47.029935 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:47.029898    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:27:47.128182 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:47.128159    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc"
Sep 07 13:27:47.176878 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:47.176824    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6b009ea-e64b-46a6-9278-390b938f0f33-metrics-certs\") pod \"f6b009ea-e64b-46a6-9278-390b938f0f33\" (UID: \"f6b009ea-e64b-46a6-9278-390b938f0f33\") "
Sep 07 13:27:47.176878 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:47.176869    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l25vm\" (UniqueName: \"kubernetes.io/projected/f6b009ea-e64b-46a6-9278-390b938f0f33-kube-api-access-l25vm\") pod \"f6b009ea-e64b-46a6-9278-390b938f0f33\" (UID: \"f6b009ea-e64b-46a6-9278-390b938f0f33\") "
Sep 07 13:27:47.177032 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:47.176885    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6b009ea-e64b-46a6-9278-390b938f0f33-openshift-service-ca\") pod \"f6b009ea-e64b-46a6-9278-390b938f0f33\" (UID: \"f6b009ea-e64b-46a6-9278-390b938f0f33\") "
Sep 07 13:27:47.177032 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:47.176905    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6b009ea-e64b-46a6-9278-390b938f0f33-maas-api-tls\") pod \"f6b009ea-e64b-46a6-9278-390b938f0f33\" (UID: \"f6b009ea-e64b-46a6-9278-390b938f0f33\") "
Sep 07 13:27:47.177238 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:47.177213    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6b009ea-e64b-46a6-9278-390b938f0f33-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f6b009ea-e64b-46a6-9278-390b938f0f33" (UID: "f6b009ea-e64b-46a6-9278-390b938f0f33"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:27:47.179018 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:47.178993    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6b009ea-e64b-46a6-9278-390b938f0f33-kube-api-access-l25vm" (OuterVolumeSpecName: "kube-api-access-l25vm") pod "f6b009ea-e64b-46a6-9278-390b938f0f33" (UID: "f6b009ea-e64b-46a6-9278-390b938f0f33"). InnerVolumeSpecName "kube-api-access-l25vm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:27:47.179115 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:47.179040    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6b009ea-e64b-46a6-9278-390b938f0f33-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f6b009ea-e64b-46a6-9278-390b938f0f33" (UID: "f6b009ea-e64b-46a6-9278-390b938f0f33"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:27:47.179115 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:47.179058    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f6b009ea-e64b-46a6-9278-390b938f0f33-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f6b009ea-e64b-46a6-9278-390b938f0f33" (UID: "f6b009ea-e64b-46a6-9278-390b938f0f33"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:27:47.213910 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:47.213840    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:27:47.277606 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:47.277572    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f6b009ea-e64b-46a6-9278-390b938f0f33-metrics-certs\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:27:47.277606 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:47.277599    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l25vm\" (UniqueName: \"kubernetes.io/projected/f6b009ea-e64b-46a6-9278-390b938f0f33-kube-api-access-l25vm\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:27:47.277606 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:47.277613    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f6b009ea-e64b-46a6-9278-390b938f0f33-openshift-service-ca\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:27:47.277857 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:47.277624    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f6b009ea-e64b-46a6-9278-390b938f0f33-maas-api-tls\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:27:47.396313 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:47.396283    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:27:47.484422 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:47.484353    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:27:47.804472 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:47.804395    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:27:47.982887 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:47.982863    2576 generic.go:356] "Generic (PLEG): container finished" podID="f6b009ea-e64b-46a6-9278-390b938f0f33" containerID="2c56a0cc5d09aceddda13c551e8ccf72eabab55f80d1d0217e00c500bb3a3cfa" exitCode=0
Sep 07 13:27:47.983292 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:47.982917    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc"
Sep 07 13:27:47.983292 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:47.982943    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc" event={"ID":"f6b009ea-e64b-46a6-9278-390b938f0f33","Type":"ContainerDied","Data":"2c56a0cc5d09aceddda13c551e8ccf72eabab55f80d1d0217e00c500bb3a3cfa"}
Sep 07 13:27:47.983292 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:47.982991    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc" event={"ID":"f6b009ea-e64b-46a6-9278-390b938f0f33","Type":"ContainerDied","Data":"9ae72b3d681ca89ab0b47e38f70c4780de2645bfe747df5944ce883b8517333f"}
Sep 07 13:27:47.983292 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:47.983015    2576 scope.go:117] "RemoveContainer" containerID="2c56a0cc5d09aceddda13c551e8ccf72eabab55f80d1d0217e00c500bb3a3cfa"
Sep 07 13:27:47.991672 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:47.991657    2576 scope.go:117] "RemoveContainer" containerID="2c56a0cc5d09aceddda13c551e8ccf72eabab55f80d1d0217e00c500bb3a3cfa"
Sep 07 13:27:47.991948 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:27:47.991930    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c56a0cc5d09aceddda13c551e8ccf72eabab55f80d1d0217e00c500bb3a3cfa\": container with ID starting with 2c56a0cc5d09aceddda13c551e8ccf72eabab55f80d1d0217e00c500bb3a3cfa not found: ID does not exist" containerID="2c56a0cc5d09aceddda13c551e8ccf72eabab55f80d1d0217e00c500bb3a3cfa"
Sep 07 13:27:47.992004 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:47.991960    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c56a0cc5d09aceddda13c551e8ccf72eabab55f80d1d0217e00c500bb3a3cfa"} err="failed to get container status \"2c56a0cc5d09aceddda13c551e8ccf72eabab55f80d1d0217e00c500bb3a3cfa\": rpc error: code = NotFound desc = could not find container \"2c56a0cc5d09aceddda13c551e8ccf72eabab55f80d1d0217e00c500bb3a3cfa\": container with ID starting with 2c56a0cc5d09aceddda13c551e8ccf72eabab55f80d1d0217e00c500bb3a3cfa not found: ID does not exist"
Sep 07 13:27:48.005489 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:48.005472    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc"]
Sep 07 13:27:48.010178 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:48.010152    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-d14aa2-66dd844f6d-t9szc"]
Sep 07 13:27:49.366819 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:49.366739    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6b009ea-e64b-46a6-9278-390b938f0f33" path="/var/lib/kubelet/pods/f6b009ea-e64b-46a6-9278-390b938f0f33/volumes"
Sep 07 13:27:51.948502 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:51.948469    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:27:54.290725 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:54.290695    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:27:54.427051 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:54.427014    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:27:54.564010 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:54.563939    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"]
Sep 07 13:27:54.564171 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:54.564149    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd" podUID="c3ac8100-8321-490f-a8b1-60a9aacbce5c" containerName="istio-proxy" containerID="cri-o://01593a466e10bc944c7b72e6cfe4776baa1be97891bebd5be657cc389aa66ea8" gracePeriod=30
Sep 07 13:27:54.586950 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:54.586912    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:27:55.086832 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:55.086799    2576 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 07 13:27:55.086974 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:55.086865    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd" podUID="c3ac8100-8321-490f-a8b1-60a9aacbce5c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 07 13:27:58.409310 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:58.409260    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:27:59.809551 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:59.809530    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:27:59.881982 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:59.881958    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3ac8100-8321-490f-a8b1-60a9aacbce5c-credential-socket\") pod \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") "
Sep 07 13:27:59.882093 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:59.882004    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3ac8100-8321-490f-a8b1-60a9aacbce5c-workload-socket\") pod \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") "
Sep 07 13:27:59.882093 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:59.882020    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3ac8100-8321-490f-a8b1-60a9aacbce5c-istio-envoy\") pod \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") "
Sep 07 13:27:59.882093 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:59.882044    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zl6lx\" (UniqueName: \"kubernetes.io/projected/c3ac8100-8321-490f-a8b1-60a9aacbce5c-kube-api-access-zl6lx\") pod \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") "
Sep 07 13:27:59.882093 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:59.882083    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3ac8100-8321-490f-a8b1-60a9aacbce5c-istio-podinfo\") pod \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") "
Sep 07 13:27:59.882272 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:59.882210    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3ac8100-8321-490f-a8b1-60a9aacbce5c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c3ac8100-8321-490f-a8b1-60a9aacbce5c" (UID: "c3ac8100-8321-490f-a8b1-60a9aacbce5c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:27:59.882272 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:59.882221    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3ac8100-8321-490f-a8b1-60a9aacbce5c-istio-data\") pod \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") "
Sep 07 13:27:59.882370 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:59.882267    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3ac8100-8321-490f-a8b1-60a9aacbce5c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c3ac8100-8321-490f-a8b1-60a9aacbce5c" (UID: "c3ac8100-8321-490f-a8b1-60a9aacbce5c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:27:59.882370 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:59.882279    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3ac8100-8321-490f-a8b1-60a9aacbce5c-istio-token\") pod \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") "
Sep 07 13:27:59.882370 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:59.882312    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3ac8100-8321-490f-a8b1-60a9aacbce5c-istiod-ca-cert\") pod \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") "
Sep 07 13:27:59.882370 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:59.882364    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3ac8100-8321-490f-a8b1-60a9aacbce5c-workload-certs\") pod \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\" (UID: \"c3ac8100-8321-490f-a8b1-60a9aacbce5c\") "
Sep 07 13:27:59.882548 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:59.882451    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3ac8100-8321-490f-a8b1-60a9aacbce5c-istio-data" (OuterVolumeSpecName: "istio-data") pod "c3ac8100-8321-490f-a8b1-60a9aacbce5c" (UID: "c3ac8100-8321-490f-a8b1-60a9aacbce5c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:27:59.882654 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:59.882635    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3ac8100-8321-490f-a8b1-60a9aacbce5c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c3ac8100-8321-490f-a8b1-60a9aacbce5c" (UID: "c3ac8100-8321-490f-a8b1-60a9aacbce5c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:27:59.882887 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:59.882652    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3ac8100-8321-490f-a8b1-60a9aacbce5c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c3ac8100-8321-490f-a8b1-60a9aacbce5c" (UID: "c3ac8100-8321-490f-a8b1-60a9aacbce5c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:27:59.882887 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:59.882798    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3ac8100-8321-490f-a8b1-60a9aacbce5c-workload-socket\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:27:59.882887 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:59.882817    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3ac8100-8321-490f-a8b1-60a9aacbce5c-istio-data\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:27:59.883053 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:59.882871    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3ac8100-8321-490f-a8b1-60a9aacbce5c-istiod-ca-cert\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:27:59.883053 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:59.882987    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3ac8100-8321-490f-a8b1-60a9aacbce5c-workload-certs\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:27:59.883053 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:59.883013    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3ac8100-8321-490f-a8b1-60a9aacbce5c-credential-socket\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:27:59.884164 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:59.884140    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c3ac8100-8321-490f-a8b1-60a9aacbce5c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c3ac8100-8321-490f-a8b1-60a9aacbce5c" (UID: "c3ac8100-8321-490f-a8b1-60a9aacbce5c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 13:27:59.884263 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:59.884215    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3ac8100-8321-490f-a8b1-60a9aacbce5c-kube-api-access-zl6lx" (OuterVolumeSpecName: "kube-api-access-zl6lx") pod "c3ac8100-8321-490f-a8b1-60a9aacbce5c" (UID: "c3ac8100-8321-490f-a8b1-60a9aacbce5c"). InnerVolumeSpecName "kube-api-access-zl6lx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:27:59.884384 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:59.884367    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3ac8100-8321-490f-a8b1-60a9aacbce5c-istio-token" (OuterVolumeSpecName: "istio-token") pod "c3ac8100-8321-490f-a8b1-60a9aacbce5c" (UID: "c3ac8100-8321-490f-a8b1-60a9aacbce5c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:27:59.884594 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:59.884580    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3ac8100-8321-490f-a8b1-60a9aacbce5c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c3ac8100-8321-490f-a8b1-60a9aacbce5c" (UID: "c3ac8100-8321-490f-a8b1-60a9aacbce5c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:27:59.983672 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:59.983655    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3ac8100-8321-490f-a8b1-60a9aacbce5c-istio-token\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:27:59.983672 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:59.983672    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3ac8100-8321-490f-a8b1-60a9aacbce5c-istio-envoy\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:27:59.983815 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:59.983683    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zl6lx\" (UniqueName: \"kubernetes.io/projected/c3ac8100-8321-490f-a8b1-60a9aacbce5c-kube-api-access-zl6lx\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:27:59.983815 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:27:59.983691    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3ac8100-8321-490f-a8b1-60a9aacbce5c-istio-podinfo\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:28:00.046453 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:00.046427    2576 generic.go:356] "Generic (PLEG): container finished" podID="c3ac8100-8321-490f-a8b1-60a9aacbce5c" containerID="01593a466e10bc944c7b72e6cfe4776baa1be97891bebd5be657cc389aa66ea8" exitCode=0
Sep 07 13:28:00.046559 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:00.046456    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd" event={"ID":"c3ac8100-8321-490f-a8b1-60a9aacbce5c","Type":"ContainerDied","Data":"01593a466e10bc944c7b72e6cfe4776baa1be97891bebd5be657cc389aa66ea8"}
Sep 07 13:28:00.046559 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:00.046478    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"
Sep 07 13:28:00.046559 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:00.046491    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd" event={"ID":"c3ac8100-8321-490f-a8b1-60a9aacbce5c","Type":"ContainerDied","Data":"3a30fed66f9258d2dce331f755a7b7ac43623934226cd20659aadef03a5a7a74"}
Sep 07 13:28:00.046559 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:00.046513    2576 scope.go:117] "RemoveContainer" containerID="01593a466e10bc944c7b72e6cfe4776baa1be97891bebd5be657cc389aa66ea8"
Sep 07 13:28:00.063090 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:00.063064    2576 scope.go:117] "RemoveContainer" containerID="2e8b163f94cca80c967dd3c2d412847e946dfe8d50c72ca6cb4d58b49233c16a"
Sep 07 13:28:00.071309 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:00.071290    2576 scope.go:117] "RemoveContainer" containerID="01593a466e10bc944c7b72e6cfe4776baa1be97891bebd5be657cc389aa66ea8"
Sep 07 13:28:00.071553 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:28:00.071536    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01593a466e10bc944c7b72e6cfe4776baa1be97891bebd5be657cc389aa66ea8\": container with ID starting with 01593a466e10bc944c7b72e6cfe4776baa1be97891bebd5be657cc389aa66ea8 not found: ID does not exist" containerID="01593a466e10bc944c7b72e6cfe4776baa1be97891bebd5be657cc389aa66ea8"
Sep 07 13:28:00.071612 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:00.071561    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01593a466e10bc944c7b72e6cfe4776baa1be97891bebd5be657cc389aa66ea8"} err="failed to get container status \"01593a466e10bc944c7b72e6cfe4776baa1be97891bebd5be657cc389aa66ea8\": rpc error: code = NotFound desc = could not find container \"01593a466e10bc944c7b72e6cfe4776baa1be97891bebd5be657cc389aa66ea8\": container with ID starting with 01593a466e10bc944c7b72e6cfe4776baa1be97891bebd5be657cc389aa66ea8 not found: ID does not exist"
Sep 07 13:28:00.071612 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:00.071581    2576 scope.go:117] "RemoveContainer" containerID="2e8b163f94cca80c967dd3c2d412847e946dfe8d50c72ca6cb4d58b49233c16a"
Sep 07 13:28:00.071860 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:28:00.071842    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e8b163f94cca80c967dd3c2d412847e946dfe8d50c72ca6cb4d58b49233c16a\": container with ID starting with 2e8b163f94cca80c967dd3c2d412847e946dfe8d50c72ca6cb4d58b49233c16a not found: ID does not exist" containerID="2e8b163f94cca80c967dd3c2d412847e946dfe8d50c72ca6cb4d58b49233c16a"
Sep 07 13:28:00.071903 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:00.071867    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e8b163f94cca80c967dd3c2d412847e946dfe8d50c72ca6cb4d58b49233c16a"} err="failed to get container status \"2e8b163f94cca80c967dd3c2d412847e946dfe8d50c72ca6cb4d58b49233c16a\": rpc error: code = NotFound desc = could not find container \"2e8b163f94cca80c967dd3c2d412847e946dfe8d50c72ca6cb4d58b49233c16a\": container with ID starting with 2e8b163f94cca80c967dd3c2d412847e946dfe8d50c72ca6cb4d58b49233c16a not found: ID does not exist"
Sep 07 13:28:00.077990 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:00.077967    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"]
Sep 07 13:28:00.083318 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:00.083299    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-d14aa2-openshift-default-7d6db94cdb-htvcd"]
Sep 07 13:28:01.366391 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:01.366360    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3ac8100-8321-490f-a8b1-60a9aacbce5c" path="/var/lib/kubelet/pods/c3ac8100-8321-490f-a8b1-60a9aacbce5c/volumes"
Sep 07 13:28:13.860190 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:13.860151    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp"]
Sep 07 13:28:13.860693 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:13.860401    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp" podUID="f2d700c7-e0bc-4b3f-a562-4df1fb667ef9" containerName="maas-api" containerID="cri-o://7c92311dc54b3f841b88ad302005edf754e1fd00177d13e3e7210d5bdbd0c2df" gracePeriod=30
Sep 07 13:28:13.896244 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:13.896214    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:28:13.961570 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:13.961540    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:28:13.997172 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:13.997136    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:28:14.104207 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:14.104184    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp"
Sep 07 13:28:14.108890 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:14.108818    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:28:14.115044 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:14.114995    2576 generic.go:356] "Generic (PLEG): container finished" podID="f2d700c7-e0bc-4b3f-a562-4df1fb667ef9" containerID="7c92311dc54b3f841b88ad302005edf754e1fd00177d13e3e7210d5bdbd0c2df" exitCode=0
Sep 07 13:28:14.115125 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:14.115045    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp"
Sep 07 13:28:14.115125 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:14.115054    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp" event={"ID":"f2d700c7-e0bc-4b3f-a562-4df1fb667ef9","Type":"ContainerDied","Data":"7c92311dc54b3f841b88ad302005edf754e1fd00177d13e3e7210d5bdbd0c2df"}
Sep 07 13:28:14.115125 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:14.115095    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp" event={"ID":"f2d700c7-e0bc-4b3f-a562-4df1fb667ef9","Type":"ContainerDied","Data":"24c484f8b39ab7a308d2a0628d4dbca535a59cc86a26fd18291eea6e0388c3fe"}
Sep 07 13:28:14.115125 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:14.115124    2576 scope.go:117] "RemoveContainer" containerID="7c92311dc54b3f841b88ad302005edf754e1fd00177d13e3e7210d5bdbd0c2df"
Sep 07 13:28:14.124759 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:14.124743    2576 scope.go:117] "RemoveContainer" containerID="7c92311dc54b3f841b88ad302005edf754e1fd00177d13e3e7210d5bdbd0c2df"
Sep 07 13:28:14.125042 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:28:14.125023    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c92311dc54b3f841b88ad302005edf754e1fd00177d13e3e7210d5bdbd0c2df\": container with ID starting with 7c92311dc54b3f841b88ad302005edf754e1fd00177d13e3e7210d5bdbd0c2df not found: ID does not exist" containerID="7c92311dc54b3f841b88ad302005edf754e1fd00177d13e3e7210d5bdbd0c2df"
Sep 07 13:28:14.125094 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:14.125051    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c92311dc54b3f841b88ad302005edf754e1fd00177d13e3e7210d5bdbd0c2df"} err="failed to get container status \"7c92311dc54b3f841b88ad302005edf754e1fd00177d13e3e7210d5bdbd0c2df\": rpc error: code = NotFound desc = could not find container \"7c92311dc54b3f841b88ad302005edf754e1fd00177d13e3e7210d5bdbd0c2df\": container with ID starting with 7c92311dc54b3f841b88ad302005edf754e1fd00177d13e3e7210d5bdbd0c2df not found: ID does not exist"
Sep 07 13:28:14.198335 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:14.198305    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2d700c7-e0bc-4b3f-a562-4df1fb667ef9-maas-api-tls\") pod \"f2d700c7-e0bc-4b3f-a562-4df1fb667ef9\" (UID: \"f2d700c7-e0bc-4b3f-a562-4df1fb667ef9\") "
Sep 07 13:28:14.198486 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:14.198347    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2d700c7-e0bc-4b3f-a562-4df1fb667ef9-metrics-certs\") pod \"f2d700c7-e0bc-4b3f-a562-4df1fb667ef9\" (UID: \"f2d700c7-e0bc-4b3f-a562-4df1fb667ef9\") "
Sep 07 13:28:14.198486 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:14.198370    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2d700c7-e0bc-4b3f-a562-4df1fb667ef9-openshift-service-ca\") pod \"f2d700c7-e0bc-4b3f-a562-4df1fb667ef9\" (UID: \"f2d700c7-e0bc-4b3f-a562-4df1fb667ef9\") "
Sep 07 13:28:14.198486 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:14.198434    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b7npc\" (UniqueName: \"kubernetes.io/projected/f2d700c7-e0bc-4b3f-a562-4df1fb667ef9-kube-api-access-b7npc\") pod \"f2d700c7-e0bc-4b3f-a562-4df1fb667ef9\" (UID: \"f2d700c7-e0bc-4b3f-a562-4df1fb667ef9\") "
Sep 07 13:28:14.198783 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:14.198745    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2d700c7-e0bc-4b3f-a562-4df1fb667ef9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f2d700c7-e0bc-4b3f-a562-4df1fb667ef9" (UID: "f2d700c7-e0bc-4b3f-a562-4df1fb667ef9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:28:14.200627 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:14.200594    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2d700c7-e0bc-4b3f-a562-4df1fb667ef9-kube-api-access-b7npc" (OuterVolumeSpecName: "kube-api-access-b7npc") pod "f2d700c7-e0bc-4b3f-a562-4df1fb667ef9" (UID: "f2d700c7-e0bc-4b3f-a562-4df1fb667ef9"). InnerVolumeSpecName "kube-api-access-b7npc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:28:14.200706 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:14.200625    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2d700c7-e0bc-4b3f-a562-4df1fb667ef9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f2d700c7-e0bc-4b3f-a562-4df1fb667ef9" (UID: "f2d700c7-e0bc-4b3f-a562-4df1fb667ef9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:28:14.200706 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:14.200673    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2d700c7-e0bc-4b3f-a562-4df1fb667ef9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f2d700c7-e0bc-4b3f-a562-4df1fb667ef9" (UID: "f2d700c7-e0bc-4b3f-a562-4df1fb667ef9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:28:14.243346 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:14.243320    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:28:14.299994 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:14.299966    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7npc\" (UniqueName: \"kubernetes.io/projected/f2d700c7-e0bc-4b3f-a562-4df1fb667ef9-kube-api-access-b7npc\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:28:14.299994 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:14.299992    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2d700c7-e0bc-4b3f-a562-4df1fb667ef9-maas-api-tls\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:28:14.300136 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:14.300007    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f2d700c7-e0bc-4b3f-a562-4df1fb667ef9-metrics-certs\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:28:14.300136 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:14.300017    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2d700c7-e0bc-4b3f-a562-4df1fb667ef9-openshift-service-ca\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:28:14.322848 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:14.322825    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:28:14.441393 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:14.441370    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp"]
Sep 07 13:28:14.444116 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:14.444097    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-219f63-68d44bd469-t5szp"]
Sep 07 13:28:14.598831 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:14.598808    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:28:15.366165 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:15.366134    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2d700c7-e0bc-4b3f-a562-4df1fb667ef9" path="/var/lib/kubelet/pods/f2d700c7-e0bc-4b3f-a562-4df1fb667ef9/volumes"
Sep 07 13:28:19.678839 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:19.678807    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:28:23.869224 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:23.869196    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:28:33.760590 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:33.760563    2576 scope.go:117] "RemoveContainer" containerID="6171b17936b11d4aa519b24a1cc219c2a70cc16bdf15cd8c626c5473b5198670"
Sep 07 13:28:33.768296 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:33.768278    2576 scope.go:117] "RemoveContainer" containerID="2ad87c6e382b21b51385d54b2588f7894f6ae542e5793972d35b8e50090329ca"
Sep 07 13:28:56.538042 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:56.538012    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:28:57.176341 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:28:57.176305    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:29:03.069253 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:03.069212    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:29:03.197551 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:03.197508    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:29:03.384369 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:03.384342    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"]
Sep 07 13:29:03.384555 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:03.384532    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9" podUID="d0372fe3-be1b-4769-bc17-9f41e2d1d630" containerName="istio-proxy" containerID="cri-o://08fb5eb09b65f71b7bc921e070afb7ebf5ad3f81d2d3600dc934659552ab9739" gracePeriod=30
Sep 07 13:29:03.408655 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:03.408633    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:29:03.908256 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:03.908222    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:29:08.633937 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:08.633908    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:29:08.710496 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:08.710443    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0372fe3-be1b-4769-bc17-9f41e2d1d630-credential-socket\") pod \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") "
Sep 07 13:29:08.710496 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:08.710479    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0372fe3-be1b-4769-bc17-9f41e2d1d630-istio-data\") pod \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") "
Sep 07 13:29:08.710496 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:08.710494    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0372fe3-be1b-4769-bc17-9f41e2d1d630-workload-socket\") pod \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") "
Sep 07 13:29:08.710682 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:08.710520    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0372fe3-be1b-4769-bc17-9f41e2d1d630-istiod-ca-cert\") pod \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") "
Sep 07 13:29:08.710682 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:08.710555    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0372fe3-be1b-4769-bc17-9f41e2d1d630-istio-envoy\") pod \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") "
Sep 07 13:29:08.710682 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:08.710572    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0372fe3-be1b-4769-bc17-9f41e2d1d630-istio-podinfo\") pod \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") "
Sep 07 13:29:08.710682 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:08.710635    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0372fe3-be1b-4769-bc17-9f41e2d1d630-workload-certs\") pod \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") "
Sep 07 13:29:08.710682 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:08.710670    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0372fe3-be1b-4769-bc17-9f41e2d1d630-istio-token\") pod \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") "
Sep 07 13:29:08.710959 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:08.710698    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nh827\" (UniqueName: \"kubernetes.io/projected/d0372fe3-be1b-4769-bc17-9f41e2d1d630-kube-api-access-nh827\") pod \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\" (UID: \"d0372fe3-be1b-4769-bc17-9f41e2d1d630\") "
Sep 07 13:29:08.710959 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:08.710728    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0372fe3-be1b-4769-bc17-9f41e2d1d630-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d0372fe3-be1b-4769-bc17-9f41e2d1d630" (UID: "d0372fe3-be1b-4769-bc17-9f41e2d1d630"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:29:08.710959 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:08.710715    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0372fe3-be1b-4769-bc17-9f41e2d1d630-istio-data" (OuterVolumeSpecName: "istio-data") pod "d0372fe3-be1b-4769-bc17-9f41e2d1d630" (UID: "d0372fe3-be1b-4769-bc17-9f41e2d1d630"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:29:08.710959 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:08.710748    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0372fe3-be1b-4769-bc17-9f41e2d1d630-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d0372fe3-be1b-4769-bc17-9f41e2d1d630" (UID: "d0372fe3-be1b-4769-bc17-9f41e2d1d630"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:29:08.710959 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:08.710906    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0372fe3-be1b-4769-bc17-9f41e2d1d630-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d0372fe3-be1b-4769-bc17-9f41e2d1d630" (UID: "d0372fe3-be1b-4769-bc17-9f41e2d1d630"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:29:08.711213 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:08.710973    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0372fe3-be1b-4769-bc17-9f41e2d1d630-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d0372fe3-be1b-4769-bc17-9f41e2d1d630" (UID: "d0372fe3-be1b-4769-bc17-9f41e2d1d630"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:29:08.711213 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:08.710984    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0372fe3-be1b-4769-bc17-9f41e2d1d630-credential-socket\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:29:08.711213 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:08.711017    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d0372fe3-be1b-4769-bc17-9f41e2d1d630-istio-data\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:29:08.711213 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:08.711034    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d0372fe3-be1b-4769-bc17-9f41e2d1d630-workload-socket\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:29:08.711213 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:08.711049    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d0372fe3-be1b-4769-bc17-9f41e2d1d630-workload-certs\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:29:08.712996 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:08.712954    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0372fe3-be1b-4769-bc17-9f41e2d1d630-istio-token" (OuterVolumeSpecName: "istio-token") pod "d0372fe3-be1b-4769-bc17-9f41e2d1d630" (UID: "d0372fe3-be1b-4769-bc17-9f41e2d1d630"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:29:08.713133 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:08.713075    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0372fe3-be1b-4769-bc17-9f41e2d1d630-kube-api-access-nh827" (OuterVolumeSpecName: "kube-api-access-nh827") pod "d0372fe3-be1b-4769-bc17-9f41e2d1d630" (UID: "d0372fe3-be1b-4769-bc17-9f41e2d1d630"). InnerVolumeSpecName "kube-api-access-nh827". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:29:08.713283 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:08.713262    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d0372fe3-be1b-4769-bc17-9f41e2d1d630-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d0372fe3-be1b-4769-bc17-9f41e2d1d630" (UID: "d0372fe3-be1b-4769-bc17-9f41e2d1d630"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 13:29:08.713406 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:08.713388    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0372fe3-be1b-4769-bc17-9f41e2d1d630-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d0372fe3-be1b-4769-bc17-9f41e2d1d630" (UID: "d0372fe3-be1b-4769-bc17-9f41e2d1d630"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:29:08.812238 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:08.812214    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d0372fe3-be1b-4769-bc17-9f41e2d1d630-istio-envoy\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:29:08.812238 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:08.812236    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d0372fe3-be1b-4769-bc17-9f41e2d1d630-istio-podinfo\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:29:08.812368 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:08.812246    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d0372fe3-be1b-4769-bc17-9f41e2d1d630-istio-token\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:29:08.812368 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:08.812253    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nh827\" (UniqueName: \"kubernetes.io/projected/d0372fe3-be1b-4769-bc17-9f41e2d1d630-kube-api-access-nh827\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:29:08.812368 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:08.812262    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d0372fe3-be1b-4769-bc17-9f41e2d1d630-istiod-ca-cert\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:29:09.369910 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:09.368937    2576 generic.go:356] "Generic (PLEG): container finished" podID="d0372fe3-be1b-4769-bc17-9f41e2d1d630" containerID="08fb5eb09b65f71b7bc921e070afb7ebf5ad3f81d2d3600dc934659552ab9739" exitCode=0
Sep 07 13:29:09.369910 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:09.369104    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9" event={"ID":"d0372fe3-be1b-4769-bc17-9f41e2d1d630","Type":"ContainerDied","Data":"08fb5eb09b65f71b7bc921e070afb7ebf5ad3f81d2d3600dc934659552ab9739"}
Sep 07 13:29:09.369910 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:09.369173    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9" event={"ID":"d0372fe3-be1b-4769-bc17-9f41e2d1d630","Type":"ContainerDied","Data":"8d0b1a2f29ebd26b268ca2a0a80026645ff147d0fc037f1aaad8a7d7fb290ac2"}
Sep 07 13:29:09.369910 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:09.369214    2576 scope.go:117] "RemoveContainer" containerID="08fb5eb09b65f71b7bc921e070afb7ebf5ad3f81d2d3600dc934659552ab9739"
Sep 07 13:29:09.369910 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:09.369412    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"
Sep 07 13:29:09.384885 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:09.384870    2576 scope.go:117] "RemoveContainer" containerID="dc7a64c86323da5c3733b09d1a0a277d12d08020b2773de5b32120d05ce88ac3"
Sep 07 13:29:09.392324 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:09.392306    2576 scope.go:117] "RemoveContainer" containerID="08fb5eb09b65f71b7bc921e070afb7ebf5ad3f81d2d3600dc934659552ab9739"
Sep 07 13:29:09.392566 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:29:09.392552    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08fb5eb09b65f71b7bc921e070afb7ebf5ad3f81d2d3600dc934659552ab9739\": container with ID starting with 08fb5eb09b65f71b7bc921e070afb7ebf5ad3f81d2d3600dc934659552ab9739 not found: ID does not exist" containerID="08fb5eb09b65f71b7bc921e070afb7ebf5ad3f81d2d3600dc934659552ab9739"
Sep 07 13:29:09.392609 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:09.392572    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08fb5eb09b65f71b7bc921e070afb7ebf5ad3f81d2d3600dc934659552ab9739"} err="failed to get container status \"08fb5eb09b65f71b7bc921e070afb7ebf5ad3f81d2d3600dc934659552ab9739\": rpc error: code = NotFound desc = could not find container \"08fb5eb09b65f71b7bc921e070afb7ebf5ad3f81d2d3600dc934659552ab9739\": container with ID starting with 08fb5eb09b65f71b7bc921e070afb7ebf5ad3f81d2d3600dc934659552ab9739 not found: ID does not exist"
Sep 07 13:29:09.392609 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:09.392587    2576 scope.go:117] "RemoveContainer" containerID="dc7a64c86323da5c3733b09d1a0a277d12d08020b2773de5b32120d05ce88ac3"
Sep 07 13:29:09.392842 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:29:09.392825    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc7a64c86323da5c3733b09d1a0a277d12d08020b2773de5b32120d05ce88ac3\": container with ID starting with dc7a64c86323da5c3733b09d1a0a277d12d08020b2773de5b32120d05ce88ac3 not found: ID does not exist" containerID="dc7a64c86323da5c3733b09d1a0a277d12d08020b2773de5b32120d05ce88ac3"
Sep 07 13:29:09.392887 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:09.392847    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc7a64c86323da5c3733b09d1a0a277d12d08020b2773de5b32120d05ce88ac3"} err="failed to get container status \"dc7a64c86323da5c3733b09d1a0a277d12d08020b2773de5b32120d05ce88ac3\": rpc error: code = NotFound desc = could not find container \"dc7a64c86323da5c3733b09d1a0a277d12d08020b2773de5b32120d05ce88ac3\": container with ID starting with dc7a64c86323da5c3733b09d1a0a277d12d08020b2773de5b32120d05ce88ac3 not found: ID does not exist"
Sep 07 13:29:09.401914 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:09.401892    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"]
Sep 07 13:29:09.406578 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:09.406558    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-219f63-openshift-default-58b9cc4cb4-pnsf9"]
Sep 07 13:29:11.366644 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:11.366610    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0372fe3-be1b-4769-bc17-9f41e2d1d630" path="/var/lib/kubelet/pods/d0372fe3-be1b-4769-bc17-9f41e2d1d630/volumes"
Sep 07 13:29:14.529606 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:14.529574    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22"]
Sep 07 13:29:14.530061 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:14.529762    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22" podUID="ed7c9509-464c-4e3b-83d6-b8db392ffdc2" containerName="maas-api" containerID="cri-o://b0fde163de0bbfa283399767759fc25c6a98978d23bd292de74d9df06a3dac8f" gracePeriod=30
Sep 07 13:29:14.627641 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:14.627597    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:29:14.722306 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:14.722271    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:29:14.766043 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:14.766020    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22"
Sep 07 13:29:14.828164 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:14.828091    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:29:14.859196 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:14.859172    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed7c9509-464c-4e3b-83d6-b8db392ffdc2-openshift-service-ca\") pod \"ed7c9509-464c-4e3b-83d6-b8db392ffdc2\" (UID: \"ed7c9509-464c-4e3b-83d6-b8db392ffdc2\") "
Sep 07 13:29:14.859316 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:14.859232    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4kk55\" (UniqueName: \"kubernetes.io/projected/ed7c9509-464c-4e3b-83d6-b8db392ffdc2-kube-api-access-4kk55\") pod \"ed7c9509-464c-4e3b-83d6-b8db392ffdc2\" (UID: \"ed7c9509-464c-4e3b-83d6-b8db392ffdc2\") "
Sep 07 13:29:14.859316 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:14.859263    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed7c9509-464c-4e3b-83d6-b8db392ffdc2-maas-api-tls\") pod \"ed7c9509-464c-4e3b-83d6-b8db392ffdc2\" (UID: \"ed7c9509-464c-4e3b-83d6-b8db392ffdc2\") "
Sep 07 13:29:14.859474 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:14.859454    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7c9509-464c-4e3b-83d6-b8db392ffdc2-metrics-certs\") pod \"ed7c9509-464c-4e3b-83d6-b8db392ffdc2\" (UID: \"ed7c9509-464c-4e3b-83d6-b8db392ffdc2\") "
Sep 07 13:29:14.859543 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:14.859478    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed7c9509-464c-4e3b-83d6-b8db392ffdc2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ed7c9509-464c-4e3b-83d6-b8db392ffdc2" (UID: "ed7c9509-464c-4e3b-83d6-b8db392ffdc2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:29:14.859793 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:14.859749    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed7c9509-464c-4e3b-83d6-b8db392ffdc2-openshift-service-ca\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:29:14.861393 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:14.861369    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed7c9509-464c-4e3b-83d6-b8db392ffdc2-kube-api-access-4kk55" (OuterVolumeSpecName: "kube-api-access-4kk55") pod "ed7c9509-464c-4e3b-83d6-b8db392ffdc2" (UID: "ed7c9509-464c-4e3b-83d6-b8db392ffdc2"). InnerVolumeSpecName "kube-api-access-4kk55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:29:14.861480 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:14.861397    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed7c9509-464c-4e3b-83d6-b8db392ffdc2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ed7c9509-464c-4e3b-83d6-b8db392ffdc2" (UID: "ed7c9509-464c-4e3b-83d6-b8db392ffdc2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:29:14.861480 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:14.861423    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed7c9509-464c-4e3b-83d6-b8db392ffdc2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ed7c9509-464c-4e3b-83d6-b8db392ffdc2" (UID: "ed7c9509-464c-4e3b-83d6-b8db392ffdc2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:29:14.924827 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:14.924798    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:29:14.960896 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:14.960878    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4kk55\" (UniqueName: \"kubernetes.io/projected/ed7c9509-464c-4e3b-83d6-b8db392ffdc2-kube-api-access-4kk55\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:29:14.960896 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:14.960897    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed7c9509-464c-4e3b-83d6-b8db392ffdc2-maas-api-tls\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:29:14.961027 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:14.960906    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed7c9509-464c-4e3b-83d6-b8db392ffdc2-metrics-certs\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:29:15.267165 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:15.267139    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:29:15.397655 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:15.397628    2576 generic.go:356] "Generic (PLEG): container finished" podID="ed7c9509-464c-4e3b-83d6-b8db392ffdc2" containerID="b0fde163de0bbfa283399767759fc25c6a98978d23bd292de74d9df06a3dac8f" exitCode=0
Sep 07 13:29:15.397757 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:15.397676    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22"
Sep 07 13:29:15.397757 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:15.397710    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22" event={"ID":"ed7c9509-464c-4e3b-83d6-b8db392ffdc2","Type":"ContainerDied","Data":"b0fde163de0bbfa283399767759fc25c6a98978d23bd292de74d9df06a3dac8f"}
Sep 07 13:29:15.397863 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:15.397756    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22" event={"ID":"ed7c9509-464c-4e3b-83d6-b8db392ffdc2","Type":"ContainerDied","Data":"ac90363e48b1e6c5a140d1363e4f6c5bf8912d6c6da31bfeda1365dd6d67484d"}
Sep 07 13:29:15.397863 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:15.397796    2576 scope.go:117] "RemoveContainer" containerID="b0fde163de0bbfa283399767759fc25c6a98978d23bd292de74d9df06a3dac8f"
Sep 07 13:29:15.406321 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:15.406303    2576 scope.go:117] "RemoveContainer" containerID="b0fde163de0bbfa283399767759fc25c6a98978d23bd292de74d9df06a3dac8f"
Sep 07 13:29:15.406565 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:29:15.406548    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0fde163de0bbfa283399767759fc25c6a98978d23bd292de74d9df06a3dac8f\": container with ID starting with b0fde163de0bbfa283399767759fc25c6a98978d23bd292de74d9df06a3dac8f not found: ID does not exist" containerID="b0fde163de0bbfa283399767759fc25c6a98978d23bd292de74d9df06a3dac8f"
Sep 07 13:29:15.406621 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:15.406572    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0fde163de0bbfa283399767759fc25c6a98978d23bd292de74d9df06a3dac8f"} err="failed to get container status \"b0fde163de0bbfa283399767759fc25c6a98978d23bd292de74d9df06a3dac8f\": rpc error: code = NotFound desc = could not find container \"b0fde163de0bbfa283399767759fc25c6a98978d23bd292de74d9df06a3dac8f\": container with ID starting with b0fde163de0bbfa283399767759fc25c6a98978d23bd292de74d9df06a3dac8f not found: ID does not exist"
Sep 07 13:29:15.420252 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:15.420233    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22"]
Sep 07 13:29:15.428069 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:15.428052    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-8dc72a-f6d597446-9gj22"]
Sep 07 13:29:16.872874 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:16.872837    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:29:17.366126 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:17.366091    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed7c9509-464c-4e3b-83d6-b8db392ffdc2" path="/var/lib/kubelet/pods/ed7c9509-464c-4e3b-83d6-b8db392ffdc2/volumes"
Sep 07 13:29:17.756659 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:17.756637    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:29:21.476154 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:21.476125    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:29:21.552365 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:21.552328    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:29:21.781996 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:21.781876    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:29:22.132036 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:22.132010    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-5910bb-w62vp"]
Sep 07 13:29:22.132348 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:22.132336    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0372fe3-be1b-4769-bc17-9f41e2d1d630" containerName="istio-proxy"
Sep 07 13:29:22.132390 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:22.132349    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0372fe3-be1b-4769-bc17-9f41e2d1d630" containerName="istio-proxy"
Sep 07 13:29:22.132390 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:22.132363    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3ac8100-8321-490f-a8b1-60a9aacbce5c" containerName="istio-proxy"
Sep 07 13:29:22.132390 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:22.132368    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3ac8100-8321-490f-a8b1-60a9aacbce5c" containerName="istio-proxy"
Sep 07 13:29:22.132390 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:22.132373    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6b009ea-e64b-46a6-9278-390b938f0f33" containerName="maas-api"
Sep 07 13:29:22.132390 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:22.132379    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6b009ea-e64b-46a6-9278-390b938f0f33" containerName="maas-api"
Sep 07 13:29:22.132390 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:22.132386    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed7c9509-464c-4e3b-83d6-b8db392ffdc2" containerName="maas-api"
Sep 07 13:29:22.132390 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:22.132391    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed7c9509-464c-4e3b-83d6-b8db392ffdc2" containerName="maas-api"
Sep 07 13:29:22.132592 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:22.132404    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2d700c7-e0bc-4b3f-a562-4df1fb667ef9" containerName="maas-api"
Sep 07 13:29:22.132592 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:22.132409    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2d700c7-e0bc-4b3f-a562-4df1fb667ef9" containerName="maas-api"
Sep 07 13:29:22.132592 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:22.132467    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3ac8100-8321-490f-a8b1-60a9aacbce5c" containerName="istio-proxy"
Sep 07 13:29:22.132592 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:22.132473    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed7c9509-464c-4e3b-83d6-b8db392ffdc2" containerName="maas-api"
Sep 07 13:29:22.132592 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:22.132479    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2d700c7-e0bc-4b3f-a562-4df1fb667ef9" containerName="maas-api"
Sep 07 13:29:22.132592 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:22.132487    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0372fe3-be1b-4769-bc17-9f41e2d1d630" containerName="istio-proxy"
Sep 07 13:29:22.132592 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:22.132492    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0372fe3-be1b-4769-bc17-9f41e2d1d630" containerName="istio-proxy"
Sep 07 13:29:22.132592 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:22.132502    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6b009ea-e64b-46a6-9278-390b938f0f33" containerName="maas-api"
Sep 07 13:29:22.136900 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:22.136884    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-5910bb-w62vp"
Sep 07 13:29:22.139077 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:22.139057    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 13:29:22.139154 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:22.139131    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jlvcf\""
Sep 07 13:29:22.145076 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:22.145054    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-5910bb-w62vp"]
Sep 07 13:29:22.209624 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:22.209601    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bd04ce8-07e8-4919-9d17-73801a924dee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-5910bb-w62vp\" (UID: \"5bd04ce8-07e8-4919-9d17-73801a924dee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-5910bb-w62vp"
Sep 07 13:29:22.310263 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:22.310237    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bd04ce8-07e8-4919-9d17-73801a924dee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-5910bb-w62vp\" (UID: \"5bd04ce8-07e8-4919-9d17-73801a924dee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-5910bb-w62vp"
Sep 07 13:29:22.310907 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:22.310886    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bd04ce8-07e8-4919-9d17-73801a924dee-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-5910bb-w62vp\" (UID: \"5bd04ce8-07e8-4919-9d17-73801a924dee\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-5910bb-w62vp"
Sep 07 13:29:22.447977 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:22.447916    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-5910bb-w62vp"
Sep 07 13:29:22.718001 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:22.717903    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-5910bb-w62vp"]
Sep 07 13:29:22.720706 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:29:22.720680    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bd04ce8_07e8_4919_9d17_73801a924dee.slice/crio-fd891c47c5711d033fffdfc15a49546f9c66f003f4d2201084906ecbebcd5976 WatchSource:0}: Error finding container fd891c47c5711d033fffdfc15a49546f9c66f003f4d2201084906ecbebcd5976: Status 404 returned error can't find the container with id fd891c47c5711d033fffdfc15a49546f9c66f003f4d2201084906ecbebcd5976
Sep 07 13:29:23.435944 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:23.435918    2576 generic.go:356] "Generic (PLEG): container finished" podID="5bd04ce8-07e8-4919-9d17-73801a924dee" containerID="eac2378cb938a0baea79f4058e622997319f11cd5082b74827433cf12cb60a32" exitCode=0
Sep 07 13:29:23.436040 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:23.435998    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-5910bb-w62vp" event={"ID":"5bd04ce8-07e8-4919-9d17-73801a924dee","Type":"ContainerDied","Data":"eac2378cb938a0baea79f4058e622997319f11cd5082b74827433cf12cb60a32"}
Sep 07 13:29:23.436081 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:23.436044    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-5910bb-w62vp" event={"ID":"5bd04ce8-07e8-4919-9d17-73801a924dee","Type":"ContainerStarted","Data":"fd891c47c5711d033fffdfc15a49546f9c66f003f4d2201084906ecbebcd5976"}
Sep 07 13:29:23.448334 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:23.448312    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:29:24.568946 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:24.568928    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-5910bb-w62vp"
Sep 07 13:29:24.626043 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:24.625988    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bd04ce8-07e8-4919-9d17-73801a924dee-maas-api-service-ca\") pod \"5bd04ce8-07e8-4919-9d17-73801a924dee\" (UID: \"5bd04ce8-07e8-4919-9d17-73801a924dee\") "
Sep 07 13:29:24.626280 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:24.626259    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bd04ce8-07e8-4919-9d17-73801a924dee-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5bd04ce8-07e8-4919-9d17-73801a924dee" (UID: "5bd04ce8-07e8-4919-9d17-73801a924dee"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:29:24.726618 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:24.726570    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5bd04ce8-07e8-4919-9d17-73801a924dee-maas-api-service-ca\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:29:25.447537 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:25.447516    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-5910bb-w62vp"
Sep 07 13:29:25.447633 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:25.447548    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-5910bb-w62vp" event={"ID":"5bd04ce8-07e8-4919-9d17-73801a924dee","Type":"ContainerDied","Data":"fd891c47c5711d033fffdfc15a49546f9c66f003f4d2201084906ecbebcd5976"}
Sep 07 13:29:25.447633 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:25.447585    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fd891c47c5711d033fffdfc15a49546f9c66f003f4d2201084906ecbebcd5976"
Sep 07 13:29:32.983002 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:32.982974    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:29:33.108458 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:33.108418    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:29:33.228405 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:33.228371    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:29:33.319100 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:33.319040    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-5910bb-w62vp"]
Sep 07 13:29:33.321645 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:33.321621    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-5910bb-w62vp"]
Sep 07 13:29:33.328564 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:33.328534    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:29:33.371572 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:33.371537    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bd04ce8-07e8-4919-9d17-73801a924dee" path="/var/lib/kubelet/pods/5bd04ce8-07e8-4919-9d17-73801a924dee/volumes"
Sep 07 13:29:33.431816 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:33.431784    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:29:33.483887 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:33.483863    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-v9pd8_d2bb2527-1a29-4b7e-b6fb-9be32693a5cd/console-operator/1.log"
Sep 07 13:29:33.486478 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:33.486456    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-v9pd8_d2bb2527-1a29-4b7e-b6fb-9be32693a5cd/console-operator/1.log"
Sep 07 13:29:33.752426 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:33.752401    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:29:35.944784 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:35.944740    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:29:40.576430 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:40.576400    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:29:40.699359 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:40.699326    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:29:40.916581 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:40.916545    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:29:41.456325 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:41.456288    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:29:51.994011 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:51.993977    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:29:52.092816 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:52.092787    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:29:52.197245 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:52.197212    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:29:52.279337 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:52.279264    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:29:52.664350 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:52.664319    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:29:54.659831 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:54.659799    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:29:59.403659 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:59.403623    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:29:59.503468 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:59.503431    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:29:59.665049 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:59.664967    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"]
Sep 07 13:29:59.665221 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:59.665197    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4" podUID="27a9b368-f0fb-44b5-ab0c-cb72509654c3" containerName="istio-proxy" containerID="cri-o://451686c558026f3ae7a195bb3858ee3518c69ec81326afaa55e24c6657fe54f8" gracePeriod=30
Sep 07 13:29:59.692674 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:29:59.692642    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:30:01.263099 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:01.263068    2576 patch_prober.go:28] interesting pod/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 07 13:30:01.263427 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:01.263132    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4" podUID="27a9b368-f0fb-44b5-ab0c-cb72509654c3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 07 13:30:04.908330 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:04.908308    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:30:05.034616 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.034565    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27a9b368-f0fb-44b5-ab0c-cb72509654c3-istio-podinfo\") pod \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") "
Sep 07 13:30:05.034616 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.034602    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27a9b368-f0fb-44b5-ab0c-cb72509654c3-istiod-ca-cert\") pod \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") "
Sep 07 13:30:05.034756 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.034641    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27a9b368-f0fb-44b5-ab0c-cb72509654c3-workload-certs\") pod \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") "
Sep 07 13:30:05.034756 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.034743    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27a9b368-f0fb-44b5-ab0c-cb72509654c3-workload-socket\") pod \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") "
Sep 07 13:30:05.034883 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.034794    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27a9b368-f0fb-44b5-ab0c-cb72509654c3-istio-data\") pod \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") "
Sep 07 13:30:05.034883 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.034834    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lmhn7\" (UniqueName: \"kubernetes.io/projected/27a9b368-f0fb-44b5-ab0c-cb72509654c3-kube-api-access-lmhn7\") pod \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") "
Sep 07 13:30:05.034883 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.034876    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27a9b368-f0fb-44b5-ab0c-cb72509654c3-istio-token\") pod \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") "
Sep 07 13:30:05.035028 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.034899    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27a9b368-f0fb-44b5-ab0c-cb72509654c3-istio-envoy\") pod \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") "
Sep 07 13:30:05.035028 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.034899    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27a9b368-f0fb-44b5-ab0c-cb72509654c3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "27a9b368-f0fb-44b5-ab0c-cb72509654c3" (UID: "27a9b368-f0fb-44b5-ab0c-cb72509654c3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:30:05.035028 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.034952    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27a9b368-f0fb-44b5-ab0c-cb72509654c3-credential-socket\") pod \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\" (UID: \"27a9b368-f0fb-44b5-ab0c-cb72509654c3\") "
Sep 07 13:30:05.035200 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.035015    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27a9b368-f0fb-44b5-ab0c-cb72509654c3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "27a9b368-f0fb-44b5-ab0c-cb72509654c3" (UID: "27a9b368-f0fb-44b5-ab0c-cb72509654c3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:30:05.035200 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.035108    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27a9b368-f0fb-44b5-ab0c-cb72509654c3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "27a9b368-f0fb-44b5-ab0c-cb72509654c3" (UID: "27a9b368-f0fb-44b5-ab0c-cb72509654c3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:30:05.035309 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.035247    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27a9b368-f0fb-44b5-ab0c-cb72509654c3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "27a9b368-f0fb-44b5-ab0c-cb72509654c3" (UID: "27a9b368-f0fb-44b5-ab0c-cb72509654c3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:30:05.035361 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.035331    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27a9b368-f0fb-44b5-ab0c-cb72509654c3-istio-data" (OuterVolumeSpecName: "istio-data") pod "27a9b368-f0fb-44b5-ab0c-cb72509654c3" (UID: "27a9b368-f0fb-44b5-ab0c-cb72509654c3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:30:05.035417 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.035371    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27a9b368-f0fb-44b5-ab0c-cb72509654c3-credential-socket\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:30:05.035417 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.035388    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27a9b368-f0fb-44b5-ab0c-cb72509654c3-istiod-ca-cert\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:30:05.035417 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.035403    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27a9b368-f0fb-44b5-ab0c-cb72509654c3-workload-certs\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:30:05.035417 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.035415    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27a9b368-f0fb-44b5-ab0c-cb72509654c3-workload-socket\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:30:05.036850 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.036822    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/27a9b368-f0fb-44b5-ab0c-cb72509654c3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "27a9b368-f0fb-44b5-ab0c-cb72509654c3" (UID: "27a9b368-f0fb-44b5-ab0c-cb72509654c3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 07 13:30:05.037036 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.037010    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27a9b368-f0fb-44b5-ab0c-cb72509654c3-istio-token" (OuterVolumeSpecName: "istio-token") pod "27a9b368-f0fb-44b5-ab0c-cb72509654c3" (UID: "27a9b368-f0fb-44b5-ab0c-cb72509654c3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:30:05.037114 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.037046    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27a9b368-f0fb-44b5-ab0c-cb72509654c3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "27a9b368-f0fb-44b5-ab0c-cb72509654c3" (UID: "27a9b368-f0fb-44b5-ab0c-cb72509654c3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 07 13:30:05.037152 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.037104    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27a9b368-f0fb-44b5-ab0c-cb72509654c3-kube-api-access-lmhn7" (OuterVolumeSpecName: "kube-api-access-lmhn7") pod "27a9b368-f0fb-44b5-ab0c-cb72509654c3" (UID: "27a9b368-f0fb-44b5-ab0c-cb72509654c3"). InnerVolumeSpecName "kube-api-access-lmhn7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:30:05.135894 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.135864    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27a9b368-f0fb-44b5-ab0c-cb72509654c3-istio-token\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:30:05.135894 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.135892    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27a9b368-f0fb-44b5-ab0c-cb72509654c3-istio-envoy\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:30:05.135894 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.135900    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27a9b368-f0fb-44b5-ab0c-cb72509654c3-istio-podinfo\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:30:05.136040 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.135908    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27a9b368-f0fb-44b5-ab0c-cb72509654c3-istio-data\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:30:05.136040 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.135915    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmhn7\" (UniqueName: \"kubernetes.io/projected/27a9b368-f0fb-44b5-ab0c-cb72509654c3-kube-api-access-lmhn7\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:30:05.627480 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.627455    2576 generic.go:356] "Generic (PLEG): container finished" podID="27a9b368-f0fb-44b5-ab0c-cb72509654c3" containerID="451686c558026f3ae7a195bb3858ee3518c69ec81326afaa55e24c6657fe54f8" exitCode=0
Sep 07 13:30:05.627580 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.627493    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"
Sep 07 13:30:05.627580 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.627545    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4" event={"ID":"27a9b368-f0fb-44b5-ab0c-cb72509654c3","Type":"ContainerDied","Data":"451686c558026f3ae7a195bb3858ee3518c69ec81326afaa55e24c6657fe54f8"}
Sep 07 13:30:05.627691 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.627597    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4" event={"ID":"27a9b368-f0fb-44b5-ab0c-cb72509654c3","Type":"ContainerDied","Data":"69b990820049b5aae6c53aff98df6125033c4d07786f30aabd3913e866a45b19"}
Sep 07 13:30:05.627691 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.627628    2576 scope.go:117] "RemoveContainer" containerID="451686c558026f3ae7a195bb3858ee3518c69ec81326afaa55e24c6657fe54f8"
Sep 07 13:30:05.635780 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.635753    2576 scope.go:117] "RemoveContainer" containerID="c526d140e2d11faed0813495033495105a5a96a146e5e75d376918419b7bd7cf"
Sep 07 13:30:05.642965 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.642950    2576 scope.go:117] "RemoveContainer" containerID="451686c558026f3ae7a195bb3858ee3518c69ec81326afaa55e24c6657fe54f8"
Sep 07 13:30:05.643246 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:30:05.643230    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"451686c558026f3ae7a195bb3858ee3518c69ec81326afaa55e24c6657fe54f8\": container with ID starting with 451686c558026f3ae7a195bb3858ee3518c69ec81326afaa55e24c6657fe54f8 not found: ID does not exist" containerID="451686c558026f3ae7a195bb3858ee3518c69ec81326afaa55e24c6657fe54f8"
Sep 07 13:30:05.643295 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.643254    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"451686c558026f3ae7a195bb3858ee3518c69ec81326afaa55e24c6657fe54f8"} err="failed to get container status \"451686c558026f3ae7a195bb3858ee3518c69ec81326afaa55e24c6657fe54f8\": rpc error: code = NotFound desc = could not find container \"451686c558026f3ae7a195bb3858ee3518c69ec81326afaa55e24c6657fe54f8\": container with ID starting with 451686c558026f3ae7a195bb3858ee3518c69ec81326afaa55e24c6657fe54f8 not found: ID does not exist"
Sep 07 13:30:05.643295 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.643269    2576 scope.go:117] "RemoveContainer" containerID="c526d140e2d11faed0813495033495105a5a96a146e5e75d376918419b7bd7cf"
Sep 07 13:30:05.643528 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:30:05.643512    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c526d140e2d11faed0813495033495105a5a96a146e5e75d376918419b7bd7cf\": container with ID starting with c526d140e2d11faed0813495033495105a5a96a146e5e75d376918419b7bd7cf not found: ID does not exist" containerID="c526d140e2d11faed0813495033495105a5a96a146e5e75d376918419b7bd7cf"
Sep 07 13:30:05.643581 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.643531    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c526d140e2d11faed0813495033495105a5a96a146e5e75d376918419b7bd7cf"} err="failed to get container status \"c526d140e2d11faed0813495033495105a5a96a146e5e75d376918419b7bd7cf\": rpc error: code = NotFound desc = could not find container \"c526d140e2d11faed0813495033495105a5a96a146e5e75d376918419b7bd7cf\": container with ID starting with c526d140e2d11faed0813495033495105a5a96a146e5e75d376918419b7bd7cf not found: ID does not exist"
Sep 07 13:30:05.647606 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.647585    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"]
Sep 07 13:30:05.649825 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.649806    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-c7c371-openshift-default-5d86b6b8fd-m2rt4"]
Sep 07 13:30:05.843882 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:05.843863    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:30:07.365185 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:07.365156    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27a9b368-f0fb-44b5-ab0c-cb72509654c3" path="/var/lib/kubelet/pods/27a9b368-f0fb-44b5-ab0c-cb72509654c3/volumes"
Sep 07 13:30:27.666554 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:27.666522    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:30:33.821641 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:33.816921    2576 scope.go:117] "RemoveContainer" containerID="e75af9491bda8c0e990a3c23db3fecea270ee16fad9560cabb8ede1ff21b1716"
Sep 07 13:30:35.407035 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:30:35.407011    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:31:24.499022 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:31:24.498979    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:31:25.854640 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:31:25.854605    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:31:26.314975 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:31:26.314943    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:31:27.384830 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:31:27.384795    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:31:52.766600 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:31:52.766560    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:32:02.484292 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:32:02.484261    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:32:10.683029 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:32:10.682996    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:32:26.454150 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:32:26.454074    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:32:34.655494 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:32:34.655462    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:32:42.091249 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:32:42.091214    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:32:42.254319 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:32:42.254289    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:32:58.419058 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:32:58.419021    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:33:57.717037 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:33:57.716960    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:33:58.539870 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:33:58.539836    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:34:33.515057 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:34:33.515031    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-v9pd8_d2bb2527-1a29-4b7e-b6fb-9be32693a5cd/console-operator/1.log"
Sep 07 13:34:33.518001 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:34:33.517978    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-v9pd8_d2bb2527-1a29-4b7e-b6fb-9be32693a5cd/console-operator/1.log"
Sep 07 13:34:35.456365 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:34:35.456335    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:34:43.396502 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:34:43.396468    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:34:52.463880 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:34:52.463850    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:34:56.061141 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:34:56.061102    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:34:57.668259 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:34:57.668227    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:35:03.071084 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:03.071056    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:35:06.327536 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:06.327503    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:35:31.544426 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:31.544350    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:35:33.289911 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:33.289876    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:35:33.682962 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:33.682933    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:35:33.870009 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:33.869985    2576 scope.go:117] "RemoveContainer" containerID="eac2378cb938a0baea79f4058e622997319f11cd5082b74827433cf12cb60a32"
Sep 07 13:35:42.304381 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:42.304351    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:35:49.449640 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:49.449600    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:35:49.769004 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:49.768930    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-849b74d9cb-xz4w2"]
Sep 07 13:35:49.769348 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:49.769331    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bd04ce8-07e8-4919-9d17-73801a924dee" containerName="revoke-keys"
Sep 07 13:35:49.769439 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:49.769350    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bd04ce8-07e8-4919-9d17-73801a924dee" containerName="revoke-keys"
Sep 07 13:35:49.769439 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:49.769362    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27a9b368-f0fb-44b5-ab0c-cb72509654c3" containerName="istio-proxy"
Sep 07 13:35:49.769439 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:49.769369    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="27a9b368-f0fb-44b5-ab0c-cb72509654c3" containerName="istio-proxy"
Sep 07 13:35:49.769439 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:49.769378    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0372fe3-be1b-4769-bc17-9f41e2d1d630" containerName="istio-proxy"
Sep 07 13:35:49.769439 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:49.769385    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0372fe3-be1b-4769-bc17-9f41e2d1d630" containerName="istio-proxy"
Sep 07 13:35:49.769439 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:49.769403    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3ac8100-8321-490f-a8b1-60a9aacbce5c" containerName="istio-proxy"
Sep 07 13:35:49.769439 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:49.769411    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3ac8100-8321-490f-a8b1-60a9aacbce5c" containerName="istio-proxy"
Sep 07 13:35:49.769762 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:49.769510    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bd04ce8-07e8-4919-9d17-73801a924dee" containerName="revoke-keys"
Sep 07 13:35:49.769762 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:49.769520    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="27a9b368-f0fb-44b5-ab0c-cb72509654c3" containerName="istio-proxy"
Sep 07 13:35:49.769762 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:49.769530    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="27a9b368-f0fb-44b5-ab0c-cb72509654c3" containerName="istio-proxy"
Sep 07 13:35:49.769762 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:49.769540    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3ac8100-8321-490f-a8b1-60a9aacbce5c" containerName="istio-proxy"
Sep 07 13:35:49.772807 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:49.772789    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-849b74d9cb-xz4w2"
Sep 07 13:35:49.775179 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:49.775162    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 07 13:35:49.775907 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:49.775890    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 07 13:35:49.776072 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:49.776054    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-fswx9\""
Sep 07 13:35:49.777470 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:49.777453    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 07 13:35:49.781605 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:49.781589    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 07 13:35:49.787592 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:49.787570    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-849b74d9cb-xz4w2"]
Sep 07 13:35:49.832167 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:49.832141    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93beb891-f8cf-4d0a-83e2-0f5566fbac27-maas-api-tls\") pod \"maas-api-849b74d9cb-xz4w2\" (UID: \"93beb891-f8cf-4d0a-83e2-0f5566fbac27\") " pod="odh-ai-gateway-infra/maas-api-849b74d9cb-xz4w2"
Sep 07 13:35:49.832264 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:49.832223    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93beb891-f8cf-4d0a-83e2-0f5566fbac27-openshift-service-ca\") pod \"maas-api-849b74d9cb-xz4w2\" (UID: \"93beb891-f8cf-4d0a-83e2-0f5566fbac27\") " pod="odh-ai-gateway-infra/maas-api-849b74d9cb-xz4w2"
Sep 07 13:35:49.832309 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:49.832297    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxhmr\" (UniqueName: \"kubernetes.io/projected/93beb891-f8cf-4d0a-83e2-0f5566fbac27-kube-api-access-wxhmr\") pod \"maas-api-849b74d9cb-xz4w2\" (UID: \"93beb891-f8cf-4d0a-83e2-0f5566fbac27\") " pod="odh-ai-gateway-infra/maas-api-849b74d9cb-xz4w2"
Sep 07 13:35:49.832382 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:49.832366    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93beb891-f8cf-4d0a-83e2-0f5566fbac27-metrics-certs\") pod \"maas-api-849b74d9cb-xz4w2\" (UID: \"93beb891-f8cf-4d0a-83e2-0f5566fbac27\") " pod="odh-ai-gateway-infra/maas-api-849b74d9cb-xz4w2"
Sep 07 13:35:49.932847 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:49.932825    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93beb891-f8cf-4d0a-83e2-0f5566fbac27-metrics-certs\") pod \"maas-api-849b74d9cb-xz4w2\" (UID: \"93beb891-f8cf-4d0a-83e2-0f5566fbac27\") " pod="odh-ai-gateway-infra/maas-api-849b74d9cb-xz4w2"
Sep 07 13:35:49.932935 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:49.932861    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93beb891-f8cf-4d0a-83e2-0f5566fbac27-maas-api-tls\") pod \"maas-api-849b74d9cb-xz4w2\" (UID: \"93beb891-f8cf-4d0a-83e2-0f5566fbac27\") " pod="odh-ai-gateway-infra/maas-api-849b74d9cb-xz4w2"
Sep 07 13:35:49.932935 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:49.932895    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93beb891-f8cf-4d0a-83e2-0f5566fbac27-openshift-service-ca\") pod \"maas-api-849b74d9cb-xz4w2\" (UID: \"93beb891-f8cf-4d0a-83e2-0f5566fbac27\") " pod="odh-ai-gateway-infra/maas-api-849b74d9cb-xz4w2"
Sep 07 13:35:49.933017 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:49.932935    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxhmr\" (UniqueName: \"kubernetes.io/projected/93beb891-f8cf-4d0a-83e2-0f5566fbac27-kube-api-access-wxhmr\") pod \"maas-api-849b74d9cb-xz4w2\" (UID: \"93beb891-f8cf-4d0a-83e2-0f5566fbac27\") " pod="odh-ai-gateway-infra/maas-api-849b74d9cb-xz4w2"
Sep 07 13:35:49.933500 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:49.933478    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93beb891-f8cf-4d0a-83e2-0f5566fbac27-openshift-service-ca\") pod \"maas-api-849b74d9cb-xz4w2\" (UID: \"93beb891-f8cf-4d0a-83e2-0f5566fbac27\") " pod="odh-ai-gateway-infra/maas-api-849b74d9cb-xz4w2"
Sep 07 13:35:49.935241 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:49.935223    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93beb891-f8cf-4d0a-83e2-0f5566fbac27-maas-api-tls\") pod \"maas-api-849b74d9cb-xz4w2\" (UID: \"93beb891-f8cf-4d0a-83e2-0f5566fbac27\") " pod="odh-ai-gateway-infra/maas-api-849b74d9cb-xz4w2"
Sep 07 13:35:49.935368 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:49.935352    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93beb891-f8cf-4d0a-83e2-0f5566fbac27-metrics-certs\") pod \"maas-api-849b74d9cb-xz4w2\" (UID: \"93beb891-f8cf-4d0a-83e2-0f5566fbac27\") " pod="odh-ai-gateway-infra/maas-api-849b74d9cb-xz4w2"
Sep 07 13:35:49.942628 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:49.942609    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxhmr\" (UniqueName: \"kubernetes.io/projected/93beb891-f8cf-4d0a-83e2-0f5566fbac27-kube-api-access-wxhmr\") pod \"maas-api-849b74d9cb-xz4w2\" (UID: \"93beb891-f8cf-4d0a-83e2-0f5566fbac27\") " pod="odh-ai-gateway-infra/maas-api-849b74d9cb-xz4w2"
Sep 07 13:35:50.082429 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:50.082380    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-849b74d9cb-xz4w2"
Sep 07 13:35:50.358312 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:50.358291    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-849b74d9cb-xz4w2"]
Sep 07 13:35:50.360353 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:35:50.360324    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93beb891_f8cf_4d0a_83e2_0f5566fbac27.slice/crio-e0eee229651b673b28704475960fc65e2aedc0dcd3e3999be905f587756d9523 WatchSource:0}: Error finding container e0eee229651b673b28704475960fc65e2aedc0dcd3e3999be905f587756d9523: Status 404 returned error can't find the container with id e0eee229651b673b28704475960fc65e2aedc0dcd3e3999be905f587756d9523
Sep 07 13:35:50.361580 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:50.361558    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 07 13:35:51.127812 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:51.127761    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-849b74d9cb-xz4w2" event={"ID":"93beb891-f8cf-4d0a-83e2-0f5566fbac27","Type":"ContainerStarted","Data":"123ab0e7a0e4f5822bb7042c14739243fe046be461a97adc195f3a6a7f3073d7"}
Sep 07 13:35:51.128194 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:51.127840    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-849b74d9cb-xz4w2" event={"ID":"93beb891-f8cf-4d0a-83e2-0f5566fbac27","Type":"ContainerStarted","Data":"e0eee229651b673b28704475960fc65e2aedc0dcd3e3999be905f587756d9523"}
Sep 07 13:35:51.128194 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:51.127887    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-849b74d9cb-xz4w2"
Sep 07 13:35:51.148308 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:51.148267    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-849b74d9cb-xz4w2" podStartSLOduration=1.555674195 podStartE2EDuration="2.148254692s" totalImagesPullingTime="592.580497ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:35:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:35:51.146369509 +0000 UTC m=+2178.203251165" watchObservedRunningTime="2026-09-07 13:35:51.148254692 +0000 UTC m=+2178.205136407"
Sep 07 13:35:57.136688 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:57.136661    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-849b74d9cb-xz4w2"
Sep 07 13:35:58.150657 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:58.150625    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-758db4577b-gcshw"]
Sep 07 13:35:58.151059 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:58.151044    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27a9b368-f0fb-44b5-ab0c-cb72509654c3" containerName="istio-proxy"
Sep 07 13:35:58.151105 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:58.151061    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="27a9b368-f0fb-44b5-ab0c-cb72509654c3" containerName="istio-proxy"
Sep 07 13:35:58.154339 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:58.154319    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-758db4577b-gcshw"
Sep 07 13:35:58.165219 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:58.165197    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-758db4577b-gcshw"]
Sep 07 13:35:58.296519 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:58.296496    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cda3520-8379-4482-94db-76d2d0eadefd-maas-api-tls\") pod \"maas-api-758db4577b-gcshw\" (UID: \"2cda3520-8379-4482-94db-76d2d0eadefd\") " pod="odh-ai-gateway-infra/maas-api-758db4577b-gcshw"
Sep 07 13:35:58.296629 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:58.296541    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cda3520-8379-4482-94db-76d2d0eadefd-metrics-certs\") pod \"maas-api-758db4577b-gcshw\" (UID: \"2cda3520-8379-4482-94db-76d2d0eadefd\") " pod="odh-ai-gateway-infra/maas-api-758db4577b-gcshw"
Sep 07 13:35:58.296629 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:58.296567    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cda3520-8379-4482-94db-76d2d0eadefd-openshift-service-ca\") pod \"maas-api-758db4577b-gcshw\" (UID: \"2cda3520-8379-4482-94db-76d2d0eadefd\") " pod="odh-ai-gateway-infra/maas-api-758db4577b-gcshw"
Sep 07 13:35:58.296721 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:58.296648    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcnvt\" (UniqueName: \"kubernetes.io/projected/2cda3520-8379-4482-94db-76d2d0eadefd-kube-api-access-kcnvt\") pod \"maas-api-758db4577b-gcshw\" (UID: \"2cda3520-8379-4482-94db-76d2d0eadefd\") " pod="odh-ai-gateway-infra/maas-api-758db4577b-gcshw"
Sep 07 13:35:58.397917 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:58.397891    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cda3520-8379-4482-94db-76d2d0eadefd-metrics-certs\") pod \"maas-api-758db4577b-gcshw\" (UID: \"2cda3520-8379-4482-94db-76d2d0eadefd\") " pod="odh-ai-gateway-infra/maas-api-758db4577b-gcshw"
Sep 07 13:35:58.398004 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:58.397929    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cda3520-8379-4482-94db-76d2d0eadefd-openshift-service-ca\") pod \"maas-api-758db4577b-gcshw\" (UID: \"2cda3520-8379-4482-94db-76d2d0eadefd\") " pod="odh-ai-gateway-infra/maas-api-758db4577b-gcshw"
Sep 07 13:35:58.398004 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:58.397955    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcnvt\" (UniqueName: \"kubernetes.io/projected/2cda3520-8379-4482-94db-76d2d0eadefd-kube-api-access-kcnvt\") pod \"maas-api-758db4577b-gcshw\" (UID: \"2cda3520-8379-4482-94db-76d2d0eadefd\") " pod="odh-ai-gateway-infra/maas-api-758db4577b-gcshw"
Sep 07 13:35:58.398004 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:58.397997    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cda3520-8379-4482-94db-76d2d0eadefd-maas-api-tls\") pod \"maas-api-758db4577b-gcshw\" (UID: \"2cda3520-8379-4482-94db-76d2d0eadefd\") " pod="odh-ai-gateway-infra/maas-api-758db4577b-gcshw"
Sep 07 13:35:58.398599 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:58.398553    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2cda3520-8379-4482-94db-76d2d0eadefd-openshift-service-ca\") pod \"maas-api-758db4577b-gcshw\" (UID: \"2cda3520-8379-4482-94db-76d2d0eadefd\") " pod="odh-ai-gateway-infra/maas-api-758db4577b-gcshw"
Sep 07 13:35:58.400378 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:58.400360    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2cda3520-8379-4482-94db-76d2d0eadefd-maas-api-tls\") pod \"maas-api-758db4577b-gcshw\" (UID: \"2cda3520-8379-4482-94db-76d2d0eadefd\") " pod="odh-ai-gateway-infra/maas-api-758db4577b-gcshw"
Sep 07 13:35:58.400448 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:58.400398    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2cda3520-8379-4482-94db-76d2d0eadefd-metrics-certs\") pod \"maas-api-758db4577b-gcshw\" (UID: \"2cda3520-8379-4482-94db-76d2d0eadefd\") " pod="odh-ai-gateway-infra/maas-api-758db4577b-gcshw"
Sep 07 13:35:58.409675 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:58.409631    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcnvt\" (UniqueName: \"kubernetes.io/projected/2cda3520-8379-4482-94db-76d2d0eadefd-kube-api-access-kcnvt\") pod \"maas-api-758db4577b-gcshw\" (UID: \"2cda3520-8379-4482-94db-76d2d0eadefd\") " pod="odh-ai-gateway-infra/maas-api-758db4577b-gcshw"
Sep 07 13:35:58.464197 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:58.464182    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-758db4577b-gcshw"
Sep 07 13:35:58.736762 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:58.736742    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-758db4577b-gcshw"]
Sep 07 13:35:58.738604 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:35:58.738579    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cda3520_8379_4482_94db_76d2d0eadefd.slice/crio-4a8088786e911fa11a755a91420149393d4f90a14564496bdc4db1c099c1bf08 WatchSource:0}: Error finding container 4a8088786e911fa11a755a91420149393d4f90a14564496bdc4db1c099c1bf08: Status 404 returned error can't find the container with id 4a8088786e911fa11a755a91420149393d4f90a14564496bdc4db1c099c1bf08
Sep 07 13:35:58.741225 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:58.741205    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:35:59.164282 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:35:59.164257    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-758db4577b-gcshw" event={"ID":"2cda3520-8379-4482-94db-76d2d0eadefd","Type":"ContainerStarted","Data":"4a8088786e911fa11a755a91420149393d4f90a14564496bdc4db1c099c1bf08"}
Sep 07 13:36:00.170472 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:00.170434    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-758db4577b-gcshw" event={"ID":"2cda3520-8379-4482-94db-76d2d0eadefd","Type":"ContainerStarted","Data":"d5a0dbe69696ad54fc0dd550ea7272dba23b881a3438608078abd26cb27a5c1b"}
Sep 07 13:36:00.170874 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:00.170522    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-758db4577b-gcshw"
Sep 07 13:36:00.195580 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:00.195538    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-758db4577b-gcshw" podStartSLOduration=1.611879208 podStartE2EDuration="2.195527129s" totalImagesPullingTime="583.647921ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-07 13:35:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:36:00.195113377 +0000 UTC m=+2187.251995033" watchObservedRunningTime="2026-09-07 13:36:00.195527129 +0000 UTC m=+2187.252408785"
Sep 07 13:36:06.179869 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:06.179838    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-758db4577b-gcshw"
Sep 07 13:36:06.230646 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:06.230594    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-849b74d9cb-xz4w2"]
Sep 07 13:36:06.230890 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:06.230838    2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-849b74d9cb-xz4w2" podUID="93beb891-f8cf-4d0a-83e2-0f5566fbac27" containerName="maas-api" containerID="cri-o://123ab0e7a0e4f5822bb7042c14739243fe046be461a97adc195f3a6a7f3073d7" gracePeriod=30
Sep 07 13:36:06.470075 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:06.470054    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-849b74d9cb-xz4w2"
Sep 07 13:36:06.557408 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:06.557378    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93beb891-f8cf-4d0a-83e2-0f5566fbac27-maas-api-tls\") pod \"93beb891-f8cf-4d0a-83e2-0f5566fbac27\" (UID: \"93beb891-f8cf-4d0a-83e2-0f5566fbac27\") "
Sep 07 13:36:06.557517 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:06.557415    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93beb891-f8cf-4d0a-83e2-0f5566fbac27-openshift-service-ca\") pod \"93beb891-f8cf-4d0a-83e2-0f5566fbac27\" (UID: \"93beb891-f8cf-4d0a-83e2-0f5566fbac27\") "
Sep 07 13:36:06.557517 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:06.557472    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxhmr\" (UniqueName: \"kubernetes.io/projected/93beb891-f8cf-4d0a-83e2-0f5566fbac27-kube-api-access-wxhmr\") pod \"93beb891-f8cf-4d0a-83e2-0f5566fbac27\" (UID: \"93beb891-f8cf-4d0a-83e2-0f5566fbac27\") "
Sep 07 13:36:06.557627 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:06.557524    2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93beb891-f8cf-4d0a-83e2-0f5566fbac27-metrics-certs\") pod \"93beb891-f8cf-4d0a-83e2-0f5566fbac27\" (UID: \"93beb891-f8cf-4d0a-83e2-0f5566fbac27\") "
Sep 07 13:36:06.557873 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:06.557844    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93beb891-f8cf-4d0a-83e2-0f5566fbac27-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "93beb891-f8cf-4d0a-83e2-0f5566fbac27" (UID: "93beb891-f8cf-4d0a-83e2-0f5566fbac27"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 07 13:36:06.559567 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:06.559547    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93beb891-f8cf-4d0a-83e2-0f5566fbac27-kube-api-access-wxhmr" (OuterVolumeSpecName: "kube-api-access-wxhmr") pod "93beb891-f8cf-4d0a-83e2-0f5566fbac27" (UID: "93beb891-f8cf-4d0a-83e2-0f5566fbac27"). InnerVolumeSpecName "kube-api-access-wxhmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 07 13:36:06.560042 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:06.560023    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93beb891-f8cf-4d0a-83e2-0f5566fbac27-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "93beb891-f8cf-4d0a-83e2-0f5566fbac27" (UID: "93beb891-f8cf-4d0a-83e2-0f5566fbac27"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:36:06.560042 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:06.560031    2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93beb891-f8cf-4d0a-83e2-0f5566fbac27-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "93beb891-f8cf-4d0a-83e2-0f5566fbac27" (UID: "93beb891-f8cf-4d0a-83e2-0f5566fbac27"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 07 13:36:06.658907 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:06.658885    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxhmr\" (UniqueName: \"kubernetes.io/projected/93beb891-f8cf-4d0a-83e2-0f5566fbac27-kube-api-access-wxhmr\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:36:06.658907 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:06.658906    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/93beb891-f8cf-4d0a-83e2-0f5566fbac27-metrics-certs\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:36:06.659030 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:06.658915    2576 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93beb891-f8cf-4d0a-83e2-0f5566fbac27-maas-api-tls\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:36:06.659030 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:06.658925    2576 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93beb891-f8cf-4d0a-83e2-0f5566fbac27-openshift-service-ca\") on node \"ip-10-0-142-74.ec2.internal\" DevicePath \"\""
Sep 07 13:36:06.945402 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:06.945370    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:36:07.206243 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:07.206189    2576 generic.go:356] "Generic (PLEG): container finished" podID="93beb891-f8cf-4d0a-83e2-0f5566fbac27" containerID="123ab0e7a0e4f5822bb7042c14739243fe046be461a97adc195f3a6a7f3073d7" exitCode=0
Sep 07 13:36:07.206243 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:07.206233    2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-849b74d9cb-xz4w2"
Sep 07 13:36:07.206652 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:07.206237    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-849b74d9cb-xz4w2" event={"ID":"93beb891-f8cf-4d0a-83e2-0f5566fbac27","Type":"ContainerDied","Data":"123ab0e7a0e4f5822bb7042c14739243fe046be461a97adc195f3a6a7f3073d7"}
Sep 07 13:36:07.206652 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:07.206359    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-849b74d9cb-xz4w2" event={"ID":"93beb891-f8cf-4d0a-83e2-0f5566fbac27","Type":"ContainerDied","Data":"e0eee229651b673b28704475960fc65e2aedc0dcd3e3999be905f587756d9523"}
Sep 07 13:36:07.206652 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:07.206386    2576 scope.go:117] "RemoveContainer" containerID="123ab0e7a0e4f5822bb7042c14739243fe046be461a97adc195f3a6a7f3073d7"
Sep 07 13:36:07.215585 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:07.215570    2576 scope.go:117] "RemoveContainer" containerID="123ab0e7a0e4f5822bb7042c14739243fe046be461a97adc195f3a6a7f3073d7"
Sep 07 13:36:07.215889 ip-10-0-142-74 kubenswrapper[2576]: E0907 13:36:07.215873    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"123ab0e7a0e4f5822bb7042c14739243fe046be461a97adc195f3a6a7f3073d7\": container with ID starting with 123ab0e7a0e4f5822bb7042c14739243fe046be461a97adc195f3a6a7f3073d7 not found: ID does not exist" containerID="123ab0e7a0e4f5822bb7042c14739243fe046be461a97adc195f3a6a7f3073d7"
Sep 07 13:36:07.215942 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:07.215898    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"123ab0e7a0e4f5822bb7042c14739243fe046be461a97adc195f3a6a7f3073d7"} err="failed to get container status \"123ab0e7a0e4f5822bb7042c14739243fe046be461a97adc195f3a6a7f3073d7\": rpc error: code = NotFound desc = could not find container \"123ab0e7a0e4f5822bb7042c14739243fe046be461a97adc195f3a6a7f3073d7\": container with ID starting with 123ab0e7a0e4f5822bb7042c14739243fe046be461a97adc195f3a6a7f3073d7 not found: ID does not exist"
Sep 07 13:36:07.228349 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:07.228330    2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-849b74d9cb-xz4w2"]
Sep 07 13:36:07.236490 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:07.236467    2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-849b74d9cb-xz4w2"]
Sep 07 13:36:07.366117 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:07.366089    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93beb891-f8cf-4d0a-83e2-0f5566fbac27" path="/var/lib/kubelet/pods/93beb891-f8cf-4d0a-83e2-0f5566fbac27/volumes"
Sep 07 13:36:10.166003 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:10.165975    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:36:13.379162 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:13.379131    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:36:15.051446 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:15.051420    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:36:18.340470 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:18.340432    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:36:18.426544 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:18.426507    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:36:19.549473 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:19.549445    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-c9tx5"]
Sep 07 13:36:28.470590 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:28.470566    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-g99rz_4f9f98c9-fd40-4637-b936-eb0bb0de7d03/manager/0.log"
Sep 07 13:36:28.599578 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:28.599553    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-m7j69_06b0d273-1cab-48c1-b496-5326a1520599/manager/0.log"
Sep 07 13:36:28.866521 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:28.866458    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-fw2fb_a69dd3a5-db4c-403a-8961-6e7aed5e70e0/server/0.log"
Sep 07 13:36:29.005894 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:29.005869    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-jx59c_219099a8-0a0b-4510-87ec-cff07e64b9b3/manager/0.log"
Sep 07 13:36:29.128721 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:29.128703    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5545ff49d6-4942p_db99403c-d6cf-424f-beca-d5ad61cd13c9/copy-manifests/0.log"
Sep 07 13:36:29.135884 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:29.135863    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5545ff49d6-4942p_db99403c-d6cf-424f-beca-d5ad61cd13c9/manager/0.log"
Sep 07 13:36:29.776028 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:29.776006    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-758db4577b-gcshw_2cda3520-8379-4482-94db-76d2d0eadefd/maas-api/0.log"
Sep 07 13:36:30.009077 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:30.009057    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29813115-6rvvt_df8fa039-c7d4-4e2a-8300-0efb419c669d/cleanup/0.log"
Sep 07 13:36:31.161523 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:31.161493    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-zcnpb_e8cc3baf-7dc7-4703-b7cc-890301e2a493/manager/0.log"
Sep 07 13:36:31.396303 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:31.396276    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-kc5qj_5509d6ee-76cf-4a10-a45c-50b60681fe98/kuadrant-console-plugin/0.log"
Sep 07 13:36:31.651749 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:31.651725    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-c9tx5_bf705471-c582-48a1-994f-dc50157bfa19/limitador/0.log"
Sep 07 13:36:33.008640 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:33.008619    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-848fc6765d-blcdh_4e745f4b-1d80-4c19-91ae-9fbe643572de/router/0.log"
Sep 07 13:36:33.483394 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:33.483369    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-vnnrp_ecadf0a0-420c-475d-af92-c344ac37f9d1/main/0.log"
Sep 07 13:36:33.984297 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:33.984271    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-nv7nq_218996b8-4158-4188-a9b7-40f5655b0859/main/0.log"
Sep 07 13:36:40.199855 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:40.199817    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:36:41.797890 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:41.797849    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:36:43.403506 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:43.403475    2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log" limit=1024
Sep 07 13:36:43.631659 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:43.631635    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-sjggc_a5d02c03-a753-4457-ab6a-99c8285ca9aa/global-pull-secret-syncer/0.log"
Sep 07 13:36:43.710607 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:43.710549    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-78vt9_c5179ef2-d701-44ec-8758-673214b5efde/konnectivity-agent/0.log"
Sep 07 13:36:43.925725 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:43.925701    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-142-74.ec2.internal_b4b5c62f53d64b7cd5db1bd47dc9efbb/haproxy/0.log"
Sep 07 13:36:48.909581 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:48.909557    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-zcnpb_e8cc3baf-7dc7-4703-b7cc-890301e2a493/manager/0.log"
Sep 07 13:36:49.007755 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:49.007729    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-kc5qj_5509d6ee-76cf-4a10-a45c-50b60681fe98/kuadrant-console-plugin/0.log"
Sep 07 13:36:49.143167 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:49.143148    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-c9tx5_bf705471-c582-48a1-994f-dc50157bfa19/limitador/0.log"
Sep 07 13:36:50.672177 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:50.672146    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fb44493e-dd4e-4932-8b77-a893b02b4282/alertmanager/0.log"
Sep 07 13:36:50.704570 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:50.704548    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fb44493e-dd4e-4932-8b77-a893b02b4282/config-reloader/0.log"
Sep 07 13:36:50.734033 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:50.734010    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fb44493e-dd4e-4932-8b77-a893b02b4282/kube-rbac-proxy-web/0.log"
Sep 07 13:36:50.765246 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:50.765201    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fb44493e-dd4e-4932-8b77-a893b02b4282/kube-rbac-proxy/0.log"
Sep 07 13:36:50.792466 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:50.792444    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fb44493e-dd4e-4932-8b77-a893b02b4282/kube-rbac-proxy-metric/0.log"
Sep 07 13:36:50.822383 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:50.822364    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fb44493e-dd4e-4932-8b77-a893b02b4282/prom-label-proxy/0.log"
Sep 07 13:36:50.856474 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:50.856452    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_fb44493e-dd4e-4932-8b77-a893b02b4282/init-config-reloader/0.log"
Sep 07 13:36:51.479389 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:51.479364    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qw8s6_801449fb-a088-44ae-acf7-2e6da783b37e/node-exporter/0.log"
Sep 07 13:36:51.507644 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:51.507622    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qw8s6_801449fb-a088-44ae-acf7-2e6da783b37e/kube-rbac-proxy/0.log"
Sep 07 13:36:51.543264 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:51.543247    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qw8s6_801449fb-a088-44ae-acf7-2e6da783b37e/init-textfile/0.log"
Sep 07 13:36:51.582445 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:51.582429    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-827pf_ed7a2c54-2a5f-47b8-9704-5aee9061ff2d/kube-rbac-proxy-main/0.log"
Sep 07 13:36:51.616180 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:51.616160    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-827pf_ed7a2c54-2a5f-47b8-9704-5aee9061ff2d/kube-rbac-proxy-self/0.log"
Sep 07 13:36:51.643134 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:51.643119    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-827pf_ed7a2c54-2a5f-47b8-9704-5aee9061ff2d/openshift-state-metrics/0.log"
Sep 07 13:36:52.007858 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:52.007842    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-wsd6j_e804131e-7b54-4039-b95b-802ca1bde3da/prometheus-operator-admission-webhook/0.log"
Sep 07 13:36:52.073546 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:52.073519    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fb7f9d697-dnxtq_5c964cb6-84c7-4706-931a-d5d689cf59fe/telemeter-client/0.log"
Sep 07 13:36:52.100938 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:52.100913    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fb7f9d697-dnxtq_5c964cb6-84c7-4706-931a-d5d689cf59fe/reload/0.log"
Sep 07 13:36:52.137822 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:52.137791    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-fb7f9d697-dnxtq_5c964cb6-84c7-4706-931a-d5d689cf59fe/kube-rbac-proxy/0.log"
Sep 07 13:36:53.760416 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:53.760386    2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-scn9z/perf-node-gather-daemonset-7sdzp"]
Sep 07 13:36:53.760847 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:53.760735    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93beb891-f8cf-4d0a-83e2-0f5566fbac27" containerName="maas-api"
Sep 07 13:36:53.760847 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:53.760746    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="93beb891-f8cf-4d0a-83e2-0f5566fbac27" containerName="maas-api"
Sep 07 13:36:53.760847 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:53.760829    2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="93beb891-f8cf-4d0a-83e2-0f5566fbac27" containerName="maas-api"
Sep 07 13:36:53.763817 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:53.763794    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-scn9z/perf-node-gather-daemonset-7sdzp"
Sep 07 13:36:53.766080 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:53.766048    2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-scn9z\"/\"default-dockercfg-wv848\""
Sep 07 13:36:53.766203 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:53.766081    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-scn9z\"/\"kube-root-ca.crt\""
Sep 07 13:36:53.766514 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:53.766498    2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-scn9z\"/\"openshift-service-ca.crt\""
Sep 07 13:36:53.776960 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:53.776938    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-scn9z/perf-node-gather-daemonset-7sdzp"]
Sep 07 13:36:53.793300 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:53.793264    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7ff3e3dd-ffb4-4eea-9c93-f25bfe713952-podres\") pod \"perf-node-gather-daemonset-7sdzp\" (UID: \"7ff3e3dd-ffb4-4eea-9c93-f25bfe713952\") " pod="openshift-must-gather-scn9z/perf-node-gather-daemonset-7sdzp"
Sep 07 13:36:53.793418 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:53.793310    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ff3e3dd-ffb4-4eea-9c93-f25bfe713952-lib-modules\") pod \"perf-node-gather-daemonset-7sdzp\" (UID: \"7ff3e3dd-ffb4-4eea-9c93-f25bfe713952\") " pod="openshift-must-gather-scn9z/perf-node-gather-daemonset-7sdzp"
Sep 07 13:36:53.793418 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:53.793345    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ff3e3dd-ffb4-4eea-9c93-f25bfe713952-sys\") pod \"perf-node-gather-daemonset-7sdzp\" (UID: \"7ff3e3dd-ffb4-4eea-9c93-f25bfe713952\") " pod="openshift-must-gather-scn9z/perf-node-gather-daemonset-7sdzp"
Sep 07 13:36:53.793418 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:53.793379    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7sh2l\" (UniqueName: \"kubernetes.io/projected/7ff3e3dd-ffb4-4eea-9c93-f25bfe713952-kube-api-access-7sh2l\") pod \"perf-node-gather-daemonset-7sdzp\" (UID: \"7ff3e3dd-ffb4-4eea-9c93-f25bfe713952\") " pod="openshift-must-gather-scn9z/perf-node-gather-daemonset-7sdzp"
Sep 07 13:36:53.793541 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:53.793445    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7ff3e3dd-ffb4-4eea-9c93-f25bfe713952-proc\") pod \"perf-node-gather-daemonset-7sdzp\" (UID: \"7ff3e3dd-ffb4-4eea-9c93-f25bfe713952\") " pod="openshift-must-gather-scn9z/perf-node-gather-daemonset-7sdzp"
Sep 07 13:36:53.894002 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:53.893980    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ff3e3dd-ffb4-4eea-9c93-f25bfe713952-lib-modules\") pod \"perf-node-gather-daemonset-7sdzp\" (UID: \"7ff3e3dd-ffb4-4eea-9c93-f25bfe713952\") " pod="openshift-must-gather-scn9z/perf-node-gather-daemonset-7sdzp"
Sep 07 13:36:53.894095 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:53.894005    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ff3e3dd-ffb4-4eea-9c93-f25bfe713952-sys\") pod \"perf-node-gather-daemonset-7sdzp\" (UID: \"7ff3e3dd-ffb4-4eea-9c93-f25bfe713952\") " pod="openshift-must-gather-scn9z/perf-node-gather-daemonset-7sdzp"
Sep 07 13:36:53.894095 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:53.894032    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7sh2l\" (UniqueName: \"kubernetes.io/projected/7ff3e3dd-ffb4-4eea-9c93-f25bfe713952-kube-api-access-7sh2l\") pod \"perf-node-gather-daemonset-7sdzp\" (UID: \"7ff3e3dd-ffb4-4eea-9c93-f25bfe713952\") " pod="openshift-must-gather-scn9z/perf-node-gather-daemonset-7sdzp"
Sep 07 13:36:53.894095 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:53.894070    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7ff3e3dd-ffb4-4eea-9c93-f25bfe713952-proc\") pod \"perf-node-gather-daemonset-7sdzp\" (UID: \"7ff3e3dd-ffb4-4eea-9c93-f25bfe713952\") " pod="openshift-must-gather-scn9z/perf-node-gather-daemonset-7sdzp"
Sep 07 13:36:53.894202 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:53.894107    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7ff3e3dd-ffb4-4eea-9c93-f25bfe713952-sys\") pod \"perf-node-gather-daemonset-7sdzp\" (UID: \"7ff3e3dd-ffb4-4eea-9c93-f25bfe713952\") " pod="openshift-must-gather-scn9z/perf-node-gather-daemonset-7sdzp"
Sep 07 13:36:53.894202 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:53.894153    2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7ff3e3dd-ffb4-4eea-9c93-f25bfe713952-podres\") pod \"perf-node-gather-daemonset-7sdzp\" (UID: \"7ff3e3dd-ffb4-4eea-9c93-f25bfe713952\") " pod="openshift-must-gather-scn9z/perf-node-gather-daemonset-7sdzp"
Sep 07 13:36:53.894202 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:53.894160    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7ff3e3dd-ffb4-4eea-9c93-f25bfe713952-proc\") pod \"perf-node-gather-daemonset-7sdzp\" (UID: \"7ff3e3dd-ffb4-4eea-9c93-f25bfe713952\") " pod="openshift-must-gather-scn9z/perf-node-gather-daemonset-7sdzp"
Sep 07 13:36:53.894300 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:53.894153    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7ff3e3dd-ffb4-4eea-9c93-f25bfe713952-lib-modules\") pod \"perf-node-gather-daemonset-7sdzp\" (UID: \"7ff3e3dd-ffb4-4eea-9c93-f25bfe713952\") " pod="openshift-must-gather-scn9z/perf-node-gather-daemonset-7sdzp"
Sep 07 13:36:53.894300 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:53.894209    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7ff3e3dd-ffb4-4eea-9c93-f25bfe713952-podres\") pod \"perf-node-gather-daemonset-7sdzp\" (UID: \"7ff3e3dd-ffb4-4eea-9c93-f25bfe713952\") " pod="openshift-must-gather-scn9z/perf-node-gather-daemonset-7sdzp"
Sep 07 13:36:53.903425 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:53.903407    2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7sh2l\" (UniqueName: \"kubernetes.io/projected/7ff3e3dd-ffb4-4eea-9c93-f25bfe713952-kube-api-access-7sh2l\") pod \"perf-node-gather-daemonset-7sdzp\" (UID: \"7ff3e3dd-ffb4-4eea-9c93-f25bfe713952\") " pod="openshift-must-gather-scn9z/perf-node-gather-daemonset-7sdzp"
Sep 07 13:36:54.073512 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:54.073464    2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-scn9z/perf-node-gather-daemonset-7sdzp"
Sep 07 13:36:54.292145 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:54.292118    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-v9pd8_d2bb2527-1a29-4b7e-b6fb-9be32693a5cd/console-operator/1.log"
Sep 07 13:36:54.300888 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:54.300868    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-v9pd8_d2bb2527-1a29-4b7e-b6fb-9be32693a5cd/console-operator/2.log"
Sep 07 13:36:54.344417 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:54.344395    2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-scn9z/perf-node-gather-daemonset-7sdzp"]
Sep 07 13:36:54.345527 ip-10-0-142-74 kubenswrapper[2576]: W0907 13:36:54.345506    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7ff3e3dd_ffb4_4eea_9c93_f25bfe713952.slice/crio-cc1265d3abc8b8c4d006600b8f26285fddc2c7b3286f38219ead07f98cdd3ef0 WatchSource:0}: Error finding container cc1265d3abc8b8c4d006600b8f26285fddc2c7b3286f38219ead07f98cdd3ef0: Status 404 returned error can't find the container with id cc1265d3abc8b8c4d006600b8f26285fddc2c7b3286f38219ead07f98cdd3ef0
Sep 07 13:36:54.410726 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:54.410703    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-scn9z/perf-node-gather-daemonset-7sdzp" event={"ID":"7ff3e3dd-ffb4-4eea-9c93-f25bfe713952","Type":"ContainerStarted","Data":"cc1265d3abc8b8c4d006600b8f26285fddc2c7b3286f38219ead07f98cdd3ef0"}
Sep 07 13:36:54.845467 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:54.845443    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-58494dbf74-x8qdg_abfb31fd-c21d-4560-bd91-a3f79785c2f8/console/0.log"
Sep 07 13:36:55.416997 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:55.416972    2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-scn9z/perf-node-gather-daemonset-7sdzp" event={"ID":"7ff3e3dd-ffb4-4eea-9c93-f25bfe713952","Type":"ContainerStarted","Data":"628081d9f0460e244dccc7fa30c8540cf8039fafa4fa335efde36b026dad8e96"}
Sep 07 13:36:55.417122 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:55.417094    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-scn9z/perf-node-gather-daemonset-7sdzp"
Sep 07 13:36:55.438635 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:55.438598    2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-scn9z/perf-node-gather-daemonset-7sdzp" podStartSLOduration=2.438581583 podStartE2EDuration="2.438581583s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-07 13:36:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-07 13:36:55.438274067 +0000 UTC m=+2242.495155723" watchObservedRunningTime="2026-09-07 13:36:55.438581583 +0000 UTC m=+2242.495463271"
Sep 07 13:36:55.555054 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:55.555034    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-nl9hf_c4eea408-8172-4e4d-bc5f-c1674c0b7169/volume-data-source-validator/0.log"
Sep 07 13:36:56.746606 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:56.746577    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hpwk6_e0ec59be-b6b6-47de-8b39-41cd853d72ac/dns/0.log"
Sep 07 13:36:56.773706 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:56.773679    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hpwk6_e0ec59be-b6b6-47de-8b39-41cd853d72ac/kube-rbac-proxy/0.log"
Sep 07 13:36:56.868449 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:56.868425    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-75jvc_a81301be-0f84-4fbb-a496-08f21fe21ad7/dns-node-resolver/0.log"
Sep 07 13:36:57.612161 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:57.612141    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wwf4n_c42a485d-29e3-41f3-aa5e-d1100b1b0c54/node-ca/0.log"
Sep 07 13:36:59.443600 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:36:59.443568    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-848fc6765d-blcdh_4e745f4b-1d80-4c19-91ae-9fbe643572de/router/0.log"
Sep 07 13:37:00.403327 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:37:00.403300    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m5qjt_14038337-346f-4a5e-96bc-d4004f778bc1/serve-healthcheck-canary/0.log"
Sep 07 13:37:00.953760 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:37:00.953728    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-hk2dx_9a2c14fb-81d2-4056-bf98-ac72b0b69aae/insights-operator/0.log"
Sep 07 13:37:00.954157 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:37:00.954080    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-hk2dx_9a2c14fb-81d2-4056-bf98-ac72b0b69aae/insights-operator/1.log"
Sep 07 13:37:01.097984 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:37:01.097957    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n7562_b22bc703-6502-4474-b93c-9a040ce34a18/kube-rbac-proxy/0.log"
Sep 07 13:37:01.124972 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:37:01.124948    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n7562_b22bc703-6502-4474-b93c-9a040ce34a18/exporter/0.log"
Sep 07 13:37:01.151245 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:37:01.151224    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n7562_b22bc703-6502-4474-b93c-9a040ce34a18/extractor/0.log"
Sep 07 13:37:01.434922 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:37:01.434899    2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-scn9z/perf-node-gather-daemonset-7sdzp"
Sep 07 13:37:03.813742 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:37:03.813713    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-g99rz_4f9f98c9-fd40-4637-b936-eb0bb0de7d03/manager/0.log"
Sep 07 13:37:04.116714 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:37:04.116649    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-m7j69_06b0d273-1cab-48c1-b496-5326a1520599/manager/0.log"
Sep 07 13:37:04.281046 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:37:04.281022    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-fw2fb_a69dd3a5-db4c-403a-8961-6e7aed5e70e0/server/0.log"
Sep 07 13:37:04.447583 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:37:04.447559    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-jx59c_219099a8-0a0b-4510-87ec-cff07e64b9b3/manager/0.log"
Sep 07 13:37:04.557701 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:37:04.557677    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5545ff49d6-4942p_db99403c-d6cf-424f-beca-d5ad61cd13c9/manager/0.log"
Sep 07 13:37:04.602492 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:37:04.602473    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5545ff49d6-4942p_db99403c-d6cf-424f-beca-d5ad61cd13c9/copy-manifests/0.log"
Sep 07 13:37:04.830957 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:37:04.830930    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-848fc6765d-blcdh_4e745f4b-1d80-4c19-91ae-9fbe643572de/router/0.log"
Sep 07 13:37:06.271373 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:37:06.271322    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-58cbfb6566-pcgpw_6c977864-524e-4aaa-b2a0-8ccff913aa83/manager/0.log"
Sep 07 13:37:07.169498 ip-10-0-142-74 kubenswrapper[2576]: I0907 13:37:07.169458    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-848fc6765d-blcdh_4e745f4b-1d80-4c19-91ae-9fbe643572de/router/0.log"